[2025-09-26T17:00:01.505737] [INFO ] [MAIN ] Using last completed trading day: 2025-09-26 [2025-09-26T17:00:01.506242] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-26T17:00:01.506357] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-26T17:00:01.506399] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-26T17:00:03.010060] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-26T17:00:03.010243] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-26T17:00:03.010448] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-26T17:00:03.011265] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-26T17:00:03.011328] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-26T17:00:03.011362] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-26T17:00:03.011424] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-26T17:00:03.011586] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-26T17:00:03.011982] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-26T17:00:03.012027] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-26T17:00:03.012187] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-26T17:00:03.012222] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-26T17:00:03.012254] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-26T17:00:03.012285] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-26T17:00:03.035960] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/KLG.csv (symbol KLG no longer active). [2025-09-26T17:00:03.040530] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/PHT.csv (symbol PHT no longer active). [2025-09-26T17:00:03.041010] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-26T17:00:03.063044] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/KLG.csv (symbol KLG no longer active). [2025-09-26T17:00:03.067181] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/PHT.csv (symbol PHT no longer active). [2025-09-26T17:00:03.067615] [INFO ] [LOCAL ] Deleted 4 obsolete data files. [2025-09-26T17:00:03.067696] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-26T17:00:03.067750] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-26T17:00:03.067782] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-26T17:00:03.068097] [WARN ] [STATE ] State set to: RUNNING [2025-09-26T17:00:03.068264] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-26T17:00:03.068693] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-26T17:00:03.068747] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-26T17:00:03.068782] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-26T17:00:03.068813] [INFO ] [MAIN ] Running in parallel mode [2025-09-26T17:00:03.068930] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-26T17:00:03.769035] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:03.826440] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:03.846097] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:03.851238] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-26T17:00:03.851152] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:03.854434] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-26T17:00:03.854491] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-26T17:00:03.854340] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-26T17:00:03.854716] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-26T17:00:03.854891] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-26T17:00:03.854950] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-26T17:00:03.855011] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-26T17:00:03.855094] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-26T17:00:03.854986] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-26T17:00:03.855221] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-26T17:00:03.869058] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-26T17:00:04.660142] [DEBUG] [LOCAL ] AA: Loaded 54004 existing records from primary storage. [2025-09-26T17:00:04.693184] [INFO ] [MAIN ] AA: Loaded 54004 existing records. [2025-09-26T17:00:04.724324] [DEBUG] [LOCAL ] A: Loaded 51143 existing records from primary storage. [2025-09-26T17:00:04.728312] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:04.728485] [INFO ] [MAIN ] A: Loaded 51143 existing records. [2025-09-26T17:00:04.756584] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-26T17:00:05.065023] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:05.098306] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-26T17:00:05.216776] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:05.236010] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-26T17:00:05.261711] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:05.261501] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-26T17:00:05.262124] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-26T17:00:05.262252] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-26T17:00:05.264147] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-26T17:00:05.264184] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-26T17:00:05.264341] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-26T17:00:05.264409] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-26T17:00:05.448983] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T17:00:05.439954] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:05.505701] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-26T17:00:05.510929] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-26T17:00:05.524784] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-26T17:00:06.022282] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:00:06.063921] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-26T17:00:06.145216] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:06.146799] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-26T17:00:06.172157] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:06.173473] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-26T17:00:06.511186] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T17:00:06.512410] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-26T17:00:06.674901] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T17:00:06.679196] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-26T17:00:06.787932] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-26T17:00:06.788924] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-26T17:00:07.584457] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T17:00:07.585492] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-26T17:00:07.627557] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:00:07.638735] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-26T17:00:07.651359] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T17:00:07.656337] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-26T17:00:07.817609] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:00:07.829223] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-26T17:00:07.882191] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-26T17:00:07.883084] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-26T17:00:08.202962] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-26T17:00:08.204112] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-26T17:00:08.477113] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-26T17:00:08.478094] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-26T17:00:08.833315] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T17:00:08.839096] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-26T17:00:08.935228] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T17:00:08.936462] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-26T17:00:09.349184] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-26T17:00:09.350802] [INFO ] [REMOTE ] AAM: Full fetch complete (966 records). [2025-09-26T17:00:09.351395] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-26T17:00:09.352565] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T17:00:09.353545] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:00:09.370639] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:00:09.371510] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:00:09.371680] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-26T17:00:09.372488] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-26T17:00:09.372604] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-26T17:00:09.372952] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-26T17:00:09.373205] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAM took 6.3s. Estimated remaining: 4h 9m 1s. Rate: 9.5 symbols/min [2025-09-26T17:00:09.374346] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-26T17:00:09.590848] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:09.634485] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:00:09.647180] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-26T17:00:09.705454] [DEBUG] [LOCAL ] AAP: Loaded 52464 existing records from primary storage. [2025-09-26T17:00:09.705674] [INFO ] [MAIN ] AAP: Loaded 52464 existing records. [2025-09-26T17:00:09.914463] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:09.914888] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-26T17:00:09.914955] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-26T17:00:09.922203] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-26T17:00:09.932266] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-26T17:00:09.938794] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T17:00:10.024872] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-26T17:00:10.332137] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:10.332518] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-26T17:00:10.906404] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T17:00:10.917789] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-26T17:00:10.933628] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T17:00:10.939911] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-26T17:00:11.664205] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-26T17:00:11.676927] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-26T17:00:11.851211] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T17:00:11.862843] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-26T17:00:12.075067] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T17:00:12.081767] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-26T17:00:12.487463] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:00:12.500562] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-26T17:00:13.310280] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:00:13.322492] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-26T17:00:13.353121] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T17:00:13.360940] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-26T17:00:13.431991] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:00:13.443620] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-26T17:00:13.963201] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:00:13.975664] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-26T17:00:14.181794] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T17:00:14.187875] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-26T17:00:14.794091] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T17:00:14.806021] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-26T17:00:15.065097] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T17:00:15.077724] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-26T17:00:15.261723] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:00:15.274331] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-26T17:00:16.133614] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T17:00:16.140032] [INFO ] [REMOTE ] AAMI: Full fetch complete (30735 records). [2025-09-26T17:00:16.140152] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-26T17:00:16.395277] [WARN ] [VALIDATOR ] AAMI: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-26T17:00:16.395753] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:00:16.395877] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:00:16.396170] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-26T17:00:16.396288] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-26T17:00:16.396340] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-26T17:00:16.396529] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-26T17:00:16.397112] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AAMI took 13.3s. Estimated remaining: 4h 23m 7s. Rate: 9.0 symbols/min [2025-09-26T17:00:16.614430] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:16.666225] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T17:00:16.697974] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T17:00:16.711120] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-26T17:00:16.721406] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-26T17:00:16.739118] [DEBUG] [LOCAL ] AAT: Loaded 30881 existing records from primary storage. [2025-09-26T17:00:16.739288] [INFO ] [MAIN ] AAT: Loaded 30881 existing records. [2025-09-26T17:00:16.965345] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:16.965838] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-26T17:00:16.965914] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-26T17:00:16.967340] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-26T17:00:16.967415] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-26T17:00:17.394240] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-26T17:00:17.508128] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-26T17:00:17.516318] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:17.518824] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-26T17:00:18.138832] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:00:18.157066] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-26T17:00:18.206298] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T17:00:18.221378] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-26T17:00:18.866584] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T17:00:18.872766] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-26T17:00:19.766855] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:00:19.779001] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-26T17:00:20.408005] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-26T17:00:20.427440] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-26T17:00:20.701607] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (3.19 seconds). [2025-09-26T17:00:20.713878] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-26T17:00:20.787105] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T17:00:20.793518] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-26T17:00:22.255066] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:00:22.267384] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-26T17:00:22.334722] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-26T17:00:22.348274] [INFO ] [REMOTE ] A: Full fetch complete (73040 records). [2025-09-26T17:00:22.348502] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-26T17:00:22.800852] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-26T17:00:22.801072] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-26T17:00:22.802243] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-26T17:00:22.802481] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-26T17:00:22.819020] [DEBUG] [LOCAL ] A: Trimmed 73040 records to 51487 (keeping 200 days of data) [2025-09-26T17:00:22.820278] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T17:00:22.827536] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-26T17:00:22.934869] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-26T17:00:22.988376] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-26T17:00:23.240386] [DEBUG] [LOCAL ] A: Primary data saved (51487 records). [2025-09-26T17:00:23.240561] [INFO ] [MAIN ] A: Full history saved. [2025-09-26T17:00:23.241300] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. A took 20.2s. Estimated remaining: 4h 25m 23s. Rate: 8.9 symbols/min [2025-09-26T17:00:23.445237] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:23.445449] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-26T17:00:23.445507] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-26T17:00:23.445700] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-26T17:00:23.445756] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-26T17:00:23.445803] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-26T17:00:23.445839] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-26T17:00:23.852409] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:23.853526] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-26T17:00:23.890394] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:00:23.898394] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-26T17:00:23.930801] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:00:23.945526] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-26T17:00:24.064194] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.064559] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-26T17:00:24.065190] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-26T17:00:24.281267] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.281597] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-26T17:00:24.282087] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-26T17:00:24.435337] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:00:24.448301] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-26T17:00:24.498060] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.498487] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-26T17:00:24.498988] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-26T17:00:24.710778] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.711137] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-26T17:00:24.711778] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-26T17:00:24.942125] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:24.942457] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-26T17:00:24.943083] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-26T17:00:24.987801] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:00:24.997248] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-26T17:00:25.081248] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T17:00:25.093717] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-26T17:00:25.195888] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:00:25.196341] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-26T17:00:25.196955] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-26T17:00:25.648585] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T17:00:25.651050] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-26T17:00:25.914423] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:00:25.922193] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-26T17:00:26.190009] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T17:00:26.192984] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-26T17:00:26.494351] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T17:00:26.505420] [INFO ] [REMOTE ] AAP: Full fetch complete (75085 records). [2025-09-26T17:00:26.505721] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-26T17:00:26.974194] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-26T17:00:27.009451] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-26T17:00:27.014498] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-26T17:00:27.020103] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-26T17:00:27.029126] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-26T17:00:27.029514] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:00:27.062070] [DEBUG] [LOCAL ] AAP: Trimmed 75085 records to 52789 (keeping 200 days of data) [2025-09-26T17:00:27.064613] [INFO ] [REMOTE ] AA: Full fetch complete (77538 records). [2025-09-26T17:00:27.064923] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-26T17:00:27.061907] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-26T17:00:27.067399] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T17:00:27.157182] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-26T17:00:27.694275] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-26T17:00:27.694944] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-26T17:00:27.698124] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-26T17:00:27.749541] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-26T17:00:27.787817] [DEBUG] [LOCAL ] AA: Trimmed 77538 records to 54394 (keeping 200 days of data) [2025-09-26T17:00:28.178237] [DEBUG] [LOCAL ] AAP: Primary data saved (52789 records). [2025-09-26T17:00:28.179052] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-26T17:00:28.180563] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. AAP took 18.8s. Estimated remaining: 4h 7m 40s. Rate: 9.6 symbols/min [2025-09-26T17:00:28.341257] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T17:00:28.380467] [INFO ] [REMOTE ] AAUC: Full fetch complete (7698 records). [2025-09-26T17:00:28.399440] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-26T17:00:28.404668] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:28.436706] [DEBUG] [LOCAL ] AB: No existing data file found in primary storage. [2025-09-26T17:00:28.447724] [WARN ] [MAIN ] AB: No existing data found, performing full refresh instead. [2025-09-26T17:00:28.472855] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-26T17:00:28.506580] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-26T17:00:28.536498] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-09-26T17:00:28.537178] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-26T17:00:28.691302] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 77 unique days, need 200 days [2025-09-26T17:00:28.697308] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:00:28.712023] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:00:28.738696] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-26T17:00:28.739486] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-26T17:00:28.739922] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-26T17:00:28.745705] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-26T17:00:28.776762] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AAUC took 5.5s. Estimated remaining: 3h 22m 45s. Rate: 11.7 symbols/min [2025-09-26T17:00:28.936012] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T17:00:29.058400] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-26T17:00:29.312906] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:29.423492] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:29.424718] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-26T17:00:29.456510] [DEBUG] [LOCAL ] AA: Primary data saved (54394 records). [2025-09-26T17:00:29.456740] [INFO ] [MAIN ] AA: Full history saved. [2025-09-26T17:00:29.457390] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AA took 26.4s. Estimated remaining: 2h 53m 21s. Rate: 13.6 symbols/min [2025-09-26T17:00:29.615288] [DEBUG] [LOCAL ] ABBV: Loaded 54076 existing records from primary storage. [2025-09-26T17:00:29.621143] [INFO ] [MAIN ] ABBV: Loaded 54076 existing records. [2025-09-26T17:00:29.792359] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:29.807542] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-09-26T17:00:29.810419] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-09-26T17:00:29.810958] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-26T17:00:29.816396] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-26T17:00:29.826742] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-09-26T17:00:29.831932] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-26T17:00:30.019946] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:30.035674] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-26T17:00:30.059793] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-26T17:00:30.092206] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-26T17:00:30.108354] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-26T17:00:30.435486] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:30.436781] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-26T17:00:30.772833] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:30.776149] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-26T17:00:30.778741] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T17:00:30.804571] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-26T17:00:30.809396] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:00:30.817622] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-26T17:00:31.461109] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:00:31.467400] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-26T17:00:31.734377] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T17:00:31.740605] [INFO ] [REMOTE ] AAT: Full fetch complete (42487 records). [2025-09-26T17:00:31.740819] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-26T17:00:31.741556] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:00:31.741682] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:00:31.741759] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:00:31.741845] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-26T17:00:31.741950] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-26T17:00:31.742020] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-09-26T17:00:31.743106] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-09-26T17:00:31.743260] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AAT took 15.3s. Estimated remaining: 2h 41m 24s. Rate: 14.6 symbols/min [2025-09-26T17:00:31.934730] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:31.961565] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T17:00:31.970954] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-26T17:00:32.042287] [DEBUG] [LOCAL ] ABEV: Loaded 53665 existing records from primary storage. [2025-09-26T17:00:32.042543] [INFO ] [MAIN ] ABEV: Loaded 53665 existing records. [2025-09-26T17:00:32.234197] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:32.234522] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-26T17:00:32.234574] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-26T17:00:32.236009] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-26T17:00:32.236074] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-26T17:00:32.639531] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:32.640338] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-26T17:00:32.672161] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T17:00:32.679613] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-26T17:00:32.713117] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T17:00:32.725110] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-26T17:00:33.100150] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:00:33.110226] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-26T17:00:33.514444] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:00:33.521254] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-26T17:00:34.353972] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T17:00:34.364473] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-26T17:00:34.578850] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:00:34.587624] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-26T17:00:34.742391] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-26T17:00:34.754110] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-26T17:00:35.029261] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-26T17:00:35.040520] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-26T17:00:35.519913] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T17:00:35.529964] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-26T17:00:36.101291] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:00:36.114638] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-26T17:00:36.595558] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T17:00:36.613302] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-26T17:00:36.657506] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T17:00:36.665540] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-26T17:00:36.774389] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T17:00:36.785636] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-26T17:00:37.362518] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-26T17:00:37.369941] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-26T17:00:37.497194] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:00:37.503925] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-26T17:00:38.115484] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T17:00:38.127312] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-26T17:00:38.243500] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T17:00:38.250233] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-26T17:00:38.271947] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:00:38.278295] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-26T17:00:38.493361] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T17:00:38.505909] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-26T17:00:39.049636] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T17:00:39.055107] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-26T17:00:39.280577] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-26T17:00:39.288593] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-26T17:00:39.901502] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:00:39.907635] [INFO ] [REMOTE ] AB: Full fetch complete (45903 records). [2025-09-26T17:00:39.907900] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-26T17:00:40.361211] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-26T17:00:40.361535] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-26T17:00:40.362513] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-26T17:00:40.362805] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-26T17:00:40.403198] [DEBUG] [LOCAL ] AB: Trimmed 45903 records to 28642 (keeping 200 days of data) [2025-09-26T17:00:40.418740] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-26T17:00:40.420847] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:00:40.442416] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-26T17:00:40.444837] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-26T17:00:40.661980] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T17:00:40.676241] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-26T17:00:40.688906] [DEBUG] [LOCAL ] AB: Primary data saved (28642 records). [2025-09-26T17:00:40.689072] [INFO ] [MAIN ] AB: Full history saved. [2025-09-26T17:00:40.689166] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AB took 12.5s. Estimated remaining: 3h 5m 12s. Rate: 12.8 symbols/min [2025-09-26T17:00:40.875266] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:40.894809] [DEBUG] [LOCAL ] ABG: Loaded 18922 existing records from primary storage. [2025-09-26T17:00:40.894956] [INFO ] [MAIN ] ABG: Loaded 18922 existing records. [2025-09-26T17:00:41.084546] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:41.084865] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-26T17:00:41.084917] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-26T17:00:41.085539] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-26T17:00:41.085603] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-26T17:00:41.469977] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:41.470324] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-26T17:00:41.869503] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T17:00:41.876585] [INFO ] [REMOTE ] ABCB: Full fetch complete (44442 records). [2025-09-26T17:00:41.876772] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-26T17:00:42.359291] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-26T17:00:42.359531] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-26T17:00:42.360096] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-26T17:00:42.360216] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-26T17:00:42.396254] [DEBUG] [LOCAL ] ABCB: Trimmed 44442 records to 31144 (keeping 200 days of data) [2025-09-26T17:00:42.398078] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T17:00:42.412056] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-26T17:00:42.583773] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:00:42.608758] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-26T17:00:42.629680] [DEBUG] [LOCAL ] ABCB: Primary data saved (31144 records). [2025-09-26T17:00:42.630290] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-26T17:00:42.630559] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. ABCB took 13.2s. Estimated remaining: 2h 53m 3s. Rate: 13.6 symbols/min [2025-09-26T17:00:42.868588] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:42.901277] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-26T17:00:42.914076] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-26T17:00:42.945810] [DEBUG] [LOCAL ] ABM: Loaded 32713 existing records from primary storage. [2025-09-26T17:00:42.945987] [INFO ] [MAIN ] ABM: Loaded 32713 existing records. [2025-09-26T17:00:43.132330] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:43.132588] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-26T17:00:43.132687] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-26T17:00:43.133639] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-26T17:00:43.133736] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-26T17:00:43.515963] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:43.516459] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-26T17:00:43.530386] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T17:00:43.535430] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-26T17:00:43.954456] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T17:00:43.967677] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-26T17:00:44.302196] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T17:00:44.308741] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-26T17:00:44.348795] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T17:00:44.353277] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-26T17:00:44.450406] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T17:00:44.462543] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-26T17:00:45.101506] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T17:00:45.107072] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-26T17:00:45.158137] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:00:45.164768] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-26T17:00:45.487126] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T17:00:45.499095] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-26T17:00:45.993489] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:00:46.000015] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-26T17:00:46.052557] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T17:00:46.060808] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-26T17:00:46.264814] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T17:00:46.277637] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-26T17:00:46.755392] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T17:00:46.759199] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-26T17:00:47.061482] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:00:47.069204] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-26T17:00:47.317899] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T17:00:47.330952] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-26T17:00:47.433735] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T17:00:47.437992] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-26T17:00:47.920371] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T17:00:47.938924] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-26T17:00:48.183830] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T17:00:48.193056] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-26T17:00:48.273084] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:00:48.278339] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-26T17:00:48.871770] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T17:00:48.888436] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-26T17:00:49.003393] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-26T17:00:49.009150] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-26T17:00:49.124831] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T17:00:49.131519] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-26T17:00:49.756110] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T17:00:49.759888] [INFO ] [REMOTE ] ABG: Full fetch complete (26446 records). [2025-09-26T17:00:49.759990] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-26T17:00:50.184279] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-26T17:00:50.184999] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-26T17:00:50.185555] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-26T17:00:50.185686] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-26T17:00:50.187239] [DEBUG] [LOCAL ] ABG: Trimmed 26446 records to 19034 (keeping 200 days of data) [2025-09-26T17:00:50.208470] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T17:00:50.338011] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-26T17:00:50.344487] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-26T17:00:50.360911] [INFO ] [REMOTE ] ABBV: Full fetch complete (77719 records). [2025-09-26T17:00:50.361854] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-26T17:00:50.787777] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T17:00:50.850980] [INFO ] [REMOTE ] ABEV: Full fetch complete (77198 records). [2025-09-26T17:00:50.876473] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-26T17:00:50.885414] [DEBUG] [LOCAL ] ABG: Primary data saved (19034 records). [2025-09-26T17:00:50.901735] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-26T17:00:50.905918] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-26T17:00:50.906076] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABG took 10.2s. Estimated remaining: 3h 8m 14s. Rate: 12.5 symbols/min [2025-09-26T17:00:50.906568] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-26T17:00:50.913000] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-26T17:00:50.921145] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-26T17:00:51.085545] [DEBUG] [LOCAL ] ABBV: Trimmed 77719 records to 54465 (keeping 200 days of data) [2025-09-26T17:00:51.375600] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:51.822681] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-26T17:00:51.824085] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-26T17:00:51.825816] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-26T17:00:51.826042] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-26T17:00:51.851736] [DEBUG] [LOCAL ] ABEV: Trimmed 77198 records to 54055 (keeping 200 days of data) [2025-09-26T17:00:51.858356] [DEBUG] [LOCAL ] ABR: Loaded 52464 existing records from primary storage. [2025-09-26T17:00:51.861067] [INFO ] [MAIN ] ABR: Loaded 52464 existing records. [2025-09-26T17:00:52.241609] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:00:52.245364] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-26T17:00:52.250912] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-26T17:00:52.255890] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-26T17:00:52.256241] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-26T17:00:52.835340] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-26T17:00:52.875836] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-26T17:00:53.018316] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:53.026003] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-26T17:00:53.082177] [DEBUG] [LOCAL ] ABEV: Primary data saved (54055 records). [2025-09-26T17:00:53.084910] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-26T17:00:53.088722] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABEV took 21.3s. Estimated remaining: 2h 58m 52s. Rate: 13.2 symbols/min [2025-09-26T17:00:53.085084] [DEBUG] [LOCAL ] ABBV: Primary data saved (54465 records). [2025-09-26T17:00:53.088930] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-26T17:00:53.123054] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABBV took 24.3s. Estimated remaining: 2h 43m 60s. Rate: 14.4 symbols/min [2025-09-26T17:00:53.481566] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:53.501764] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-09-26T17:00:53.501589] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:53.501885] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-09-26T17:00:53.502065] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-09-26T17:00:53.502410] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-26T17:00:53.502504] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-26T17:00:53.502218] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-09-26T17:00:53.502820] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-26T17:00:53.502907] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-26T17:00:53.503015] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-26T17:00:53.508255] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-26T17:00:53.539047] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-09-26T17:00:53.574769] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-26T17:00:54.286773] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:54.303127] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-26T17:00:54.364522] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:54.365441] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-26T17:00:54.388898] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T17:00:54.397252] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-26T17:00:55.022058] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-26T17:00:55.034909] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-26T17:00:55.121519] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T17:00:55.126760] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-26T17:00:55.700948] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T17:00:55.709854] [INFO ] [REMOTE ] ABM: Full fetch complete (44682 records). [2025-09-26T17:00:55.710010] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-26T17:00:56.158585] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-26T17:00:56.160044] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-26T17:00:56.162425] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-26T17:00:56.161616] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T17:00:56.164625] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-26T17:00:56.169710] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-26T17:00:56.171932] [DEBUG] [LOCAL ] ABM: Trimmed 44682 records to 32915 (keeping 200 days of data) [2025-09-26T17:00:56.321268] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T17:00:56.337431] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-26T17:00:56.480796] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T17:00:56.494443] [DEBUG] [LOCAL ] ABM: Primary data saved (32915 records). [2025-09-26T17:00:56.494680] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-26T17:00:56.497719] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 13.9s. Estimated remaining: 2h 41m 31s. Rate: 14.6 symbols/min [2025-09-26T17:00:56.498831] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-26T17:00:56.690000] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:00:56.690206] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-09-26T17:00:56.690245] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-09-26T17:00:56.690405] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-26T17:00:56.690454] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-26T17:00:56.690496] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-26T17:00:56.690542] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-26T17:00:57.081725] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:00:57.082202] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-26T17:00:57.099171] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T17:00:57.105627] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-26T17:00:57.727443] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T17:00:57.739216] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-26T17:00:57.838581] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:00:58.262782] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T17:00:58.356742] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-26T17:00:58.465113] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T17:00:59.163917] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-26T17:00:59.185514] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T17:00:59.715220] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T17:00:59.956750] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-26T17:01:00.068873] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T17:01:00.756742] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-26T17:01:01.440742] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:01:01.556745] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-26T17:01:01.799489] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:01:02.356752] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-26T17:01:03.133596] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T17:01:03.156681] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-26T17:01:03.281457] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T17:01:03.956751] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-26T17:01:04.659087] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T17:01:04.756784] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-26T17:01:05.081052] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T17:01:05.556750] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-26T17:01:06.356735] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-26T17:01:06.471377] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T17:01:06.939449] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:01:07.156754] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-26T17:01:07.295081] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T17:01:07.956755] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-26T17:01:08.756765] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-26T17:01:08.822090] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T17:01:08.945262] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T17:01:09.556756] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-26T17:01:10.357751] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-26T17:01:10.361543] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T17:01:10.403521] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T17:01:11.156814] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-26T17:01:11.598064] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T17:01:11.956762] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-26T17:01:12.558578] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T17:01:12.756791] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-26T17:01:13.444667] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T17:01:13.556730] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-26T17:01:13.827450] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:01:14.356740] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-26T17:01:15.156704] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-26T17:01:15.248218] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T17:01:15.259341] [INFO ] [REMOTE ] ABT: Full fetch complete (77198 records). [2025-09-26T17:01:15.259706] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-26T17:01:15.274921] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:01:15.275434] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:01:15.276606] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:01:15.275942] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:01:15.282278] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-26T17:01:15.282936] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-26T17:01:15.283033] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-09-26T17:01:15.283466] [DEBUG] [LOCAL ] ABT: No derivative data file found to delete. [2025-09-26T17:01:15.283573] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ABT took 22.2s. Estimated remaining: 3h 22m 38s. Rate: 11.6 symbols/min [2025-09-26T17:01:15.474161] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:15.511406] [DEBUG] [LOCAL ] ACEL: Loaded 27254 existing records from primary storage. [2025-09-26T17:01:15.511574] [INFO ] [MAIN ] ACEL: Loaded 27254 existing records. [2025-09-26T17:01:15.707993] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:01:15.708273] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-26T17:01:15.708328] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-26T17:01:15.709350] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-26T17:01:15.709424] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-26T17:01:15.966856] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-26T17:01:16.110213] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:16.691479] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:01:16.756743] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-26T17:01:16.980173] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T17:01:16.984980] [INFO ] [REMOTE ] ACA: Full fetch complete (34298 records). [2025-09-26T17:01:16.985110] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-26T17:01:17.388126] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-26T17:01:17.388220] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-26T17:01:17.388597] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-26T17:01:17.388684] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-26T17:01:17.389593] [DEBUG] [LOCAL ] ACA: Trimmed 34298 records to 24034 (keeping 200 days of data) [2025-09-26T17:01:17.523745] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T17:01:17.563129] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-26T17:01:17.581485] [DEBUG] [LOCAL ] ACA: Primary data saved (24034 records). [2025-09-26T17:01:17.581681] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-26T17:01:17.581816] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ACA took 24.4s. Estimated remaining: 3h 15m 3s. Rate: 12.1 symbols/min [2025-09-26T17:01:17.788074] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:17.847553] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-09-26T17:01:17.847750] [INFO ] [MAIN ] ACHR: Loaded 54208 existing records. [2025-09-26T17:01:18.046059] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:01:18.046351] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-26T17:01:18.046422] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-26T17:01:18.048569] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-26T17:01:18.048663] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-26T17:01:18.361961] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-26T17:01:18.427541] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:18.875709] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T17:01:19.156788] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-26T17:01:19.910124] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:01:19.956751] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-26T17:01:20.756764] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-26T17:01:21.556759] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-26T17:01:21.787126] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-26T17:01:21.877183] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T17:01:22.025840] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-26T17:01:22.037275] [INFO ] [REMOTE ] ABR: Full fetch complete (74830 records). [2025-09-26T17:01:22.037491] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-26T17:01:22.038587] [FATAL] [VALIDATOR ] ABR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:01:22.038749] [FATAL] [MAIN ] ABR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:01:22.038835] [WARN ] [MAIN ] ABR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:01:22.038914] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-26T17:01:22.038995] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-09-26T17:01:22.039035] [INFO ] [LOCAL ] ABR: Starting deletion of derivative data. [2025-09-26T17:01:22.039833] [DEBUG] [LOCAL ] ABR: Deleted derivative data file. [2025-09-26T17:01:22.042703] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ABR took 31.1s. Estimated remaining: 3h 13m 44s. Rate: 12.2 symbols/min [2025-09-26T17:01:22.239241] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:22.318383] [DEBUG] [LOCAL ] ACI: Loaded 53659 existing records from primary storage. [2025-09-26T17:01:22.318586] [INFO ] [MAIN ] ACI: Loaded 53659 existing records. [2025-09-26T17:01:22.361961] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-26T17:01:22.533015] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:01:22.533538] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-26T17:01:22.553589] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-26T17:01:22.554968] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T17:01:22.560901] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-26T17:01:22.561547] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-26T17:01:22.964758] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:23.156758] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-26T17:01:23.882439] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T17:01:23.956779] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-26T17:01:24.034525] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T17:01:24.756733] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-26T17:01:25.556762] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-26T17:01:26.157495] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T17:01:26.356760] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-26T17:01:26.544722] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-26T17:01:27.156790] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-26T17:01:27.606227] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:01:27.679457] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-26T17:01:27.956760] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-26T17:01:28.650099] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:01:28.756789] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-26T17:01:29.556749] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-26T17:01:29.658249] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:01:30.356773] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-26T17:01:31.084625] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T17:01:31.091759] [INFO ] [REMOTE ] ACCO: Full fetch complete (53913 records). [2025-09-26T17:01:31.091889] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-26T17:01:31.094957] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:01:31.095064] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:01:31.095114] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:01:31.095202] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-26T17:01:31.095348] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-26T17:01:31.095424] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-09-26T17:01:31.095498] [DEBUG] [LOCAL ] ACCO: No derivative data file found to delete. [2025-09-26T17:01:31.095600] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 34.6s. Estimated remaining: 3h 23m 9s. Rate: 11.6 symbols/min [2025-09-26T17:01:31.164364] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-26T17:01:31.290271] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:31.290675] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-09-26T17:01:31.290758] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-09-26T17:01:31.290973] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-26T17:01:31.291120] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-26T17:01:31.291263] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-09-26T17:01:31.291366] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-26T17:01:31.709212] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.95 seconds). [2025-09-26T17:01:31.762461] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:31.956697] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-26T17:01:32.012756] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T17:01:32.203729] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T17:01:32.756781] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-26T17:01:33.556801] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-26T17:01:33.942585] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T17:01:34.181311] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-26T17:01:34.356787] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-26T17:01:34.716808] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:01:35.156767] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-26T17:01:35.254947] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T17:01:35.260689] [INFO ] [REMOTE ] ACEL: Full fetch complete (38799 records). [2025-09-26T17:01:35.260851] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-26T17:01:35.673056] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-26T17:01:35.673141] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-26T17:01:35.673582] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-26T17:01:35.673671] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-26T17:01:35.676331] [DEBUG] [LOCAL ] ACEL: Trimmed 38799 records to 27405 (keeping 200 days of data) [2025-09-26T17:01:35.836872] [DEBUG] [LOCAL ] ACEL: Primary data saved (27405 records). [2025-09-26T17:01:35.837043] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-26T17:01:35.837154] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ACEL took 20.6s. Estimated remaining: 3h 22m 7s. Rate: 11.6 symbols/min [2025-09-26T17:01:35.961942] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-26T17:01:36.020639] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:36.020862] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-09-26T17:01:36.020917] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-09-26T17:01:36.021063] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-26T17:01:36.021108] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-26T17:01:36.021152] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-09-26T17:01:36.021185] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-26T17:01:36.387761] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:01:36.756797] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-26T17:01:37.561264] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-26T17:01:37.567424] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:01:37.829883] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-26T17:01:38.356701] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-26T17:01:38.892779] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-26T17:01:39.157762] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-26T17:01:39.157609] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:01:39.956805] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-26T17:01:40.431957] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:01:40.621796] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-26T17:01:40.756762] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-26T17:01:41.528966] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:01:41.556739] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-26T17:01:42.356752] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-26T17:01:43.166725] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-26T17:01:43.175145] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T17:01:43.270929] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-26T17:01:43.644533] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T17:01:43.956789] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-26T17:01:44.595218] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:01:44.756766] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-26T17:01:45.195204] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T17:01:45.556789] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-26T17:01:46.356710] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-26T17:01:46.452067] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T17:01:46.841815] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:01:47.156737] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-26T17:01:47.956758] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-26T17:01:47.999713] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:01:48.514198] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T17:01:48.756764] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-26T17:01:49.556758] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-26T17:01:50.356773] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-26T17:01:50.618496] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:01:50.917782] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.96 seconds). [2025-09-26T17:01:50.998747] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T17:01:51.156745] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-26T17:01:51.956756] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-26T17:01:52.047595] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T17:01:52.741261] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T17:01:52.756685] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-26T17:01:53.432052] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T17:01:53.556735] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-26T17:01:54.243606] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:01:54.356730] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-26T17:01:54.706415] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T17:01:55.156796] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-26T17:01:55.956834] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-26T17:01:56.434672] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T17:01:56.701843] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:01:56.756744] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-26T17:01:57.538586] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T17:01:57.556791] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-26T17:01:58.257521] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T17:01:58.269690] [INFO ] [REMOTE ] ACI: Full fetch complete (77048 records). [2025-09-26T17:01:58.269916] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-26T17:01:58.362480] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-26T17:01:58.786360] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-26T17:01:58.786518] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-26T17:01:58.787362] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-26T17:01:58.787438] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-26T17:01:58.789427] [DEBUG] [LOCAL ] ACI: Trimmed 77048 records to 54044 (keeping 200 days of data) [2025-09-26T17:01:59.163391] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-26T17:01:59.172497] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:01:59.201267] [DEBUG] [LOCAL ] ACI: Primary data saved (54044 records). [2025-09-26T17:01:59.201415] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-26T17:01:59.201502] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACI took 37.2s. Estimated remaining: 3h 59m 36s. Rate: 9.8 symbols/min [2025-09-26T17:01:59.409972] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:01:59.445834] [DEBUG] [LOCAL ] ACP: Loaded 31281 existing records from primary storage. [2025-09-26T17:01:59.445991] [INFO ] [MAIN ] ACP: Loaded 31281 existing records. [2025-09-26T17:01:59.651809] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:01:59.652122] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-26T17:01:59.652187] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-26T17:01:59.653173] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-26T17:01:59.653250] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-26T17:01:59.962009] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-26T17:02:00.170780] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:00.196522] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:02:00.206402] [INFO ] [REMOTE ] ACM: Full fetch complete (62766 records). [2025-09-26T17:02:00.206555] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-26T17:02:00.649178] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-26T17:02:00.649326] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-26T17:02:00.650144] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-26T17:02:00.650270] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-26T17:02:00.652063] [DEBUG] [LOCAL ] ACM: Trimmed 62766 records to 43767 (keeping 200 days of data) [2025-09-26T17:02:00.765574] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-26T17:02:00.999775] [DEBUG] [LOCAL ] ACM: Primary data saved (43767 records). [2025-09-26T17:02:00.999951] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-26T17:02:01.000043] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACM took 29.9s. Estimated remaining: 3h 51m 3s. Rate: 10.2 symbols/min [2025-09-26T17:02:01.222595] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:01.234801] [DEBUG] [LOCAL ] ACR: Loaded 6320 existing records from primary storage. [2025-09-26T17:02:01.234956] [INFO ] [MAIN ] ACR: Loaded 6320 existing records. [2025-09-26T17:02:01.450407] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:02:01.450712] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-26T17:02:01.450772] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-26T17:02:01.451095] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-26T17:02:01.451157] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-26T17:02:01.856255] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:01.857146] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-26T17:02:02.168054] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-26T17:02:02.290632] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-09-26T17:02:02.302678] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-09-26T17:02:02.302861] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-26T17:02:02.303808] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:02:02.303928] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:02:02.304006] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:02:02.304101] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-26T17:02:02.304185] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-09-26T17:02:02.304228] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-09-26T17:02:02.304690] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-09-26T17:02:02.306135] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACHR took 44.7s. Estimated remaining: 3h 42m 23s. Rate: 10.6 symbols/min [2025-09-26T17:02:02.366532] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-26T17:02:02.507977] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:02.508618] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-09-26T17:02:02.509041] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-09-26T17:02:02.509382] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-26T17:02:02.509441] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-26T17:02:02.509489] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-26T17:02:02.509566] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-26T17:02:02.645864] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T17:02:02.790326] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T17:02:03.126137] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:03.156801] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-26T17:02:03.956810] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-26T17:02:04.589720] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-26T17:02:04.601176] [INFO ] [REMOTE ] ACN: Full fetch complete (77108 records). [2025-09-26T17:02:04.601343] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-26T17:02:04.761333] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-26T17:02:05.087939] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-26T17:02:05.090073] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T17:02:05.090422] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-26T17:02:05.100712] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-26T17:02:05.100960] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-26T17:02:05.103481] [DEBUG] [LOCAL ] ACN: Trimmed 77108 records to 54204 (keeping 200 days of data) [2025-09-26T17:02:05.128574] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T17:02:05.370499] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T17:02:05.502842] [DEBUG] [LOCAL ] ACN: Primary data saved (54204 records). [2025-09-26T17:02:05.503014] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-26T17:02:05.503114] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 29.7s. Estimated remaining: 3h 37m 53s. Rate: 10.8 symbols/min [2025-09-26T17:02:05.561875] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-26T17:02:05.725509] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:05.736163] [DEBUG] [LOCAL ] ACV: Loaded 7016 existing records from primary storage. [2025-09-26T17:02:05.736394] [INFO ] [MAIN ] ACV: Loaded 7016 existing records. [2025-09-26T17:02:05.948686] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:02:05.949110] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-26T17:02:05.949175] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-26T17:02:05.949618] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-26T17:02:05.949758] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-26T17:02:06.279098] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T17:02:06.361875] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-26T17:02:06.367987] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:07.053214] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T17:02:07.156787] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-26T17:02:07.956785] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-26T17:02:08.304985] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T17:02:08.542840] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T17:02:08.756756] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-26T17:02:09.556736] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-26T17:02:09.931408] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T17:02:10.356774] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-26T17:02:11.024547] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T17:02:11.156781] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-26T17:02:11.318783] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T17:02:11.823419] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T17:02:11.956769] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-26T17:02:12.466139] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T17:02:12.756769] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-26T17:02:13.400215] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T17:02:13.556738] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-26T17:02:14.356777] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-26T17:02:14.380190] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T17:02:15.156765] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-26T17:02:15.673789] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:02:15.956773] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-26T17:02:16.129246] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T17:02:16.756767] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-26T17:02:17.221401] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T17:02:17.247261] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:02:17.556735] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-26T17:02:18.356810] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-26T17:02:18.594441] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T17:02:18.721147] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-26T17:02:19.156749] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-26T17:02:19.809782] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T17:02:19.956781] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-26T17:02:20.612632] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T17:02:20.756804] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-26T17:02:21.556713] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-26T17:02:21.639796] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:02:22.356810] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-26T17:02:23.013390] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:02:23.156788] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-26T17:02:23.621395] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T17:02:23.956740] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-26T17:02:24.131196] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:02:24.133923] [INFO ] [REMOTE ] ACV: Full fetch complete (9780 records). [2025-09-26T17:02:24.134001] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-26T17:02:24.566945] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-26T17:02:24.567133] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-26T17:02:24.567893] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-26T17:02:24.567994] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-26T17:02:24.569601] [DEBUG] [LOCAL ] ACV: Trimmed 9780 records to 7095 (keeping 200 days of data) [2025-09-26T17:02:24.632953] [DEBUG] [LOCAL ] ACV: Primary data saved (7095 records). [2025-09-26T17:02:24.633212] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-26T17:02:24.633395] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACV took 19.1s. Estimated remaining: 4h 0m 52s. Rate: 9.7 symbols/min [2025-09-26T17:02:24.761850] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-26T17:02:24.842015] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:24.842361] [DEBUG] [LOCAL ] ACVA: No existing data file found in primary storage. [2025-09-26T17:02:24.842448] [WARN ] [MAIN ] ACVA: No existing data found, performing full refresh instead. [2025-09-26T17:02:24.843151] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-26T17:02:24.843230] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-26T17:02:24.843302] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-09-26T17:02:24.843344] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-26T17:02:25.052635] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:02:25.276632] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:25.284001] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-26T17:02:25.556756] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-26T17:02:26.002032] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-26T17:02:26.356801] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-26T17:02:27.156749] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-26T17:02:27.761506] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T17:02:27.875637] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T17:02:27.877124] [INFO ] [REMOTE ] ACR: Full fetch complete (8571 records). [2025-09-26T17:02:27.877203] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-26T17:02:27.962078] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-26T17:02:28.279522] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-26T17:02:28.279637] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-26T17:02:28.279978] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-26T17:02:28.280046] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-26T17:02:28.280542] [DEBUG] [LOCAL ] ACR: Trimmed 8571 records to 6352 (keeping 200 days of data) [2025-09-26T17:02:28.319507] [DEBUG] [LOCAL ] ACR: Primary data saved (6352 records). [2025-09-26T17:02:28.319691] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-26T17:02:28.319874] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACR took 27.3s. Estimated remaining: 3h 56m 44s. Rate: 9.9 symbols/min [2025-09-26T17:02:28.501294] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:28.501535] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-26T17:02:28.501582] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-26T17:02:28.501795] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-26T17:02:28.501853] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-26T17:02:28.501897] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-26T17:02:28.502009] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-26T17:02:28.763339] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-26T17:02:28.909272] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:29.282997] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:02:29.290203] [INFO ] [REMOTE ] ACP: Full fetch complete (47511 records). [2025-09-26T17:02:29.290383] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-26T17:02:29.567225] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-26T17:02:29.713265] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-26T17:02:29.713360] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-26T17:02:29.714080] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-26T17:02:29.714152] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-26T17:02:29.715726] [DEBUG] [LOCAL ] ACP: Trimmed 47511 records to 31428 (keeping 200 days of data) [2025-09-26T17:02:29.901366] [DEBUG] [LOCAL ] ACP: Primary data saved (31428 records). [2025-09-26T17:02:29.901514] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-26T17:02:29.901605] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. ACP took 30.7s. Estimated remaining: 3h 49m 39s. Rate: 10.2 symbols/min [2025-09-26T17:02:30.090778] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:30.091028] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-09-26T17:02:30.091073] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-09-26T17:02:30.091317] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-26T17:02:30.091373] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-26T17:02:30.091417] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-26T17:02:30.091465] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-26T17:02:30.368618] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-26T17:02:30.511329] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:30.535585] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:02:30.676065] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:30.676402] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-26T17:02:31.156789] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-26T17:02:31.380916] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T17:02:31.956790] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-26T17:02:32.111548] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T17:02:32.169271] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:32.169630] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-26T17:02:32.756783] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-26T17:02:32.986448] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:32.986826] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-26T17:02:33.556734] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-26T17:02:34.356814] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-26T17:02:34.584829] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:34.585183] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-26T17:02:35.097047] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T17:02:35.156708] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-26T17:02:35.956737] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-26T17:02:36.202789] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:36.203157] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-26T17:02:36.679535] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T17:02:36.756784] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-26T17:02:37.556748] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-26T17:02:37.968900] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:37.969262] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-26T17:02:37.991972] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:02:38.356781] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-26T17:02:38.597136] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:38.597521] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-26T17:02:39.156728] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-26T17:02:39.366263] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:02:39.366700] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-26T17:02:39.956762] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-26T17:02:40.756771] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-26T17:02:41.182859] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T17:02:41.556736] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-26T17:02:42.292370] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:02:42.356761] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-26T17:02:42.822009] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:02:42.829552] [INFO ] [REMOTE ] AD: Full fetch complete (6577 records). [2025-09-26T17:02:42.829756] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-26T17:02:43.038923] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 33 unique days, need 200 days [2025-09-26T17:02:43.039193] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:02:43.039268] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:02:43.039324] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-26T17:02:43.039424] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-26T17:02:43.039496] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-26T17:02:43.039568] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-26T17:02:43.039697] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. AD took 14.7s. Estimated remaining: 4h 0m 28s. Rate: 9.8 symbols/min [2025-09-26T17:02:43.161923] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-26T17:02:43.235230] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:43.279783] [DEBUG] [LOCAL ] ADCT: Loaded 34394 existing records from primary storage. [2025-09-26T17:02:43.279972] [INFO ] [MAIN ] ADCT: Loaded 34394 existing records. [2025-09-26T17:02:43.499490] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:02:43.499819] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-26T17:02:43.499875] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-26T17:02:43.501141] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-26T17:02:43.501208] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-26T17:02:43.904823] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:43.967330] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-26T17:02:43.976524] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:02:44.444318] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T17:02:44.756780] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-26T17:02:45.248616] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T17:02:45.556759] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-26T17:02:46.040773] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:02:46.356771] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-26T17:02:47.063760] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T17:02:47.156755] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-26T17:02:47.450881] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T17:02:47.956749] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-26T17:02:48.065519] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T17:02:48.756756] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-26T17:02:49.172393] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:02:49.556807] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-26T17:02:49.868058] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T17:02:49.874978] [INFO ] [REMOTE ] ACRE: Full fetch complete (50537 records). [2025-09-26T17:02:49.875186] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-26T17:02:50.314931] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-26T17:02:50.315029] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-26T17:02:50.315559] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-26T17:02:50.315607] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-26T17:02:50.318733] [DEBUG] [LOCAL ] ACRE: Trimmed 50537 records to 34027 (keeping 200 days of data) [2025-09-26T17:02:50.370573] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-26T17:02:50.529475] [DEBUG] [LOCAL ] ACRE: Primary data saved (34027 records). [2025-09-26T17:02:50.529675] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-26T17:02:50.529789] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACRE took 48.2s. Estimated remaining: 4h 2m 18s. Rate: 9.7 symbols/min [2025-09-26T17:02:50.716053] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:02:50.716255] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-09-26T17:02:50.716297] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-09-26T17:02:50.716458] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-26T17:02:50.716504] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-26T17:02:50.716549] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-09-26T17:02:50.716587] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-26T17:02:51.157057] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-26T17:02:51.163894] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:02:51.198432] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:02:51.524926] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T17:02:51.956732] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-26T17:02:52.286415] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T17:02:52.756733] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-26T17:02:53.556739] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-26T17:02:53.894048] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T17:02:54.356779] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-26T17:02:54.476168] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T17:02:54.989290] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:02:55.156796] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-26T17:02:55.871130] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:02:55.956770] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-26T17:02:56.512191] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T17:02:56.756814] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-26T17:02:57.245384] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T17:02:57.556773] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-26T17:02:58.356747] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-26T17:02:58.394467] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T17:02:58.926920] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:02:59.156748] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-26T17:02:59.445960] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:02:59.956758] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-26T17:03:00.756726] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-26T17:03:00.945753] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T17:03:01.204826] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T17:03:01.556758] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-26T17:03:02.356749] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-26T17:03:02.427504] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T17:03:02.438072] [INFO ] [REMOTE ] ACVA: Full fetch complete (70254 records). [2025-09-26T17:03:02.438256] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-26T17:03:02.904545] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-26T17:03:02.904755] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-26T17:03:02.905589] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-26T17:03:02.905704] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-26T17:03:02.907895] [DEBUG] [LOCAL ] ACVA: Trimmed 70254 records to 50072 (keeping 200 days of data) [2025-09-26T17:03:03.031079] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T17:03:03.162980] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-26T17:03:03.261268] [DEBUG] [LOCAL ] ACVA: Primary data saved (50072 records). [2025-09-26T17:03:03.261449] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-26T17:03:03.261539] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 38.6s. Estimated remaining: 4h 11m 18s. Rate: 9.3 symbols/min [2025-09-26T17:03:03.456250] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:03.508233] [DEBUG] [LOCAL ] ADNT: Loaded 47786 existing records from primary storage. [2025-09-26T17:03:03.508394] [INFO ] [MAIN ] ADNT: Loaded 47786 existing records. [2025-09-26T17:03:03.709794] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:03.726847] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-26T17:03:03.727251] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-26T17:03:03.728691] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:03:03.735330] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-26T17:03:03.735565] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-26T17:03:03.961887] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-26T17:03:04.114160] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:04.756703] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-26T17:03:04.804216] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T17:03:05.249225] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T17:03:05.556743] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-26T17:03:06.112271] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T17:03:06.356791] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-26T17:03:07.156755] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-26T17:03:07.316922] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T17:03:07.956740] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-26T17:03:08.223291] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T17:03:08.258829] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:03:08.756737] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-26T17:03:09.379276] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T17:03:09.556727] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-26T17:03:10.356753] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-26T17:03:11.156738] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-26T17:03:11.243747] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-26T17:03:11.383002] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T17:03:11.919840] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-26T17:03:11.929163] [INFO ] [REMOTE ] ADC: Full fetch complete (66035 records). [2025-09-26T17:03:11.929328] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-26T17:03:11.966598] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-26T17:03:12.371308] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-26T17:03:12.371473] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-26T17:03:12.372177] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-26T17:03:12.372246] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-26T17:03:12.373781] [DEBUG] [LOCAL ] ADC: Trimmed 66035 records to 46934 (keeping 200 days of data) [2025-09-26T17:03:12.678059] [DEBUG] [LOCAL ] ADC: Primary data saved (46934 records). [2025-09-26T17:03:12.678229] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-26T17:03:12.678335] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. ADC took 42.8s. Estimated remaining: 4h 15m 13s. Rate: 9.2 symbols/min [2025-09-26T17:03:12.757370] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-26T17:03:12.885214] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:12.887376] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T17:03:12.949215] [DEBUG] [LOCAL ] ADT: Loaded 53866 existing records from primary storage. [2025-09-26T17:03:12.949391] [INFO ] [MAIN ] ADT: Loaded 53866 existing records. [2025-09-26T17:03:13.133775] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:13.134067] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-26T17:03:13.134133] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-26T17:03:13.135918] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-26T17:03:13.135986] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-26T17:03:13.523047] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:03:13.565716] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-26T17:03:13.572454] [INFO ] [REMOTE ] ADCT: Full fetch complete (51606 records). [2025-09-26T17:03:13.572242] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:13.572831] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-26T17:03:13.984106] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-26T17:03:13.984227] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-26T17:03:13.984813] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-26T17:03:13.984879] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-26T17:03:13.986367] [DEBUG] [LOCAL ] ADCT: Trimmed 51606 records to 34670 (keeping 200 days of data) [2025-09-26T17:03:14.199463] [DEBUG] [LOCAL ] ADCT: Primary data saved (34670 records). [2025-09-26T17:03:14.199773] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-26T17:03:14.201490] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADCT took 31.2s. Estimated remaining: 4h 8m 35s. Rate: 9.4 symbols/min [2025-09-26T17:03:14.356966] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-26T17:03:14.393046] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:14.430466] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T17:03:14.467354] [DEBUG] [LOCAL ] ADX: Loaded 28005 existing records from primary storage. [2025-09-26T17:03:14.467507] [INFO ] [MAIN ] ADX: Loaded 28005 existing records. [2025-09-26T17:03:14.657947] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:14.658307] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-26T17:03:14.658357] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-26T17:03:14.659310] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-26T17:03:14.659413] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-26T17:03:15.048352] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:15.080478] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:03:15.156727] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-26T17:03:15.956745] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-26T17:03:16.020557] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:03:16.756767] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-26T17:03:16.895535] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T17:03:17.556737] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-26T17:03:18.031841] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T17:03:18.157105] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:03:18.356733] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-26T17:03:18.575320] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:03:19.156728] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-26T17:03:19.956751] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-26T17:03:20.316991] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T17:03:20.475354] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:03:20.756790] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-26T17:03:21.258266] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T17:03:21.556732] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-26T17:03:22.356738] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-26T17:03:22.792122] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T17:03:22.877669] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T17:03:22.889227] [INFO ] [REMOTE ] ADM: Full fetch complete (77223 records). [2025-09-26T17:03:22.889415] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-26T17:03:23.162898] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-26T17:03:23.308796] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-26T17:03:23.308909] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-26T17:03:23.309702] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-26T17:03:23.309775] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-26T17:03:23.311516] [DEBUG] [LOCAL ] ADM: Trimmed 77223 records to 54175 (keeping 200 days of data) [2025-09-26T17:03:23.685126] [DEBUG] [LOCAL ] ADM: Primary data saved (54175 records). [2025-09-26T17:03:23.685427] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-26T17:03:23.685880] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADM took 33.2s. Estimated remaining: 4h 12m 23s. Rate: 9.3 symbols/min [2025-09-26T17:03:23.877974] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:23.937318] [DEBUG] [LOCAL ] AEE: Loaded 50500 existing records from primary storage. [2025-09-26T17:03:23.937505] [INFO ] [MAIN ] AEE: Loaded 50500 existing records. [2025-09-26T17:03:23.971327] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-26T17:03:24.145465] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:24.156611] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-26T17:03:24.171668] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-26T17:03:24.177507] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T17:03:24.187734] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-26T17:03:24.188688] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-26T17:03:24.304800] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:03:24.616153] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:24.756759] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-26T17:03:25.239526] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:03:25.556757] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-26T17:03:25.999468] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T17:03:26.356732] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-26T17:03:26.944818] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T17:03:27.156775] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-26T17:03:27.241740] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T17:03:27.956752] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-26T17:03:28.425904] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:03:28.756767] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-26T17:03:29.114254] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:03:29.556732] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-26T17:03:30.356746] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-26T17:03:31.027232] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-26T17:03:31.115005] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:03:31.156772] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-26T17:03:31.219459] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:03:31.956734] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-26T17:03:32.756690] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-26T17:03:32.802677] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:03:32.814078] [INFO ] [REMOTE ] ADNT: Full fetch complete (68058 records). [2025-09-26T17:03:32.814282] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-26T17:03:33.140020] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T17:03:33.270253] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-26T17:03:33.270349] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-26T17:03:33.271037] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-26T17:03:33.271108] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-26T17:03:33.272573] [DEBUG] [LOCAL ] ADNT: Trimmed 68058 records to 48095 (keeping 200 days of data) [2025-09-26T17:03:33.558026] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-26T17:03:33.574683] [DEBUG] [LOCAL ] ADNT: Primary data saved (48095 records). [2025-09-26T17:03:33.574952] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-26T17:03:33.575127] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADNT took 30.3s. Estimated remaining: 4h 16m 27s. Rate: 9.1 symbols/min [2025-09-26T17:03:33.763381] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:33.763577] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-09-26T17:03:33.763615] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-09-26T17:03:33.763785] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-26T17:03:33.763828] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-26T17:03:33.763870] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-09-26T17:03:33.763901] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-26T17:03:34.146765] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:34.361884] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-26T17:03:34.377594] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:03:35.094043] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T17:03:35.156778] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-26T17:03:35.366987] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T17:03:35.956734] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-26T17:03:36.447293] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:03:36.756745] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-26T17:03:37.556745] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-26T17:03:37.652522] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T17:03:37.681394] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:03:37.952942] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T17:03:38.356737] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-26T17:03:38.999159] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T17:03:39.156792] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-26T17:03:39.932151] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T17:03:39.956764] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-26T17:03:40.756791] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-26T17:03:41.556761] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-26T17:03:41.860022] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T17:03:42.029570] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T17:03:42.055916] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T17:03:42.356738] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-26T17:03:43.156729] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-26T17:03:43.175427] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T17:03:43.956787] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-26T17:03:44.756811] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-26T17:03:44.832704] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T17:03:45.004202] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:03:45.010281] [INFO ] [REMOTE ] ADX: Full fetch complete (42107 records). [2025-09-26T17:03:45.010428] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-26T17:03:45.398376] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-26T17:03:45.398505] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-26T17:03:45.399058] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-26T17:03:45.399135] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-26T17:03:45.400698] [DEBUG] [LOCAL ] ADX: Trimmed 42107 records to 28180 (keeping 200 days of data) [2025-09-26T17:03:45.486381] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T17:03:45.557304] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-26T17:03:45.615013] [DEBUG] [LOCAL ] ADX: Primary data saved (28180 records). [2025-09-26T17:03:45.615232] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-26T17:03:45.616691] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADX took 31.4s. Estimated remaining: 4h 22m 47s. Rate: 8.9 symbols/min [2025-09-26T17:03:45.793215] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:45.793446] [DEBUG] [LOCAL ] AEG: No existing data file found in primary storage. [2025-09-26T17:03:45.793483] [WARN ] [MAIN ] AEG: No existing data found, performing full refresh instead. [2025-09-26T17:03:45.793638] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-26T17:03:45.793732] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-26T17:03:45.793803] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-09-26T17:03:45.793840] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-26T17:03:46.179103] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:46.356726] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-26T17:03:46.369719] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T17:03:47.156809] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-26T17:03:47.956816] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-26T17:03:48.126033] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T17:03:48.164821] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T17:03:48.756753] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-26T17:03:49.371475] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T17:03:49.408728] [INFO ] [REMOTE ] AEFC: Full fetch complete (12319 records). [2025-09-26T17:03:49.409936] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-26T17:03:49.412024] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:03:49.561919] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-26T17:03:49.909846] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-26T17:03:49.909962] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-26T17:03:49.910297] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-26T17:03:49.910338] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-26T17:03:49.910951] [DEBUG] [LOCAL ] AEFC: Trimmed 12319 records to 8643 (keeping 200 days of data) [2025-09-26T17:03:49.968046] [DEBUG] [LOCAL ] AEFC: Primary data saved (8643 records). [2025-09-26T17:03:49.968258] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-26T17:03:49.968357] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. AEFC took 16.4s. Estimated remaining: 4h 19m 56s. Rate: 9.0 symbols/min [2025-09-26T17:03:50.143973] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:50.144164] [DEBUG] [LOCAL ] AEM: No existing data file found in primary storage. [2025-09-26T17:03:50.144224] [WARN ] [MAIN ] AEM: No existing data found, performing full refresh instead. [2025-09-26T17:03:50.144375] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-26T17:03:50.144418] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-26T17:03:50.144460] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-26T17:03:50.144492] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-26T17:03:50.361798] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-26T17:03:50.516151] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:51.026467] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T17:03:51.156758] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-26T17:03:51.845383] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T17:03:51.956679] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-26T17:03:52.756775] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-26T17:03:52.798964] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:03:53.373585] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T17:03:53.556770] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-26T17:03:54.356737] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-26T17:03:54.721538] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T17:03:55.156750] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-26T17:03:55.280676] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T17:03:55.866521] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T17:03:55.956777] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-26T17:03:56.670168] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T17:03:56.681598] [INFO ] [REMOTE ] ADT: Full fetch complete (77204 records). [2025-09-26T17:03:56.681825] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-26T17:03:56.762677] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-26T17:03:57.127343] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-26T17:03:57.127448] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-26T17:03:57.128301] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-26T17:03:57.128369] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-26T17:03:57.130135] [DEBUG] [LOCAL ] ADT: Trimmed 77204 records to 54253 (keeping 200 days of data) [2025-09-26T17:03:57.485794] [DEBUG] [LOCAL ] ADT: Primary data saved (54253 records). [2025-09-26T17:03:57.486203] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-26T17:03:57.486511] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. ADT took 44.8s. Estimated remaining: 4h 20m 46s. Rate: 9.0 symbols/min [2025-09-26T17:03:57.560947] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-26T17:03:57.716444] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:57.720601] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T17:03:57.789337] [DEBUG] [LOCAL ] AEO: Loaded 53946 existing records from primary storage. [2025-09-26T17:03:57.789519] [INFO ] [MAIN ] AEO: Loaded 53946 existing records. [2025-09-26T17:03:57.982166] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:03:57.982522] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-26T17:03:57.982615] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-26T17:03:57.984122] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-26T17:03:57.984184] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-26T17:03:58.359099] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-26T17:03:58.359000] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:58.397828] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:03:58.409323] [INFO ] [REMOTE ] AEE: Full fetch complete (72553 records). [2025-09-26T17:03:58.409563] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-26T17:03:58.836130] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-26T17:03:58.836228] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-26T17:03:58.836957] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-26T17:03:58.837058] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-26T17:03:58.838805] [DEBUG] [LOCAL ] AEE: Trimmed 72553 records to 50875 (keeping 200 days of data) [2025-09-26T17:03:59.156890] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-26T17:03:59.175091] [DEBUG] [LOCAL ] AEE: Primary data saved (50875 records). [2025-09-26T17:03:59.175313] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-26T17:03:59.176756] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEE took 35.5s. Estimated remaining: 4h 15m 14s. Rate: 9.1 symbols/min [2025-09-26T17:03:59.368465] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:03:59.368746] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-09-26T17:03:59.368820] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-09-26T17:03:59.368976] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-26T17:03:59.369021] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-26T17:03:59.369064] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-09-26T17:03:59.369102] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-26T17:03:59.805799] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:03:59.808936] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-26T17:03:59.956736] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-26T17:04:00.060913] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T17:04:00.709961] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T17:04:00.756727] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-26T17:04:01.417062] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T17:04:01.556743] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-26T17:04:02.074226] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:04:02.356752] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-26T17:04:03.156698] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-26T17:04:03.197294] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:04:03.956730] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-26T17:04:04.026708] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:04:04.717208] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:04:04.756696] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-26T17:04:05.365982] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:04:05.556766] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-26T17:04:06.356768] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-26T17:04:06.464716] [DEBUG] [REMOTE ] AER: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-26T17:04:06.465270] [WARN ] [REMOTE ] AER: No data returned for month 2025-02 [2025-09-26T17:04:06.741304] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T17:04:06.828919] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:04:07.156739] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-26T17:04:07.956779] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-26T17:04:08.756819] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-26T17:04:08.917335] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T17:04:09.292746] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T17:04:09.556748] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-26T17:04:09.951663] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T17:04:10.356758] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-26T17:04:11.156734] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-26T17:04:11.473863] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T17:04:11.870491] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:04:11.956783] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-26T17:04:12.715793] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T17:04:12.756733] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-26T17:04:13.556722] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-26T17:04:13.946481] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-26T17:04:14.356739] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-26T17:04:14.667334] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T17:04:15.156746] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-26T17:04:15.716708] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-26T17:04:15.956730] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-26T17:04:16.195266] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T17:04:16.205460] [INFO ] [REMOTE ] AEG: Full fetch complete (70286 records). [2025-09-26T17:04:16.205619] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-26T17:04:16.696134] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-26T17:04:16.696253] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-26T17:04:16.697098] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-26T17:04:16.697212] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-26T17:04:16.698888] [DEBUG] [LOCAL ] AEG: Trimmed 70286 records to 50307 (keeping 200 days of data) [2025-09-26T17:04:16.758330] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-26T17:04:16.954284] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T17:04:17.067566] [DEBUG] [LOCAL ] AEG: Primary data saved (50307 records). [2025-09-26T17:04:17.067758] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-26T17:04:17.067877] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 31.5s. Estimated remaining: 4h 27m 3s. Rate: 8.7 symbols/min [2025-09-26T17:04:17.556779] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-26T17:04:18.212384] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-26T17:04:18.356779] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-26T17:04:18.577332] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T17:04:18.868857] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T17:04:19.156774] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-26T17:04:19.904698] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:04:19.956695] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-26T17:04:20.241860] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T17:04:20.756788] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-26T17:04:21.477192] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T17:04:21.487820] [INFO ] [REMOTE ] AEM: Full fetch complete (76755 records). [2025-09-26T17:04:21.488003] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-26T17:04:21.490522] [FATAL] [VALIDATOR ] AEM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:04:21.490636] [FATAL] [MAIN ] AEM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:04:21.490719] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:04:21.490794] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-26T17:04:21.490867] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-26T17:04:21.490918] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-09-26T17:04:21.491003] [DEBUG] [LOCAL ] AEM: No derivative data file found to delete. [2025-09-26T17:04:21.491099] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEM took 31.5s. Estimated remaining: 4h 24m 26s. Rate: 8.8 symbols/min [2025-09-26T17:04:21.556775] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-26T17:04:22.310584] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:04:22.356705] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-26T17:04:22.626180] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T17:04:23.156791] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-26T17:04:24.353033] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T17:04:24.366013] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-26T17:04:24.791033] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:04:24.800966] [INFO ] [REMOTE ] AER: Full fetch complete (62826 records). [2025-09-26T17:04:24.801117] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-26T17:04:25.015881] [WARN ] [VALIDATOR ] AER: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T17:04:25.016606] [FATAL] [MAIN ] AER: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:04:25.016705] [WARN ] [MAIN ] AER: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:04:25.016780] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-26T17:04:25.016912] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-09-26T17:04:25.016977] [INFO ] [LOCAL ] AER: Starting deletion of derivative data. [2025-09-26T17:04:25.017087] [DEBUG] [LOCAL ] AER: No derivative data file found to delete. [2025-09-26T17:04:25.017182] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AER took 25.8s. Estimated remaining: 4h 21m 3s. Rate: 8.9 symbols/min [2025-09-26T17:04:26.200105] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T17:04:26.212850] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-26T17:04:29.195617] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-09-26T17:04:29.206769] [INFO ] [REMOTE ] AEO: Full fetch complete (77444 records). [2025-09-26T17:04:29.206929] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-26T17:04:29.636057] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-26T17:04:29.636163] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-26T17:04:29.636954] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-26T17:04:29.637081] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-26T17:04:29.638842] [DEBUG] [LOCAL ] AEO: Trimmed 77444 records to 54336 (keeping 200 days of data) [2025-09-26T17:04:29.983352] [DEBUG] [LOCAL ] AEO: Primary data saved (54336 records). [2025-09-26T17:04:29.983532] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-26T17:04:29.983671] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEO took 32.5s. Estimated remaining: 4h 19m 14s. Rate: 9.0 symbols/min [2025-09-26T17:04:30.720137] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:30.741535] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:30.742389] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:30.740213] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:30.743027] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-09-26T17:04:30.743742] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-09-26T17:04:30.743886] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-09-26T17:04:30.743927] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-26T17:04:30.743969] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-26T17:04:30.744001] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-09-26T17:04:30.884628] [DEBUG] [LOCAL ] AFB: Loaded 11386 existing records from primary storage. [2025-09-26T17:04:30.922358] [INFO ] [MAIN ] AFB: Loaded 11386 existing records. [2025-09-26T17:04:31.216446] [DEBUG] [LOCAL ] AESI: Loaded 49853 existing records from primary storage. [2025-09-26T17:04:31.319844] [DEBUG] [LOCAL ] AES: Loaded 54061 existing records from primary storage. [2025-09-26T17:04:31.320020] [INFO ] [MAIN ] AESI: Loaded 49853 existing records. [2025-09-26T17:04:31.398593] [INFO ] [MAIN ] AES: Loaded 54061 existing records. [2025-09-26T17:04:31.488418] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:31.521585] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:31.541399] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-09-26T17:04:31.619852] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-26T17:04:31.665020] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-26T17:04:31.725784] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-26T17:04:31.761523] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-26T17:04:31.855793] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:31.890676] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:31.926554] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-26T17:04:31.926195] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:31.938589] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-26T17:04:31.948373] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-26T17:04:31.948281] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-09-26T17:04:31.964118] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-26T17:04:31.969876] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-09-26T17:04:31.964059] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-26T17:04:31.981325] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-26T17:04:31.993902] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-26T17:04:31.993726] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-26T17:04:32.292811] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:32.375537] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-09-26T17:04:32.409762] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-02. [2025-09-26T17:04:32.827996] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:32.843032] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:32.864399] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-02 [2025-09-26T17:04:32.895833] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-26T17:04:32.906577] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-03. [2025-09-26T17:04:33.097338] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:33.098874] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-26T17:04:33.125677] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:33.126318] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-26T17:04:33.196755] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:33.197146] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-03 [2025-09-26T17:04:33.197621] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-04. [2025-09-26T17:04:33.394455] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:33.394808] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-04 [2025-09-26T17:04:33.395299] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-05. [2025-09-26T17:04:33.612402] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:33.612832] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-05 [2025-09-26T17:04:33.613441] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-06. [2025-09-26T17:04:33.851825] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:33.852194] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-06 [2025-09-26T17:04:33.852691] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-07. [2025-09-26T17:04:33.958739] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T17:04:34.047372] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:34.047734] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-07 [2025-09-26T17:04:34.356718] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-26T17:04:34.763389] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T17:04:34.858014] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T17:04:34.894870] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:04:35.156731] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-26T17:04:35.956729] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-26T17:04:36.604373] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T17:04:36.756703] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-26T17:04:36.942670] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T17:04:37.556741] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-08. [2025-09-26T17:04:37.757614] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:37.757979] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-08 [2025-09-26T17:04:38.320563] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:04:38.356690] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-26T17:04:39.156727] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-09. [2025-09-26T17:04:39.397457] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:04:39.397827] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-09 [2025-09-26T17:04:39.397944] [INFO ] [REMOTE ] AEXA: Full fetch complete (0 records). [2025-09-26T17:04:39.398023] [DEBUG] [VALIDATOR ] AEXA: Validating primary data. [2025-09-26T17:04:39.398103] [WARN ] [VALIDATOR ] AEXA: No data provided for validation! [2025-09-26T17:04:39.398190] [FATAL] [MAIN ] AEXA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:04:39.398267] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:04:39.398361] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-09-26T17:04:39.398459] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-09-26T17:04:39.398518] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-09-26T17:04:39.398704] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-09-26T17:04:39.398785] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AEXA took 9.4s. Estimated remaining: 4h 21m 44s. Rate: 8.9 symbols/min [2025-09-26T17:04:39.606527] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:39.659346] [DEBUG] [LOCAL ] AFG: Loaded 32808 existing records from primary storage. [2025-09-26T17:04:39.659528] [INFO ] [MAIN ] AFG: Loaded 32808 existing records. [2025-09-26T17:04:39.858199] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:39.858635] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-26T17:04:39.858778] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-26T17:04:39.859896] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-26T17:04:39.859963] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-26T17:04:39.961840] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-26T17:04:40.021726] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T17:04:40.287268] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:40.756757] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-26T17:04:41.556759] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-26T17:04:41.907493] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T17:04:42.285511] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T17:04:42.356705] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-26T17:04:42.552401] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T17:04:42.915799] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T17:04:43.156755] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-26T17:04:43.956697] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-26T17:04:44.078759] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T17:04:44.756739] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-26T17:04:45.466514] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T17:04:45.556700] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-26T17:04:45.665280] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T17:04:46.101752] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T17:04:46.356726] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-26T17:04:47.156715] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-26T17:04:47.196826] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:04:47.956723] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-26T17:04:48.756720] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-26T17:04:48.956729] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T17:04:49.518102] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:04:49.556723] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-26T17:04:49.673909] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T17:04:50.334030] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T17:04:50.356686] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-26T17:04:51.156733] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-26T17:04:51.621099] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T17:04:51.623988] [INFO ] [REMOTE ] AFB: Full fetch complete (16499 records). [2025-09-26T17:04:51.624085] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-26T17:04:51.961806] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-26T17:04:52.026626] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-26T17:04:52.026810] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-26T17:04:52.027194] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-26T17:04:52.027269] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-26T17:04:52.027931] [DEBUG] [LOCAL ] AFB: Trimmed 16499 records to 11422 (keeping 200 days of data) [2025-09-26T17:04:52.100201] [DEBUG] [LOCAL ] AFB: Primary data saved (11422 records). [2025-09-26T17:04:52.100361] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-26T17:04:52.100455] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AFB took 22.1s. Estimated remaining: 4h 27m 7s. Rate: 8.7 symbols/min [2025-09-26T17:04:52.275762] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:04:52.280984] [DEBUG] [LOCAL ] AFGB: Loaded 2394 existing records from primary storage. [2025-09-26T17:04:52.281075] [INFO ] [MAIN ] AFGB: Loaded 2394 existing records. [2025-09-26T17:04:52.466839] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:04:52.467134] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-26T17:04:52.467219] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-26T17:04:52.467471] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-26T17:04:52.467531] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-26T17:04:52.760400] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-26T17:04:52.871998] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:04:53.249109] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T17:04:53.281300] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:04:53.556723] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-26T17:04:54.126582] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T17:04:54.356735] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-26T17:04:55.156725] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-26T17:04:55.312195] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T17:04:55.951530] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:04:55.959396] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-26T17:04:56.730798] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T17:04:56.756737] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-26T17:04:57.556740] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-26T17:04:57.844552] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T17:04:58.169106] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T17:04:58.356770] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-26T17:04:58.834333] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T17:04:59.156733] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-26T17:04:59.762724] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T17:04:59.822188] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T17:04:59.956769] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-26T17:05:00.756776] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-26T17:05:01.556759] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-26T17:05:02.132078] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:05:02.344039] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-26T17:05:02.356706] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-26T17:05:02.861419] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T17:05:03.156691] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-26T17:05:03.275235] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:05:03.285571] [INFO ] [REMOTE ] AESI: Full fetch complete (69961 records). [2025-09-26T17:05:03.285765] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-26T17:05:03.286806] [FATAL] [VALIDATOR ] AESI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:05:03.286900] [FATAL] [MAIN ] AESI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:05:03.286946] [WARN ] [MAIN ] AESI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:05:03.286986] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-26T17:05:03.287111] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-26T17:05:03.287167] [INFO ] [LOCAL ] AESI: Starting deletion of derivative data. [2025-09-26T17:05:03.287811] [DEBUG] [LOCAL ] AESI: Deleted derivative data file. [2025-09-26T17:05:03.287951] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 33.3s. Estimated remaining: 4h 30m 54s. Rate: 8.6 symbols/min [2025-09-26T17:05:03.477419] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:03.482330] [DEBUG] [LOCAL ] AFGC: Loaded 2590 existing records from primary storage. [2025-09-26T17:05:03.482440] [INFO ] [MAIN ] AFGC: Loaded 2590 existing records. [2025-09-26T17:05:03.673830] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:03.674148] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-26T17:05:03.674198] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-26T17:05:03.674512] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-26T17:05:03.674574] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-26T17:05:03.965249] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-26T17:05:04.094189] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:04.756785] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-26T17:05:04.942845] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:05:05.202029] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T17:05:05.556768] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-26T17:05:05.593614] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:05:06.080714] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-26T17:05:06.356821] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-26T17:05:06.927231] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-26T17:05:07.156748] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-26T17:05:07.956724] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-26T17:05:08.091767] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:05:08.318450] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-26T17:05:08.756774] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-26T17:05:09.327738] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T17:05:09.556755] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-26T17:05:09.992296] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T17:05:10.356771] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-26T17:05:11.156704] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-26T17:05:11.407062] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:05:11.418435] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-09-26T17:05:11.418612] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-26T17:05:11.883796] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-26T17:05:11.883953] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-26T17:05:11.884754] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-26T17:05:11.884827] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-26T17:05:11.886480] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 54450 (keeping 200 days of data) [2025-09-26T17:05:11.957228] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-26T17:05:12.243826] [DEBUG] [LOCAL ] AES: Primary data saved (54450 records). [2025-09-26T17:05:12.243990] [INFO ] [MAIN ] AES: Full history saved. [2025-09-26T17:05:12.246890] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AES took 42.3s. Estimated remaining: 4h 32m 31s. Rate: 8.5 symbols/min [2025-09-26T17:05:12.437556] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:12.442213] [DEBUG] [LOCAL ] AFGD: Loaded 1852 existing records from primary storage. [2025-09-26T17:05:12.442318] [INFO ] [MAIN ] AFGD: Loaded 1852 existing records. [2025-09-26T17:05:12.664242] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:12.667445] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-26T17:05:12.667201] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T17:05:12.667626] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-26T17:05:12.675533] [INFO ] [REMOTE ] AFG: Full fetch complete (45743 records). [2025-09-26T17:05:12.675600] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-26T17:05:12.675901] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-26T17:05:12.675841] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-26T17:05:12.780099] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-26T17:05:13.476376] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:13.498555] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T17:05:13.518729] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-26T17:05:13.518802] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-26T17:05:13.519299] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-26T17:05:13.519341] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-26T17:05:13.520373] [DEBUG] [LOCAL ] AFG: Trimmed 45743 records to 33021 (keeping 200 days of data) [2025-09-26T17:05:13.578096] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-26T17:05:13.739891] [DEBUG] [LOCAL ] AFG: Primary data saved (33021 records). [2025-09-26T17:05:13.740062] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-26T17:05:13.745761] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AFG took 34.3s. Estimated remaining: 4h 27m 39s. Rate: 8.7 symbols/min [2025-09-26T17:05:13.929770] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:13.935376] [DEBUG] [LOCAL ] AFGE: Loaded 2508 existing records from primary storage. [2025-09-26T17:05:13.935492] [INFO ] [MAIN ] AFGE: Loaded 2508 existing records. [2025-09-26T17:05:14.126243] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:14.126509] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-26T17:05:14.126602] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-26T17:05:14.127064] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-26T17:05:14.127125] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-26T17:05:14.215840] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T17:05:14.361916] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-26T17:05:14.541392] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:14.946044] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T17:05:15.156774] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-26T17:05:15.406939] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (3.45 seconds). [2025-09-26T17:05:15.794557] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T17:05:15.956789] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-26T17:05:16.424123] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T17:05:16.756771] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-26T17:05:17.208670] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T17:05:17.556729] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-26T17:05:18.160367] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T17:05:18.356740] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-26T17:05:18.845501] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-26T17:05:19.156782] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-26T17:05:19.666553] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T17:05:19.956771] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-26T17:05:20.530773] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T17:05:20.756787] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-26T17:05:21.254366] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T17:05:21.255554] [INFO ] [REMOTE ] AFGB: Full fetch complete (3649 records). [2025-09-26T17:05:21.255676] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-26T17:05:21.599109] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-26T17:05:21.686398] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-26T17:05:21.686707] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-26T17:05:21.686872] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-26T17:05:21.686934] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-26T17:05:21.687349] [DEBUG] [LOCAL ] AFGB: Trimmed 3649 records to 2404 (keeping 200 days of data) [2025-09-26T17:05:21.702545] [DEBUG] [LOCAL ] AFGB: Primary data saved (2404 records). [2025-09-26T17:05:21.702624] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-26T17:05:21.702754] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGB took 29.6s. Estimated remaining: 4h 28m 25s. Rate: 8.7 symbols/min [2025-09-26T17:05:21.884974] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:21.947168] [DEBUG] [LOCAL ] AFL: Loaded 53532 existing records from primary storage. [2025-09-26T17:05:21.947341] [INFO ] [MAIN ] AFL: Loaded 53532 existing records. [2025-09-26T17:05:22.075106] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T17:05:22.165413] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:22.165752] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-26T17:05:22.165812] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-26T17:05:22.167784] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-26T17:05:22.167851] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-26T17:05:22.365609] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-26T17:05:22.561893] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:22.845379] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-26T17:05:23.156755] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-26T17:05:23.610418] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T17:05:23.956737] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-26T17:05:24.414881] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T17:05:24.756806] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-26T17:05:25.268506] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T17:05:25.556751] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-26T17:05:26.254948] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:05:26.356740] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-26T17:05:26.672910] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-26T17:05:27.156795] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-26T17:05:27.593018] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T17:05:27.956747] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-26T17:05:28.548482] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T17:05:28.756765] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-26T17:05:29.201417] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-26T17:05:29.556726] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-26T17:05:29.962226] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-26T17:05:30.356759] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-26T17:05:31.156937] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-26T17:05:31.719845] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-26T17:05:31.721186] [INFO ] [REMOTE ] AFGD: Full fetch complete (3178 records). [2025-09-26T17:05:31.721261] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-26T17:05:31.961840] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-26T17:05:32.153274] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-26T17:05:32.153410] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-26T17:05:32.153688] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-26T17:05:32.153809] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-26T17:05:32.155092] [DEBUG] [LOCAL ] AFGD: Trimmed 3178 records to 1859 (keeping 200 days of data) [2025-09-26T17:05:32.168681] [DEBUG] [LOCAL ] AFGD: Primary data saved (1859 records). [2025-09-26T17:05:32.168898] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-26T17:05:32.169104] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGD took 19.9s. Estimated remaining: 4h 31m 13s. Rate: 8.6 symbols/min [2025-09-26T17:05:32.399862] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:05:32.443807] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:32.505058] [DEBUG] [LOCAL ] AG: Loaded 54033 existing records from primary storage. [2025-09-26T17:05:32.505260] [INFO ] [MAIN ] AG: Loaded 54033 existing records. [2025-09-26T17:05:32.740349] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T17:05:32.740541] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:32.743235] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-26T17:05:32.743305] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-26T17:05:32.745170] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-26T17:05:32.745262] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-26T17:05:32.761854] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-26T17:05:33.183729] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:33.469463] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T17:05:33.556729] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-26T17:05:34.356747] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-26T17:05:34.813513] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T17:05:35.156758] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-26T17:05:35.460099] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T17:05:35.956756] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-26T17:05:36.719368] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:05:36.756690] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-26T17:05:37.556721] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-26T17:05:37.617989] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T17:05:38.120746] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T17:05:38.356743] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-26T17:05:38.431587] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T17:05:39.156778] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-26T17:05:39.667754] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T17:05:39.669476] [INFO ] [REMOTE ] AFGC: Full fetch complete (3727 records). [2025-09-26T17:05:39.669556] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-26T17:05:39.961951] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-26T17:05:40.064424] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-26T17:05:40.064599] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-26T17:05:40.064824] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-26T17:05:40.065003] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-26T17:05:40.065536] [DEBUG] [LOCAL ] AFGC: Trimmed 3727 records to 2602 (keeping 200 days of data) [2025-09-26T17:05:40.082483] [DEBUG] [LOCAL ] AFGC: Primary data saved (2602 records). [2025-09-26T17:05:40.082584] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-26T17:05:40.082698] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 36.8s. Estimated remaining: 4h 31m 50s. Rate: 8.5 symbols/min [2025-09-26T17:05:40.308447] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T17:05:40.317913] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:40.337615] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T17:05:40.387250] [DEBUG] [LOCAL ] AGCO: Loaded 42791 existing records from primary storage. [2025-09-26T17:05:40.387475] [INFO ] [MAIN ] AGCO: Loaded 42791 existing records. [2025-09-26T17:05:40.594994] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:40.595284] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-26T17:05:40.595335] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-26T17:05:40.596913] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-26T17:05:40.596979] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-26T17:05:40.763832] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-26T17:05:41.030691] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:41.556769] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-26T17:05:42.060929] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T17:05:42.356747] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-26T17:05:42.640502] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T17:05:43.156737] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-26T17:05:43.680373] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T17:05:43.681378] [INFO ] [REMOTE ] AFGE: Full fetch complete (3486 records). [2025-09-26T17:05:43.681452] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-26T17:05:43.681868] [FATAL] [VALIDATOR ] AFGE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:05:43.682009] [FATAL] [MAIN ] AFGE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:05:43.682056] [WARN ] [MAIN ] AFGE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:05:43.682096] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-26T17:05:43.682155] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-09-26T17:05:43.682192] [INFO ] [LOCAL ] AFGE: Starting deletion of derivative data. [2025-09-26T17:05:43.682826] [DEBUG] [LOCAL ] AFGE: Deleted derivative data file. [2025-09-26T17:05:43.682929] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGE took 29.9s. Estimated remaining: 4h 29m 1s. Rate: 8.6 symbols/min [2025-09-26T17:05:43.873941] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:05:43.895717] [DEBUG] [LOCAL ] AGD: Loaded 17874 existing records from primary storage. [2025-09-26T17:05:43.895864] [INFO ] [MAIN ] AGD: Loaded 17874 existing records. [2025-09-26T17:05:43.958343] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-26T17:05:44.138590] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:05:44.139284] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-26T17:05:44.139507] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-26T17:05:44.140772] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-26T17:05:44.140858] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-26T17:05:44.434979] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-26T17:05:44.641074] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:05:44.756787] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-26T17:05:45.556728] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-26T17:05:45.629986] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:05:46.279329] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:05:46.356782] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-26T17:05:47.156736] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-26T17:05:47.396042] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T17:05:47.754133] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:05:47.809009] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T17:05:47.956784] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-26T17:05:48.756782] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-26T17:05:49.531784] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T17:05:49.556709] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-26T17:05:49.595866] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T17:05:50.356777] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-26T17:05:50.914337] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T17:05:51.156759] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-26T17:05:51.956715] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-26T17:05:52.440108] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T17:05:52.570043] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T17:05:52.594184] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T17:05:52.756780] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-26T17:05:53.556779] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-26T17:05:54.368290] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-26T17:05:54.376098] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:05:54.399240] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T17:05:55.156765] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-26T17:05:55.956729] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-26T17:05:56.470771] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-26T17:05:56.756773] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-26T17:05:56.818533] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:05:57.021538] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T17:05:57.556737] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-26T17:05:58.356807] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-26T17:05:58.496930] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T17:05:58.694800] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T17:05:59.156778] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-26T17:05:59.392375] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T17:05:59.956734] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-26T17:06:00.589779] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:06:00.756775] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-26T17:06:01.181032] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T17:06:01.556789] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-26T17:06:02.356785] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-26T17:06:02.760372] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T17:06:02.913430] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T17:06:02.925005] [INFO ] [REMOTE ] AFL: Full fetch complete (76535 records). [2025-09-26T17:06:02.925283] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-26T17:06:02.931314] [FATAL] [VALIDATOR ] AFL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:06:02.931496] [FATAL] [MAIN ] AFL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:06:02.931586] [WARN ] [MAIN ] AFL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:06:02.931727] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-26T17:06:02.931831] [DEBUG] [LOCAL ] AFL: No primary data file found to delete. [2025-09-26T17:06:02.931899] [INFO ] [LOCAL ] AFL: Starting deletion of derivative data. [2025-09-26T17:06:02.932570] [DEBUG] [LOCAL ] AFL: Deleted derivative data file. [2025-09-26T17:06:02.932794] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 41.2s. Estimated remaining: 4h 38m 25s. Rate: 8.3 symbols/min [2025-09-26T17:06:03.132684] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:03.156741] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-26T17:06:03.209636] [DEBUG] [LOCAL ] AGI: Loaded 53807 existing records from primary storage. [2025-09-26T17:06:03.209847] [INFO ] [MAIN ] AGI: Loaded 53807 existing records. [2025-09-26T17:06:03.414706] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:03.414995] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-26T17:06:03.415045] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-26T17:06:03.416613] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-26T17:06:03.416952] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-26T17:06:03.812456] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:03.845756] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:06:03.878334] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T17:06:03.956745] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-26T17:06:04.756734] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-26T17:06:05.556745] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-26T17:06:05.789445] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T17:06:06.356731] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-26T17:06:06.464416] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T17:06:06.473312] [INFO ] [REMOTE ] AGCO: Full fetch complete (61985 records). [2025-09-26T17:06:06.473519] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-26T17:06:06.930428] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-26T17:06:06.926731] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T17:06:06.930613] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-26T17:06:06.936821] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-26T17:06:06.937082] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-26T17:06:06.939725] [DEBUG] [LOCAL ] AGCO: Trimmed 61985 records to 43086 (keeping 200 days of data) [2025-09-26T17:06:07.177415] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-26T17:06:07.239357] [DEBUG] [LOCAL ] AGCO: Primary data saved (43086 records). [2025-09-26T17:06:07.239522] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-26T17:06:07.239623] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGCO took 27.2s. Estimated remaining: 4h 36m 6s. Rate: 8.4 symbols/min [2025-09-26T17:06:07.440795] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:07.500143] [DEBUG] [LOCAL ] AGL: Loaded 52810 existing records from primary storage. [2025-09-26T17:06:07.500309] [INFO ] [MAIN ] AGL: Loaded 52810 existing records. [2025-09-26T17:06:07.688436] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:07.688745] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-26T17:06:07.688818] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-26T17:06:07.690274] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-26T17:06:07.690340] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-26T17:06:07.962999] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-26T17:06:08.083509] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:08.242589] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T17:06:08.756781] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-26T17:06:08.855137] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T17:06:08.967666] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T17:06:09.556744] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-26T17:06:10.356741] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-26T17:06:10.542169] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:06:11.126634] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T17:06:11.156694] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-26T17:06:11.684619] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:06:11.956762] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-26T17:06:12.747697] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:06:12.758991] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-26T17:06:13.556723] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-26T17:06:13.718594] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:06:13.723403] [INFO ] [REMOTE ] AGD: Full fetch complete (25388 records). [2025-09-26T17:06:13.723521] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-26T17:06:14.142768] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-26T17:06:14.142856] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-26T17:06:14.143219] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-26T17:06:14.143296] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-26T17:06:14.144197] [DEBUG] [LOCAL ] AGD: Trimmed 25388 records to 17937 (keeping 200 days of data) [2025-09-26T17:06:14.270971] [DEBUG] [LOCAL ] AGD: Primary data saved (17937 records). [2025-09-26T17:06:14.271164] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-26T17:06:14.271307] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AGD took 30.6s. Estimated remaining: 4h 35m 54s. Rate: 8.4 symbols/min [2025-09-26T17:06:14.361793] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-26T17:06:14.462280] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:14.475190] [DEBUG] [LOCAL ] AGM: Loaded 9994 existing records from primary storage. [2025-09-26T17:06:14.475313] [INFO ] [MAIN ] AGM: Loaded 9994 existing records. [2025-09-26T17:06:14.678692] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:14.679269] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-26T17:06:14.679495] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-26T17:06:14.680042] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-26T17:06:14.680106] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-26T17:06:15.044374] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-09-26T17:06:15.108502] [INFO ] [REMOTE ] AG: Full fetch complete (77586 records). [2025-09-26T17:06:15.119527] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-26T17:06:15.148760] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:15.191826] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-26T17:06:15.588326] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-26T17:06:15.588449] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-26T17:06:15.589398] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-26T17:06:15.589558] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-26T17:06:15.623857] [DEBUG] [LOCAL ] AG: Trimmed 77586 records to 54423 (keeping 200 days of data) [2025-09-26T17:06:15.623677] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T17:06:15.759163] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T17:06:15.910830] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T17:06:15.989000] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-26T17:06:16.043485] [DEBUG] [LOCAL ] AG: Primary data saved (54423 records). [2025-09-26T17:06:16.043661] [INFO ] [MAIN ] AG: Full history saved. [2025-09-26T17:06:16.045121] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AG took 43.9s. Estimated remaining: 4h 31m 52s. Rate: 8.5 symbols/min [2025-09-26T17:06:16.228742] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:16.267807] [DEBUG] [LOCAL ] AGO: Loaded 28247 existing records from primary storage. [2025-09-26T17:06:16.267987] [INFO ] [MAIN ] AGO: Loaded 28247 existing records. [2025-09-26T17:06:16.465176] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:16.465543] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-26T17:06:16.465627] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-26T17:06:16.466779] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-26T17:06:16.466855] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-26T17:06:16.764781] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-26T17:06:16.862450] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:17.459540] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T17:06:17.556725] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-26T17:06:18.356744] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-26T17:06:18.428720] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:06:18.808308] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-26T17:06:18.900107] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:06:19.156759] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-26T17:06:19.956962] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-26T17:06:20.740062] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T17:06:20.756679] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-26T17:06:20.860886] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:06:21.556736] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-26T17:06:22.271755] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:06:22.356740] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-26T17:06:22.815838] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T17:06:23.158873] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-26T17:06:23.175499] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T17:06:23.956714] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-26T17:06:24.079551] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T17:06:24.756735] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-26T17:06:25.556731] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-26T17:06:25.633930] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T17:06:25.671251] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T17:06:26.071637] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-26T17:06:26.356735] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-26T17:06:27.156733] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-26T17:06:27.614965] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:06:27.956731] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-26T17:06:28.700259] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T17:06:28.756778] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-26T17:06:28.846500] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T17:06:29.556752] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-26T17:06:30.356712] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-26T17:06:30.394060] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T17:06:30.539350] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T17:06:31.156712] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-26T17:06:31.480348] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T17:06:31.956748] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-26T17:06:32.756761] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-26T17:06:33.181176] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T17:06:33.556699] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-26T17:06:33.933174] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T17:06:33.936294] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T17:06:33.955126] [INFO ] [REMOTE ] AGL: Full fetch complete (75474 records). [2025-09-26T17:06:33.955328] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-26T17:06:34.360955] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-26T17:06:34.385358] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-26T17:06:34.385461] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-26T17:06:34.386229] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-26T17:06:34.386412] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-26T17:06:34.388175] [DEBUG] [LOCAL ] AGL: Trimmed 75474 records to 53191 (keeping 200 days of data) [2025-09-26T17:06:34.703238] [DEBUG] [LOCAL ] AGL: Primary data saved (53191 records). [2025-09-26T17:06:34.703476] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-26T17:06:34.703610] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGL took 27.5s. Estimated remaining: 4h 40m 4s. Rate: 8.3 symbols/min [2025-09-26T17:06:34.884281] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:34.918217] [DEBUG] [LOCAL ] AGRO: Loaded 33927 existing records from primary storage. [2025-09-26T17:06:34.918385] [INFO ] [MAIN ] AGRO: Loaded 33927 existing records. [2025-09-26T17:06:35.131730] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:35.132190] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-26T17:06:35.132271] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-26T17:06:35.133431] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-26T17:06:35.133513] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-26T17:06:35.164867] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-26T17:06:35.435915] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:06:35.579329] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:35.762954] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-26T17:06:35.956741] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-26T17:06:36.140174] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T17:06:36.756733] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-26T17:06:37.141558] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T17:06:37.346957] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:06:37.556726] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-26T17:06:38.345244] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T17:06:38.356674] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-26T17:06:39.076494] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T17:06:39.079112] [INFO ] [REMOTE ] AGM: Full fetch complete (12620 records). [2025-09-26T17:06:39.079212] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-26T17:06:39.161870] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-26T17:06:39.469444] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-26T17:06:39.469533] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-26T17:06:39.469833] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-26T17:06:39.469903] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-26T17:06:39.470724] [DEBUG] [LOCAL ] AGM: Trimmed 12620 records to 10125 (keeping 200 days of data) [2025-09-26T17:06:39.542550] [DEBUG] [LOCAL ] AGM: Primary data saved (10125 records). [2025-09-26T17:06:39.542744] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-26T17:06:39.542850] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGM took 25.3s. Estimated remaining: 4h 38m 15s. Rate: 8.3 symbols/min [2025-09-26T17:06:39.724280] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:39.778978] [DEBUG] [LOCAL ] AGX: Loaded 33628 existing records from primary storage. [2025-09-26T17:06:39.779201] [INFO ] [MAIN ] AGX: Loaded 33628 existing records. [2025-09-26T17:06:39.965500] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-26T17:06:39.972533] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:39.974137] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-26T17:06:39.974212] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-26T17:06:39.975402] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-26T17:06:39.975485] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-26T17:06:40.369047] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:40.399774] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T17:06:40.756727] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-26T17:06:40.987053] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:06:41.556742] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-26T17:06:41.720836] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T17:06:42.356780] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-26T17:06:42.627819] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T17:06:43.156751] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-26T17:06:43.956764] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-26T17:06:44.137586] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T17:06:44.273383] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T17:06:44.278929] [INFO ] [REMOTE ] AGO: Full fetch complete (39304 records). [2025-09-26T17:06:44.279049] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-26T17:06:44.705318] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-26T17:06:44.705444] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-26T17:06:44.705967] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-26T17:06:44.706035] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-26T17:06:44.707211] [DEBUG] [LOCAL ] AGO: Trimmed 39304 records to 28356 (keeping 200 days of data) [2025-09-26T17:06:44.769623] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-26T17:06:44.920789] [DEBUG] [LOCAL ] AGO: Primary data saved (28356 records). [2025-09-26T17:06:44.920950] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-26T17:06:44.922483] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGO took 28.9s. Estimated remaining: 4h 36m 52s. Rate: 8.4 symbols/min [2025-09-26T17:06:45.123805] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:45.177896] [DEBUG] [LOCAL ] AHH: Loaded 41636 existing records from primary storage. [2025-09-26T17:06:45.178127] [INFO ] [MAIN ] AHH: Loaded 41636 existing records. [2025-09-26T17:06:45.469235] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:06:45.469559] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-26T17:06:45.469622] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-26T17:06:45.470962] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-26T17:06:45.471048] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-26T17:06:45.562499] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-26T17:06:45.960477] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:45.985358] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-26T17:06:46.225595] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:06:46.356759] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-26T17:06:47.156749] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-26T17:06:47.539930] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T17:06:47.553201] [INFO ] [REMOTE ] AGI: Full fetch complete (76769 records). [2025-09-26T17:06:47.553758] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-26T17:06:47.785736] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:06:47.961875] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-26T17:06:48.076323] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-26T17:06:48.076452] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-26T17:06:48.077886] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-26T17:06:48.077993] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-26T17:06:48.080285] [DEBUG] [LOCAL ] AGI: Trimmed 76769 records to 54195 (keeping 200 days of data) [2025-09-26T17:06:48.566562] [DEBUG] [LOCAL ] AGI: Primary data saved (54195 records). [2025-09-26T17:06:48.566813] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-26T17:06:48.566984] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGI took 45.6s. Estimated remaining: 4h 34m 22s. Rate: 8.4 symbols/min [2025-09-26T17:06:48.758503] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-26T17:06:48.843132] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:06:48.843815] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-26T17:06:48.844040] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-26T17:06:48.844344] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-26T17:06:48.844525] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-26T17:06:48.844620] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-26T17:06:48.844742] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-26T17:06:49.202637] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T17:06:49.365166] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:06:49.556724] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-26T17:06:49.594172] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:06:49.751500] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:49.751987] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-26T17:06:50.195912] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T17:06:50.356761] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-26T17:06:50.747847] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:50.748199] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-26T17:06:51.156772] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-26T17:06:51.956757] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-26T17:06:52.478734] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:06:52.756775] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-26T17:06:53.297350] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T17:06:53.556728] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-26T17:06:53.776484] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:53.777062] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-26T17:06:54.015389] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T17:06:54.356753] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-26T17:06:54.578910] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:54.579247] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-26T17:06:55.156741] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-26T17:06:55.956743] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-26T17:06:56.598607] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:06:56.756770] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-26T17:06:56.977798] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T17:06:57.556747] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-26T17:06:58.098124] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:06:58.356715] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-26T17:06:58.394904] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T17:06:58.563008] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:06:58.563387] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-26T17:06:59.156782] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-26T17:06:59.956766] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-26T17:07:00.692719] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T17:07:00.756697] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-26T17:07:01.304370] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T17:07:01.556757] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-26T17:07:02.054399] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:07:02.356751] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-26T17:07:02.601187] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T17:07:03.156786] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-26T17:07:03.702130] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T17:07:03.956738] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-26T17:07:04.300547] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T17:07:04.642289] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T17:07:04.756771] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-26T17:07:05.556747] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-26T17:07:06.284006] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:07:06.356742] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-26T17:07:06.838722] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T17:07:06.846368] [INFO ] [REMOTE ] AGX: Full fetch complete (48815 records). [2025-09-26T17:07:06.846516] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-26T17:07:07.161829] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-26T17:07:07.299404] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-26T17:07:07.299564] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-26T17:07:07.300585] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-26T17:07:07.300838] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-26T17:07:07.310272] [DEBUG] [LOCAL ] AGX: Trimmed 48815 records to 33823 (keeping 200 days of data) [2025-09-26T17:07:07.323835] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T17:07:07.595757] [DEBUG] [LOCAL ] AGX: Primary data saved (33823 records). [2025-09-26T17:07:07.595943] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-26T17:07:07.597244] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AGX took 28.1s. Estimated remaining: 4h 42m 10s. Rate: 8.2 symbols/min [2025-09-26T17:07:07.786620] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:07.841600] [DEBUG] [LOCAL ] AHR: Loaded 49615 existing records from primary storage. [2025-09-26T17:07:07.841780] [INFO ] [MAIN ] AHR: Loaded 49615 existing records. [2025-09-26T17:07:07.962089] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-26T17:07:08.054126] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:08.054490] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-26T17:07:08.054576] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-26T17:07:08.056147] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-26T17:07:08.056240] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-26T17:07:08.464447] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:08.504846] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T17:07:08.756735] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-26T17:07:09.009573] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:07:09.016996] [INFO ] [REMOTE ] AGRO: Full fetch complete (49824 records). [2025-09-26T17:07:09.017172] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-26T17:07:09.425489] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-26T17:07:09.425663] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-26T17:07:09.426382] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-26T17:07:09.426446] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-26T17:07:09.427919] [DEBUG] [LOCAL ] AGRO: Trimmed 49824 records to 34097 (keeping 200 days of data) [2025-09-26T17:07:09.586610] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-26T17:07:09.635983] [DEBUG] [LOCAL ] AGRO: Primary data saved (34097 records). [2025-09-26T17:07:09.636138] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-26T17:07:09.636242] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AGRO took 34.9s. Estimated remaining: 4h 38m 36s. Rate: 8.3 symbols/min [2025-09-26T17:07:09.825275] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:09.834047] [DEBUG] [LOCAL ] AHT: Loaded 6122 existing records from primary storage. [2025-09-26T17:07:09.834153] [INFO ] [MAIN ] AHT: Loaded 6122 existing records. [2025-09-26T17:07:10.018324] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:10.018634] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-26T17:07:10.018721] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-26T17:07:10.019134] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-26T17:07:10.019219] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-26T17:07:10.364798] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-26T17:07:10.409074] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:10.443317] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T17:07:10.921542] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:07:11.055272] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T17:07:11.156751] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-26T17:07:11.956778] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-26T17:07:12.756777] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-26T17:07:12.791757] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:07:12.799485] [INFO ] [REMOTE ] AHH: Full fetch complete (59981 records). [2025-09-26T17:07:12.799782] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-26T17:07:12.810892] [FATAL] [VALIDATOR ] AHH: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:07:12.811994] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T17:07:12.815818] [FATAL] [MAIN ] AHH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:07:12.816729] [WARN ] [MAIN ] AHH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:07:12.816810] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-26T17:07:12.816904] [DEBUG] [LOCAL ] AHH: No primary data file found to delete. [2025-09-26T17:07:12.816963] [INFO ] [LOCAL ] AHH: Starting deletion of derivative data. [2025-09-26T17:07:12.817508] [DEBUG] [LOCAL ] AHH: Deleted derivative data file. [2025-09-26T17:07:12.817624] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AHH took 27.9s. Estimated remaining: 4h 35m 52s. Rate: 8.4 symbols/min [2025-09-26T17:07:13.020408] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:13.083580] [DEBUG] [LOCAL ] AI: Loaded 54139 existing records from primary storage. [2025-09-26T17:07:13.083801] [INFO ] [MAIN ] AI: Loaded 54139 existing records. [2025-09-26T17:07:13.305742] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:13.306003] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-26T17:07:13.306052] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-26T17:07:13.307553] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-26T17:07:13.307635] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-26T17:07:13.561928] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-26T17:07:13.721294] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:13.730881] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T17:07:14.356740] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-26T17:07:14.693499] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:07:15.156774] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-26T17:07:15.956744] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-26T17:07:16.721306] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:07:16.756778] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-26T17:07:17.189455] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-26T17:07:17.222107] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:07:17.229792] [INFO ] [REMOTE ] AHL: Full fetch complete (18042 records). [2025-09-26T17:07:17.229881] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-26T17:07:17.428483] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 98 unique days, need 200 days [2025-09-26T17:07:17.428852] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:07:17.428924] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:07:17.428993] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-26T17:07:17.429074] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-26T17:07:17.429133] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-26T17:07:17.429190] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-26T17:07:17.429254] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AHL took 28.9s. Estimated remaining: 4h 34m 9s. Rate: 8.4 symbols/min [2025-09-26T17:07:17.593881] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-26T17:07:17.675358] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:17.733582] [DEBUG] [LOCAL ] AIG: Loaded 53865 existing records from primary storage. [2025-09-26T17:07:17.733834] [INFO ] [MAIN ] AIG: Loaded 53865 existing records. [2025-09-26T17:07:17.934851] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:17.935172] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-26T17:07:17.935222] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-26T17:07:17.937098] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-26T17:07:17.937162] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-26T17:07:18.330799] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:18.356692] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-26T17:07:18.356603] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T17:07:19.156731] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-26T17:07:19.956763] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-26T17:07:20.110221] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T17:07:20.194711] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-26T17:07:20.406425] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-26T17:07:20.504230] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T17:07:20.756738] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-26T17:07:21.556737] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-26T17:07:22.365232] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-26T17:07:22.369032] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T17:07:22.791960] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-26T17:07:23.156775] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-26T17:07:23.956759] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-26T17:07:24.490125] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T17:07:24.570553] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-26T17:07:24.756738] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-26T17:07:25.331082] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:07:25.556731] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-26T17:07:26.356747] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-26T17:07:26.953259] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T17:07:27.135369] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-26T17:07:27.156700] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-26T17:07:27.930448] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:07:27.956718] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-26T17:07:28.756723] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-26T17:07:29.556793] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-26T17:07:29.598427] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T17:07:29.645553] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-26T17:07:30.109609] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T17:07:30.288994] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:07:30.356709] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-26T17:07:30.961536] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T17:07:31.156755] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-26T17:07:31.702317] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T17:07:31.956733] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-26T17:07:32.504780] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T17:07:32.756738] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-26T17:07:33.478875] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T17:07:33.556752] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-26T17:07:34.356750] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-26T17:07:34.990028] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T17:07:35.156707] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-26T17:07:35.188765] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:07:35.956735] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-26T17:07:36.068709] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T17:07:36.756737] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-26T17:07:37.556745] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-26T17:07:38.187850] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-26T17:07:38.231890] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T17:07:38.243314] [INFO ] [REMOTE ] AHR: Full fetch complete (70937 records). [2025-09-26T17:07:38.243483] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-26T17:07:38.361154] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-26T17:07:38.697670] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-26T17:07:38.697777] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-26T17:07:38.698548] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-26T17:07:38.698598] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-26T17:07:38.700280] [DEBUG] [LOCAL ] AHR: Trimmed 70937 records to 49946 (keeping 200 days of data) [2025-09-26T17:07:38.926825] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T17:07:38.937356] [INFO ] [REMOTE ] AHT: Full fetch complete (9396 records). [2025-09-26T17:07:38.937578] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-26T17:07:39.159372] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-26T17:07:39.411697] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-26T17:07:39.412279] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-26T17:07:39.414217] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-26T17:07:39.415168] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-26T17:07:39.416249] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T17:07:39.433176] [DEBUG] [LOCAL ] AHT: Trimmed 9396 records to 6181 (keeping 200 days of data) [2025-09-26T17:07:39.534229] [DEBUG] [LOCAL ] AHR: Primary data saved (49946 records). [2025-09-26T17:07:39.535245] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-26T17:07:39.538859] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHR took 31.9s. Estimated remaining: 4h 43m 20s. Rate: 8.1 symbols/min [2025-09-26T17:07:39.538939] [DEBUG] [LOCAL ] AHT: Primary data saved (6181 records). [2025-09-26T17:07:39.539069] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-26T17:07:39.539463] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHT took 29.9s. Estimated remaining: 4h 38m 43s. Rate: 8.3 symbols/min [2025-09-26T17:07:39.910949] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:39.936846] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:39.937158] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-26T17:07:39.937207] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-26T17:07:39.937364] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-26T17:07:39.937410] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-26T17:07:39.937454] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-26T17:07:39.937488] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-26T17:07:39.962336] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-26T17:07:40.229337] [DEBUG] [LOCAL ] AIN: Loaded 24757 existing records from primary storage. [2025-09-26T17:07:40.256207] [INFO ] [MAIN ] AIN: Loaded 24757 existing records. [2025-09-26T17:07:40.485216] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:40.568182] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:40.568437] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-26T17:07:40.568488] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-26T17:07:40.569439] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-26T17:07:40.569503] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-26T17:07:40.759510] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-26T17:07:40.954252] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:41.080500] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:41.080867] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-26T17:07:41.522987] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-26T17:07:41.556679] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-26T17:07:41.616252] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:07:42.356743] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-26T17:07:42.567479] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:42.567835] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-26T17:07:43.156719] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-26T17:07:43.956729] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-26T17:07:44.070944] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-26T17:07:44.578076] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T17:07:44.756736] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-26T17:07:44.825079] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T17:07:45.556735] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-26T17:07:46.356702] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-26T17:07:46.556041] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T17:07:47.156697] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-26T17:07:47.338793] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T17:07:47.956769] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-26T17:07:48.023700] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-26T17:07:48.157532] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:48.157948] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-26T17:07:48.756758] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-26T17:07:48.970263] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:07:48.981565] [INFO ] [REMOTE ] AIG: Full fetch complete (77379 records). [2025-09-26T17:07:48.981832] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-26T17:07:49.412162] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-26T17:07:49.412331] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-26T17:07:49.413215] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-26T17:07:49.413305] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-26T17:07:49.415036] [DEBUG] [LOCAL ] AIG: Trimmed 77379 records to 54254 (keeping 200 days of data) [2025-09-26T17:07:49.606514] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-26T17:07:49.774889] [DEBUG] [LOCAL ] AIG: Primary data saved (54254 records). [2025-09-26T17:07:49.775105] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-26T17:07:49.775214] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AIG took 32.3s. Estimated remaining: 4h 40m 23s. Rate: 8.2 symbols/min [2025-09-26T17:07:49.919941] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:07:49.987844] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:50.004670] [DEBUG] [LOCAL ] AIO: Loaded 13365 existing records from primary storage. [2025-09-26T17:07:50.004847] [INFO ] [MAIN ] AIO: Loaded 13365 existing records. [2025-09-26T17:07:50.192635] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:07:50.192943] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-26T17:07:50.193007] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-26T17:07:50.193679] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-26T17:07:50.193750] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-26T17:07:50.378978] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-26T17:07:50.583146] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:51.156785] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-26T17:07:51.808552] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T17:07:51.956742] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-26T17:07:52.178188] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:07:52.319107] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:52.319437] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-26T17:07:52.353560] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-26T17:07:52.364857] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-26T17:07:52.365053] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-26T17:07:52.761580] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-26T17:07:52.788997] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-26T17:07:52.789124] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-26T17:07:52.789997] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-26T17:07:52.790186] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-26T17:07:52.792057] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54529 (keeping 200 days of data) [2025-09-26T17:07:53.074418] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:07:53.100213] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-26T17:07:53.126833] [DEBUG] [LOCAL ] AI: Primary data saved (54529 records). [2025-09-26T17:07:53.127055] [INFO ] [MAIN ] AI: Full history saved. [2025-09-26T17:07:53.130417] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AI took 40.3s. Estimated remaining: 4h 37m 56s. Rate: 8.3 symbols/min [2025-09-26T17:07:53.311721] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:07:53.311926] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-09-26T17:07:53.311969] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-09-26T17:07:53.312120] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-26T17:07:53.312171] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-26T17:07:53.312217] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-09-26T17:07:53.312251] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-26T17:07:53.561872] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-26T17:07:53.721272] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:07:54.356696] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-26T17:07:54.655807] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:07:55.156762] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-26T17:07:55.441633] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T17:07:55.956753] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-26T17:07:56.224724] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T17:07:56.756688] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-26T17:07:56.852813] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:07:57.449138] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T17:07:57.556724] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-26T17:07:58.356757] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-26T17:07:58.587559] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T17:07:59.047491] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T17:07:59.156729] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-26T17:07:59.956738] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-26T17:08:00.073258] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T17:08:00.756798] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-26T17:08:01.204435] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T17:08:01.556729] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-26T17:08:01.636411] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:08:02.356704] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-26T17:08:02.378185] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T17:08:03.156782] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-26T17:08:03.742703] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T17:08:03.956731] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-26T17:08:03.998515] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:08:04.756780] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-26T17:08:04.819359] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:08:05.556753] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-26T17:08:05.980978] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T17:08:06.356799] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-26T17:08:06.486367] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T17:08:07.104413] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T17:08:07.156740] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-26T17:08:07.956744] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-26T17:08:08.506853] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T17:08:08.512750] [INFO ] [REMOTE ] AIN: Full fetch complete (33250 records). [2025-09-26T17:08:08.512887] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-26T17:08:08.767854] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-26T17:08:08.949738] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-26T17:08:08.949954] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-26T17:08:08.950537] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-26T17:08:08.950722] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-26T17:08:08.952150] [DEBUG] [LOCAL ] AIN: Trimmed 33250 records to 24906 (keeping 200 days of data) [2025-09-26T17:08:09.068403] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T17:08:09.140064] [DEBUG] [LOCAL ] AIN: Primary data saved (24906 records). [2025-09-26T17:08:09.140255] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-26T17:08:09.140377] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIN took 29.6s. Estimated remaining: 4h 42m 56s. Rate: 8.1 symbols/min [2025-09-26T17:08:09.337450] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:09.365906] [DEBUG] [LOCAL ] AIT: Loaded 28128 existing records from primary storage. [2025-09-26T17:08:09.366047] [INFO ] [MAIN ] AIT: Loaded 28128 existing records. [2025-09-26T17:08:09.562167] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-26T17:08:09.582114] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:09.584562] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-26T17:08:09.584639] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-26T17:08:09.585808] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-26T17:08:09.585896] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-26T17:08:09.731012] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T17:08:10.020148] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:10.356735] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-26T17:08:10.560811] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:08:11.156887] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-26T17:08:11.760413] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:08:11.956776] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-26T17:08:12.204237] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:08:12.208726] [INFO ] [REMOTE ] AII: Full fetch complete (10735 records). [2025-09-26T17:08:12.208847] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-26T17:08:12.449915] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 98 unique days, need 200 days [2025-09-26T17:08:12.451384] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:08:12.451674] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:08:12.451754] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-26T17:08:12.451895] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-26T17:08:12.451972] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-26T17:08:12.452044] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-26T17:08:12.452149] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AII took 32.9s. Estimated remaining: 4h 40m 29s. Rate: 8.2 symbols/min [2025-09-26T17:08:12.669114] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:12.741386] [DEBUG] [LOCAL ] AIV: Loaded 40567 existing records from primary storage. [2025-09-26T17:08:12.741561] [INFO ] [MAIN ] AIV: Loaded 40567 existing records. [2025-09-26T17:08:12.761979] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-26T17:08:12.966694] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:12.966975] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-26T17:08:12.967067] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-26T17:08:12.968568] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-26T17:08:12.968639] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-26T17:08:13.373606] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:13.390337] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:08:13.556729] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-26T17:08:13.676313] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T17:08:14.356795] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-26T17:08:14.867789] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T17:08:14.987683] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T17:08:15.156783] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-26T17:08:15.956753] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-26T17:08:16.556943] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:08:16.756748] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-26T17:08:16.885804] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T17:08:17.556753] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-26T17:08:17.921222] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T17:08:18.356728] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-26T17:08:18.497317] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:08:18.877895] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T17:08:19.156718] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-26T17:08:19.956770] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-26T17:08:20.293538] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T17:08:20.296950] [INFO ] [REMOTE ] AIO: Full fetch complete (20055 records). [2025-09-26T17:08:20.297140] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-26T17:08:20.716358] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-26T17:08:20.716455] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-26T17:08:20.716823] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-26T17:08:20.716890] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-26T17:08:20.717677] [DEBUG] [LOCAL ] AIO: Trimmed 20055 records to 13477 (keeping 200 days of data) [2025-09-26T17:08:20.766320] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-26T17:08:20.818222] [DEBUG] [LOCAL ] AIO: Primary data saved (13477 records). [2025-09-26T17:08:20.818377] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-26T17:08:20.818492] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIO took 31.0s. Estimated remaining: 4h 40m 58s. Rate: 8.2 symbols/min [2025-09-26T17:08:21.019152] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:21.042254] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T17:08:21.092049] [DEBUG] [LOCAL ] AIZ: Loaded 30320 existing records from primary storage. [2025-09-26T17:08:21.092220] [INFO ] [MAIN ] AIZ: Loaded 30320 existing records. [2025-09-26T17:08:21.293402] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:21.293934] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-26T17:08:21.294078] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-26T17:08:21.295241] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-26T17:08:21.295307] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-26T17:08:21.564120] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-26T17:08:21.731177] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:22.356750] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-26T17:08:22.497234] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T17:08:22.503840] [INFO ] [REMOTE ] AIR: Full fetch complete (37964 records). [2025-09-26T17:08:22.504009] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-26T17:08:22.505156] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:08:22.505246] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:08:22.505311] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:08:22.505387] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-26T17:08:22.505457] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-09-26T17:08:22.505496] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-09-26T17:08:22.505554] [DEBUG] [LOCAL ] AIR: No derivative data file found to delete. [2025-09-26T17:08:22.505669] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIR took 29.4s. Estimated remaining: 4h 37m 42s. Rate: 8.3 symbols/min [2025-09-26T17:08:22.695991] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:22.712696] [DEBUG] [LOCAL ] AIZN: Loaded 3914 existing records from primary storage. [2025-09-26T17:08:22.713130] [INFO ] [MAIN ] AIZN: Loaded 3914 existing records. [2025-09-26T17:08:22.917183] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:22.917623] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-26T17:08:22.917737] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-26T17:08:22.918140] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-26T17:08:22.918202] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-26T17:08:23.157819] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-26T17:08:23.331728] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:23.354976] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T17:08:23.446993] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T17:08:23.956755] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-26T17:08:24.287950] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:08:24.384442] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T17:08:24.756763] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-26T17:08:25.556747] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-26T17:08:25.779726] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:08:26.356734] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-26T17:08:26.684879] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:08:27.156760] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-26T17:08:27.553266] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T17:08:27.578975] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:08:27.956746] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-26T17:08:28.515573] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T17:08:28.756752] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-26T17:08:29.556731] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-26T17:08:30.232147] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:08:30.356732] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-26T17:08:30.929425] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:08:31.156731] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-26T17:08:31.799333] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:08:31.834476] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T17:08:31.956734] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-26T17:08:32.756735] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-26T17:08:33.123274] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T17:08:33.137723] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T17:08:33.556734] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-26T17:08:34.118758] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T17:08:34.356730] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-26T17:08:34.962520] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T17:08:35.156716] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-26T17:08:35.738630] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T17:08:35.956745] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-26T17:08:36.549351] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T17:08:36.756772] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-26T17:08:37.556725] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-26T17:08:38.356736] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-26T17:08:38.388777] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:08:38.661630] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T17:08:39.156732] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-26T17:08:39.331110] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:08:39.956767] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-26T17:08:40.545449] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T17:08:40.546853] [INFO ] [REMOTE ] AIZN: Full fetch complete (5742 records). [2025-09-26T17:08:40.546931] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-26T17:08:40.763105] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-26T17:08:40.941528] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T17:08:41.021129] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-26T17:08:41.021214] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-26T17:08:41.021395] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-26T17:08:41.021440] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-26T17:08:41.021917] [DEBUG] [LOCAL ] AIZN: Trimmed 5742 records to 3935 (keeping 200 days of data) [2025-09-26T17:08:41.047002] [DEBUG] [LOCAL ] AIZN: Primary data saved (3935 records). [2025-09-26T17:08:41.047178] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-26T17:08:41.047271] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIZN took 18.5s. Estimated remaining: 4h 43m 47s. Rate: 8.1 symbols/min [2025-09-26T17:08:41.234966] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:41.296925] [DEBUG] [LOCAL ] AJG: Loaded 47404 existing records from primary storage. [2025-09-26T17:08:41.297135] [INFO ] [MAIN ] AJG: Loaded 47404 existing records. [2025-09-26T17:08:41.497222] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:41.497494] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-26T17:08:41.497550] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-26T17:08:41.499245] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-26T17:08:41.499312] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-26T17:08:41.569607] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-26T17:08:41.936897] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:42.213074] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T17:08:42.356734] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-26T17:08:43.156721] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-26T17:08:43.231710] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T17:08:43.956707] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-26T17:08:44.154556] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:08:44.222132] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:08:44.756796] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-26T17:08:45.241539] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T17:08:45.251442] [INFO ] [REMOTE ] AIV: Full fetch complete (59432 records). [2025-09-26T17:08:45.251604] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-26T17:08:45.561889] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-26T17:08:45.712453] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-26T17:08:45.712559] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-26T17:08:45.713229] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-26T17:08:45.713320] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-26T17:08:45.715379] [DEBUG] [LOCAL ] AIV: Trimmed 59432 records to 40950 (keeping 200 days of data) [2025-09-26T17:08:45.963044] [DEBUG] [LOCAL ] AIV: Primary data saved (40950 records). [2025-09-26T17:08:45.963183] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-26T17:08:45.964238] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 33.5s. Estimated remaining: 4h 42m 19s. Rate: 8.1 symbols/min [2025-09-26T17:08:46.157445] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:46.157860] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-26T17:08:46.157922] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-26T17:08:46.158070] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-26T17:08:46.158115] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-26T17:08:46.158157] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-26T17:08:46.158190] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-26T17:08:46.362432] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-26T17:08:46.564733] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:46.595285] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T17:08:47.156703] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-26T17:08:47.223144] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:08:47.294140] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:08:47.956750] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-26T17:08:48.374776] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-26T17:08:48.419331] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:08:48.756757] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-26T17:08:49.556748] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-26T17:08:50.356705] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-26T17:08:50.396730] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:08:50.561247] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:08:50.565719] [INFO ] [REMOTE ] AIT: Full fetch complete (39468 records). [2025-09-26T17:08:50.565835] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-26T17:08:50.885961] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:08:50.989261] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-26T17:08:50.989363] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-26T17:08:50.989929] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-26T17:08:50.990003] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-26T17:08:50.991134] [DEBUG] [LOCAL ] AIT: Trimmed 39468 records to 28208 (keeping 200 days of data) [2025-09-26T17:08:51.158572] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-26T17:08:51.192708] [DEBUG] [LOCAL ] AIT: Primary data saved (28208 records). [2025-09-26T17:08:51.192841] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-26T17:08:51.192933] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIT took 42.1s. Estimated remaining: 4h 41m 3s. Rate: 8.2 symbols/min [2025-09-26T17:08:51.373157] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:51.421838] [DEBUG] [LOCAL ] AKR: Loaded 46130 existing records from primary storage. [2025-09-26T17:08:51.422009] [INFO ] [MAIN ] AKR: Loaded 46130 existing records. [2025-09-26T17:08:51.616635] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:51.616989] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-26T17:08:51.617078] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-26T17:08:51.618402] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-26T17:08:51.618465] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-26T17:08:51.970074] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-26T17:08:51.995342] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:52.756770] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-26T17:08:53.078031] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T17:08:53.448798] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T17:08:53.556750] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-26T17:08:54.356817] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-26T17:08:54.566021] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T17:08:54.732145] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:08:55.156748] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-26T17:08:55.956774] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-26T17:08:56.023153] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:08:56.593211] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T17:08:56.756729] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-26T17:08:57.462556] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:08:57.556733] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-26T17:08:58.100744] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T17:08:58.106801] [INFO ] [REMOTE ] AIZ: Full fetch complete (43010 records). [2025-09-26T17:08:58.106937] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-26T17:08:58.361920] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-26T17:08:58.530366] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-26T17:08:58.530525] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-26T17:08:58.531137] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-26T17:08:58.531227] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-26T17:08:58.532546] [DEBUG] [LOCAL ] AIZ: Trimmed 43010 records to 30543 (keeping 200 days of data) [2025-09-26T17:08:58.752202] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T17:08:58.780994] [DEBUG] [LOCAL ] AIZ: Primary data saved (30543 records). [2025-09-26T17:08:58.781136] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-26T17:08:58.781241] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZ took 38.0s. Estimated remaining: 4h 41m 4s. Rate: 8.2 symbols/min [2025-09-26T17:08:58.903314] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-26T17:08:58.979853] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:08:59.027865] [DEBUG] [LOCAL ] AL: Loaded 44455 existing records from primary storage. [2025-09-26T17:08:59.028071] [INFO ] [MAIN ] AL: Loaded 44455 existing records. [2025-09-26T17:08:59.161873] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-26T17:08:59.223125] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:08:59.223422] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-26T17:08:59.223472] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-26T17:08:59.225369] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-26T17:08:59.225487] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-26T17:08:59.605020] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:08:59.956750] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-26T17:09:00.756743] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-26T17:09:00.870156] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T17:09:01.449108] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T17:09:01.556723] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-26T17:09:01.636952] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T17:09:02.356735] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-26T17:09:02.875444] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-26T17:09:02.901580] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:09:03.156712] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-26T17:09:03.956736] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-26T17:09:04.662491] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:09:04.756752] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-26T17:09:05.413243] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:09:05.556725] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-26T17:09:06.210545] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T17:09:06.356755] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-26T17:09:06.629490] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:09:07.156716] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-26T17:09:07.653773] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T17:09:07.956751] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-26T17:09:08.459888] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T17:09:08.756741] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-26T17:09:09.517581] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T17:09:09.556738] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-26T17:09:10.339698] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T17:09:10.356685] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-26T17:09:11.156736] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-26T17:09:11.291404] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T17:09:11.618556] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:09:11.956769] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-26T17:09:12.561295] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T17:09:12.572200] [INFO ] [REMOTE ] AJG: Full fetch complete (69776 records). [2025-09-26T17:09:12.572391] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-26T17:09:12.767908] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-26T17:09:13.013320] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-26T17:09:13.013473] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-26T17:09:13.014261] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-26T17:09:13.014332] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-26T17:09:13.016108] [DEBUG] [LOCAL ] AJG: Trimmed 69776 records to 47710 (keeping 200 days of data) [2025-09-26T17:09:13.330592] [DEBUG] [LOCAL ] AJG: Primary data saved (47710 records). [2025-09-26T17:09:13.330771] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-26T17:09:13.331884] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AJG took 32.3s. Estimated remaining: 4h 44m 40s. Rate: 8.1 symbols/min [2025-09-26T17:09:13.519980] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:13.553770] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T17:09:13.564191] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-26T17:09:13.620667] [DEBUG] [LOCAL ] ALB: Loaded 53612 existing records from primary storage. [2025-09-26T17:09:13.620845] [INFO ] [MAIN ] ALB: Loaded 53612 existing records. [2025-09-26T17:09:13.741810] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T17:09:13.828106] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:13.828420] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-26T17:09:13.828478] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-26T17:09:13.830057] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-26T17:09:13.830120] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-26T17:09:14.219283] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:14.356748] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-26T17:09:14.778560] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-26T17:09:15.120209] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T17:09:15.156687] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-26T17:09:15.788243] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T17:09:15.956745] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-26T17:09:16.235451] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-26T17:09:16.756764] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-26T17:09:17.556736] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-26T17:09:18.356068] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T17:09:18.364844] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-26T17:09:18.367391] [INFO ] [REMOTE ] AKR: Full fetch complete (65494 records). [2025-09-26T17:09:18.367541] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-26T17:09:18.796865] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-26T17:09:18.797059] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-26T17:09:18.798783] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-26T17:09:18.798867] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-26T17:09:18.800438] [DEBUG] [LOCAL ] AKR: Trimmed 65494 records to 46481 (keeping 200 days of data) [2025-09-26T17:09:19.059938] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T17:09:19.120351] [DEBUG] [LOCAL ] AKR: Primary data saved (46481 records). [2025-09-26T17:09:19.120500] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-26T17:09:19.120610] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AKR took 27.9s. Estimated remaining: 4h 43m 43s. Rate: 8.1 symbols/min [2025-09-26T17:09:19.161830] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-26T17:09:19.314682] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:19.314887] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-09-26T17:09:19.314932] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-09-26T17:09:19.315108] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-26T17:09:19.315166] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-26T17:09:19.315236] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-09-26T17:09:19.315274] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-26T17:09:19.711012] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:19.714420] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T17:09:19.715737] [INFO ] [REMOTE ] AKA: Full fetch complete (2428 records). [2025-09-26T17:09:19.715810] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-26T17:09:19.908703] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T17:09:19.908965] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:09:19.909053] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:09:19.909145] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-26T17:09:19.909248] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-26T17:09:19.909315] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-26T17:09:19.909363] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-26T17:09:19.909428] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AKA took 33.9s. Estimated remaining: 4h 40m 15s. Rate: 8.2 symbols/min [2025-09-26T17:09:19.967788] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-26T17:09:20.100498] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:20.150388] [DEBUG] [LOCAL ] ALE: Loaded 30493 existing records from primary storage. [2025-09-26T17:09:20.150557] [INFO ] [MAIN ] ALE: Loaded 30493 existing records. [2025-09-26T17:09:20.345343] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:20.345769] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-26T17:09:20.345905] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-26T17:09:20.346954] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-26T17:09:20.347050] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-26T17:09:20.549535] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-26T17:09:20.761875] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-26T17:09:20.796944] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:21.196639] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T17:09:21.556736] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-26T17:09:22.356734] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-26T17:09:22.655936] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T17:09:22.818979] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:09:23.156727] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-26T17:09:23.767414] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T17:09:23.956746] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-26T17:09:24.009665] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:09:24.756726] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-26T17:09:25.530179] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:09:25.556711] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-26T17:09:26.356718] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-26T17:09:26.580885] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T17:09:26.986799] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:09:27.156717] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-26T17:09:27.202205] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T17:09:27.956738] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-26T17:09:28.691123] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T17:09:28.756715] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-26T17:09:29.276253] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T17:09:29.556733] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-26T17:09:30.133678] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:09:30.356739] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-26T17:09:31.156728] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-26T17:09:31.328432] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T17:09:31.830811] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T17:09:31.843189] [INFO ] [REMOTE ] AL: Full fetch complete (62378 records). [2025-09-26T17:09:31.843454] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-26T17:09:31.961993] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-26T17:09:32.254610] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-26T17:09:32.254746] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-26T17:09:32.255457] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-26T17:09:32.255503] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-26T17:09:32.257408] [DEBUG] [LOCAL ] AL: Trimmed 62378 records to 44831 (keeping 200 days of data) [2025-09-26T17:09:32.546261] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:09:32.615687] [DEBUG] [LOCAL ] AL: Primary data saved (44831 records). [2025-09-26T17:09:32.615891] [INFO ] [MAIN ] AL: Full history saved. [2025-09-26T17:09:32.616018] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AL took 33.8s. Estimated remaining: 4h 42m 48s. Rate: 8.1 symbols/min [2025-09-26T17:09:32.756734] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-26T17:09:33.556733] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-26T17:09:33.914343] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T17:09:34.356712] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-26T17:09:34.492139] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T17:09:34.626828] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T17:09:35.156757] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-26T17:09:35.956719] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-26T17:09:36.128281] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T17:09:36.165462] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T17:09:36.756757] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-26T17:09:37.243137] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:09:37.556753] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-26T17:09:37.675167] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:09:38.356759] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-26T17:09:39.156737] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-26T17:09:39.459066] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T17:09:39.956738] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-26T17:09:40.372271] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T17:09:40.402750] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:09:40.756754] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-26T17:09:41.495750] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:09:41.506796] [INFO ] [REMOTE ] ALC: Full fetch complete (72764 records). [2025-09-26T17:09:41.506972] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-26T17:09:41.574752] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-26T17:09:41.915204] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-26T17:09:41.915315] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-26T17:09:41.916118] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-26T17:09:41.916189] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-26T17:09:41.918139] [DEBUG] [LOCAL ] ALC: Trimmed 72764 records to 51537 (keeping 200 days of data) [2025-09-26T17:09:42.246428] [DEBUG] [LOCAL ] ALC: Primary data saved (51537 records). [2025-09-26T17:09:42.246631] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-26T17:09:42.246808] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALC took 23.1s. Estimated remaining: 4h 43m 46s. Rate: 8.1 symbols/min [2025-09-26T17:09:42.762445] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T17:09:42.775623] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-26T17:09:42.801001] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T17:09:43.156730] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-26T17:09:44.566595] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:09:44.575023] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-26T17:09:44.965394] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-26T17:09:44.978318] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-26T17:09:46.137293] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:09:46.149851] [INFO ] [REMOTE ] ALE: Full fetch complete (42465 records). [2025-09-26T17:09:46.150066] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-26T17:09:46.698242] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-26T17:09:46.698521] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-26T17:09:46.699224] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-26T17:09:46.699376] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-26T17:09:46.700832] [DEBUG] [LOCAL ] ALE: Trimmed 42465 records to 30788 (keeping 200 days of data) [2025-09-26T17:09:46.986760] [DEBUG] [LOCAL ] ALE: Primary data saved (30788 records). [2025-09-26T17:09:46.986970] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-26T17:09:46.991016] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALE took 27.1s. Estimated remaining: 4h 42m 21s. Rate: 8.1 symbols/min [2025-09-26T17:09:47.246312] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-26T17:09:47.257744] [INFO ] [REMOTE ] ALB: Full fetch complete (76789 records). [2025-09-26T17:09:47.257924] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-26T17:09:47.709786] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-26T17:09:47.709914] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-26T17:09:47.710765] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-26T17:09:47.710835] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-26T17:09:47.712567] [DEBUG] [LOCAL ] ALB: Trimmed 76789 records to 54000 (keeping 200 days of data) [2025-09-26T17:09:48.070934] [DEBUG] [LOCAL ] ALB: Primary data saved (54000 records). [2025-09-26T17:09:48.071098] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-26T17:09:48.074906] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALB took 34.7s. Estimated remaining: 4h 39m 13s. Rate: 8.2 symbols/min [2025-09-26T17:09:48.734462] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:48.769554] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:48.852537] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:48.873849] [DEBUG] [LOCAL ] ALG: No existing data file found in primary storage. [2025-09-26T17:09:48.874507] [WARN ] [MAIN ] ALG: No existing data found, performing full refresh instead. [2025-09-26T17:09:48.879895] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:09:48.880541] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-26T17:09:48.881014] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-26T17:09:48.881243] [DEBUG] [LOCAL ] ALG: No primary data file found to delete. [2025-09-26T17:09:48.881306] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-26T17:09:49.206445] [DEBUG] [LOCAL ] ALEX: Loaded 31536 existing records from primary storage. [2025-09-26T17:09:49.268045] [DEBUG] [LOCAL ] ALIT: Loaded 53147 existing records from primary storage. [2025-09-26T17:09:49.274245] [DEBUG] [LOCAL ] ALK: Loaded 53452 existing records from primary storage. [2025-09-26T17:09:49.273336] [INFO ] [MAIN ] ALEX: Loaded 31536 existing records. [2025-09-26T17:09:49.274632] [INFO ] [MAIN ] ALK: Loaded 53452 existing records. [2025-09-26T17:09:49.274506] [INFO ] [MAIN ] ALIT: Loaded 53147 existing records. [2025-09-26T17:09:49.703358] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:49.728613] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-26T17:09:49.981981] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:49.990949] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:49.991309] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-26T17:09:49.991159] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:09:49.991995] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-26T17:09:49.991548] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-26T17:09:49.992260] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-26T17:09:49.992323] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-26T17:09:49.992490] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-26T17:09:49.993673] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-26T17:09:49.993713] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-26T17:09:49.993861] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-26T17:09:49.993922] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-26T17:09:49.999184] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-26T17:09:50.071377] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-26T17:09:51.063975] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T17:09:51.095401] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:51.142558] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-26T17:09:51.122411] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-26T17:09:51.227223] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:51.233861] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:09:51.234367] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-26T17:09:51.234930] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-26T17:09:52.075921] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:09:52.079229] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-26T17:09:52.414959] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T17:09:52.422353] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-26T17:09:52.612570] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:09:52.629628] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-26T17:09:52.669060] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T17:09:52.680867] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-26T17:09:52.690261] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T17:09:52.756715] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-26T17:09:53.322225] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:09:53.556736] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-26T17:09:53.821467] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:09:54.281279] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T17:09:54.307284] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T17:09:54.342917] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T17:09:54.356669] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-26T17:09:55.156735] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-26T17:09:55.956707] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-26T17:09:55.989707] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:09:56.100569] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T17:09:56.756744] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-26T17:09:56.962911] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T17:09:57.556750] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-26T17:09:58.130507] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T17:09:58.169065] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T17:09:58.356723] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-26T17:09:59.156721] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-26T17:09:59.370372] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T17:09:59.956775] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-26T17:10:00.756710] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-26T17:10:01.020534] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T17:10:01.214054] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T17:10:01.556739] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-26T17:10:01.912673] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T17:10:02.356736] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-26T17:10:02.707256] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T17:10:03.156712] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-26T17:10:03.719881] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T17:10:03.956707] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-26T17:10:04.025666] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T17:10:04.756743] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-26T17:10:05.569391] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-26T17:10:05.575782] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T17:10:05.645420] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T17:10:06.241357] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-26T17:10:06.244187] [INFO ] [REMOTE ] ALG: Full fetch complete (15901 records). [2025-09-26T17:10:06.244271] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-26T17:10:06.360506] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-26T17:10:06.656393] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-26T17:10:06.656490] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-26T17:10:06.656884] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-26T17:10:06.656955] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-26T17:10:06.657806] [DEBUG] [LOCAL ] ALG: Trimmed 15901 records to 10562 (keeping 200 days of data) [2025-09-26T17:10:06.726900] [DEBUG] [LOCAL ] ALG: Primary data saved (10562 records). [2025-09-26T17:10:06.727091] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-26T17:10:06.727183] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 18.6s. Estimated remaining: 4h 44m 26s. Rate: 8.1 symbols/min [2025-09-26T17:10:06.908974] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:06.963392] [DEBUG] [LOCAL ] ALL: Loaded 50565 existing records from primary storage. [2025-09-26T17:10:06.963572] [INFO ] [MAIN ] ALL: Loaded 50565 existing records. [2025-09-26T17:10:07.156752] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-26T17:10:07.156627] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:07.158281] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-26T17:10:07.158677] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-26T17:10:07.160258] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-26T17:10:07.160371] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-26T17:10:07.540094] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:07.956714] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-26T17:10:08.191809] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T17:10:08.667163] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:10:08.756787] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-26T17:10:08.984754] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T17:10:09.556730] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-26T17:10:10.358886] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-26T17:10:10.367727] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T17:10:11.156721] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-26T17:10:11.319348] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:10:11.623436] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T17:10:11.956766] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-26T17:10:12.756717] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-26T17:10:12.854409] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:10:13.396214] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T17:10:13.556737] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-26T17:10:14.356773] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-26T17:10:14.641891] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T17:10:15.014512] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:10:15.156715] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-26T17:10:15.956702] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-26T17:10:16.230863] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T17:10:16.541595] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T17:10:16.549062] [INFO ] [REMOTE ] ALEX: Full fetch complete (44646 records). [2025-09-26T17:10:16.549213] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-26T17:10:16.761851] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-26T17:10:16.962665] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-26T17:10:16.962774] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-26T17:10:16.963366] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-26T17:10:16.963519] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-26T17:10:16.964983] [DEBUG] [LOCAL ] ALEX: Trimmed 44646 records to 31769 (keeping 200 days of data) [2025-09-26T17:10:17.190961] [DEBUG] [LOCAL ] ALEX: Primary data saved (31769 records). [2025-09-26T17:10:17.191320] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-26T17:10:17.191808] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 29.1s. Estimated remaining: 4h 45m 43s. Rate: 8.0 symbols/min [2025-09-26T17:10:17.385084] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:17.447478] [DEBUG] [LOCAL ] ALLE: Loaded 45377 existing records from primary storage. [2025-09-26T17:10:17.447687] [INFO ] [MAIN ] ALLE: Loaded 45377 existing records. [2025-09-26T17:10:17.559276] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-26T17:10:17.730318] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:17.730799] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-26T17:10:17.730906] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-26T17:10:17.732957] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-26T17:10:17.733038] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-26T17:10:17.919015] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-26T17:10:18.187312] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:18.279570] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:10:18.356767] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-26T17:10:19.141351] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:10:19.156722] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-26T17:10:19.846150] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T17:10:19.857764] [INFO ] [REMOTE ] ALIT: Full fetch complete (76414 records). [2025-09-26T17:10:19.857987] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-26T17:10:19.961884] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-26T17:10:20.319556] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-26T17:10:20.319961] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-26T17:10:20.320881] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-26T17:10:20.320952] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-26T17:10:20.322693] [DEBUG] [LOCAL ] ALIT: Trimmed 76414 records to 53534 (keeping 200 days of data) [2025-09-26T17:10:20.651752] [DEBUG] [LOCAL ] ALIT: Primary data saved (53534 records). [2025-09-26T17:10:20.651908] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-26T17:10:20.652000] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALIT took 32.6s. Estimated remaining: 4h 43m 44s. Rate: 8.1 symbols/min [2025-09-26T17:10:20.765413] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-26T17:10:20.852585] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:20.911370] [DEBUG] [LOCAL ] ALLY: Loaded 53608 existing records from primary storage. [2025-09-26T17:10:20.911597] [INFO ] [MAIN ] ALLY: Loaded 53608 existing records. [2025-09-26T17:10:21.111943] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:21.112277] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-26T17:10:21.112329] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-26T17:10:21.114288] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-26T17:10:21.114364] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-26T17:10:21.533399] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:21.564305] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-26T17:10:21.570059] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:10:21.586783] [INFO ] [REMOTE ] ALK: Full fetch complete (76838 records). [2025-09-26T17:10:21.587535] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-26T17:10:22.015228] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-26T17:10:22.015337] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-26T17:10:22.016257] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-26T17:10:22.016339] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-26T17:10:22.018440] [DEBUG] [LOCAL ] ALK: Trimmed 76838 records to 53840 (keeping 200 days of data) [2025-09-26T17:10:22.384109] [DEBUG] [LOCAL ] ALK: Primary data saved (53840 records). [2025-09-26T17:10:22.384421] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-26T17:10:22.386360] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALK took 34.3s. Estimated remaining: 4h 41m 2s. Rate: 8.1 symbols/min [2025-09-26T17:10:22.596452] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:22.624793] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (3.47 seconds). [2025-09-26T17:10:22.634802] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-26T17:10:22.677905] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T17:10:22.727380] [DEBUG] [LOCAL ] ALSN: Loaded 43608 existing records from primary storage. [2025-09-26T17:10:22.727532] [INFO ] [MAIN ] ALSN: Loaded 43608 existing records. [2025-09-26T17:10:22.979339] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:22.979801] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-26T17:10:22.979881] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-26T17:10:22.981135] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-26T17:10:22.981210] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-26T17:10:23.176572] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-26T17:10:23.347815] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T17:10:23.446878] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:23.921382] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T17:10:23.956716] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-26T17:10:24.756731] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-26T17:10:25.099930] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T17:10:25.516130] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T17:10:25.556687] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-26T17:10:26.126525] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T17:10:26.356741] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-26T17:10:26.918313] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T17:10:27.156714] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-26T17:10:27.956720] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-26T17:10:28.109594] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T17:10:28.636205] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T17:10:28.756740] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-26T17:10:29.351686] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T17:10:29.556729] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-26T17:10:30.356730] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-26T17:10:30.535467] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T17:10:31.003436] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T17:10:31.156701] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-26T17:10:31.956731] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-26T17:10:31.985939] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T17:10:32.756693] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-26T17:10:32.956511] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T17:10:33.539718] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T17:10:33.556702] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-26T17:10:33.996180] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:10:34.356772] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-26T17:10:34.856002] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T17:10:35.156772] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-26T17:10:35.642100] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:10:35.956750] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-26T17:10:36.398118] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:10:36.756788] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-26T17:10:37.475704] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:10:37.556731] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-26T17:10:37.994126] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T17:10:38.356749] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-26T17:10:39.029072] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:10:39.156785] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-26T17:10:39.674665] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:10:39.684529] [INFO ] [REMOTE ] ALLE: Full fetch complete (64880 records). [2025-09-26T17:10:39.684773] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-26T17:10:39.965004] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-26T17:10:40.218451] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-26T17:10:40.218592] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-26T17:10:40.219593] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-26T17:10:40.219700] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-26T17:10:40.222245] [DEBUG] [LOCAL ] ALLE: Trimmed 64880 records to 45637 (keeping 200 days of data) [2025-09-26T17:10:40.529513] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T17:10:40.601180] [DEBUG] [LOCAL ] ALLE: Primary data saved (45637 records). [2025-09-26T17:10:40.601363] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-26T17:10:40.601465] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALLE took 23.4s. Estimated remaining: 4h 45m 46s. Rate: 8.0 symbols/min [2025-09-26T17:10:40.764788] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-26T17:10:40.798378] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:40.823800] [DEBUG] [LOCAL ] ALTG: Loaded 24032 existing records from primary storage. [2025-09-26T17:10:40.823942] [INFO ] [MAIN ] ALTG: Loaded 24032 existing records. [2025-09-26T17:10:41.032530] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:41.032868] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-26T17:10:41.032919] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-26T17:10:41.033697] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-26T17:10:41.033760] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-26T17:10:41.460603] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:41.556793] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-26T17:10:41.647124] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T17:10:42.343086] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:10:42.356979] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-26T17:10:42.743059] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T17:10:43.156754] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-26T17:10:43.945123] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:10:43.956817] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-26T17:10:44.679761] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:10:44.756788] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-26T17:10:45.170889] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T17:10:45.556737] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-26T17:10:46.356709] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-26T17:10:46.391883] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:10:46.403035] [INFO ] [REMOTE ] ALL: Full fetch complete (72523 records). [2025-09-26T17:10:46.403200] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-26T17:10:46.885740] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-26T17:10:46.886022] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-26T17:10:46.886943] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-26T17:10:46.887361] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-26T17:10:46.889612] [DEBUG] [LOCAL ] ALL: Trimmed 72523 records to 50903 (keeping 200 days of data) [2025-09-26T17:10:47.014377] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T17:10:47.047342] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T17:10:47.158141] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-26T17:10:47.311431] [DEBUG] [LOCAL ] ALL: Primary data saved (50903 records). [2025-09-26T17:10:47.311716] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-26T17:10:47.313890] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALL took 40.6s. Estimated remaining: 4h 45m 17s. Rate: 8.0 symbols/min [2025-09-26T17:10:47.534345] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:47.551262] [DEBUG] [LOCAL ] ALUR: Loaded 10913 existing records from primary storage. [2025-09-26T17:10:47.551447] [INFO ] [MAIN ] ALUR: Loaded 10913 existing records. [2025-09-26T17:10:47.754519] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:47.754826] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-26T17:10:47.754885] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-26T17:10:47.755828] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-26T17:10:47.755893] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-26T17:10:47.966571] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-26T17:10:48.145677] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:48.756709] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-26T17:10:48.912393] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T17:10:49.253782] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T17:10:49.265497] [INFO ] [REMOTE ] ALLY: Full fetch complete (76895 records). [2025-09-26T17:10:49.265715] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-26T17:10:49.561906] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-26T17:10:49.710305] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-26T17:10:49.710407] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-26T17:10:49.711224] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-26T17:10:49.711296] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-26T17:10:49.714575] [DEBUG] [LOCAL ] ALLY: Trimmed 76895 records to 53997 (keeping 200 days of data) [2025-09-26T17:10:50.087183] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:10:50.115063] [DEBUG] [LOCAL ] ALLY: Primary data saved (53997 records). [2025-09-26T17:10:50.115219] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-26T17:10:50.116464] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 29.5s. Estimated remaining: 4h 43m 7s. Rate: 8.1 symbols/min [2025-09-26T17:10:50.309987] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:10:50.359288] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-26T17:10:50.361569] [DEBUG] [LOCAL ] ALV: Loaded 42904 existing records from primary storage. [2025-09-26T17:10:50.361688] [INFO ] [MAIN ] ALV: Loaded 42904 existing records. [2025-09-26T17:10:50.579539] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:10:50.580115] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-26T17:10:50.580282] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-26T17:10:50.587718] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-26T17:10:50.601253] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T17:10:50.600271] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-26T17:10:51.066306] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:10:51.156751] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-26T17:10:51.874031] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:10:51.956777] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-26T17:10:52.756725] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-26T17:10:52.844767] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T17:10:53.173385] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T17:10:53.556738] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-26T17:10:53.583693] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T17:10:54.356778] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-26T17:10:55.158723] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-26T17:10:55.165352] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T17:10:55.211896] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T17:10:55.956726] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-26T17:10:56.152984] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T17:10:56.756727] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-26T17:10:56.903154] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:10:57.556761] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-26T17:10:57.846346] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T17:10:58.048806] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T17:10:58.356763] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-26T17:10:59.156742] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-26T17:10:59.511118] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T17:10:59.914626] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T17:10:59.956754] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-26T17:11:00.756782] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-26T17:11:01.410560] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T17:11:01.556734] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-26T17:11:01.666572] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T17:11:02.356749] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-26T17:11:03.122585] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:11:03.151174] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T17:11:03.157359] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-26T17:11:03.956760] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-26T17:11:04.756780] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-26T17:11:04.939050] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T17:11:05.556731] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-26T17:11:05.749686] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T17:11:05.760563] [INFO ] [REMOTE ] ALSN: Full fetch complete (62130 records). [2025-09-26T17:11:05.760937] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-26T17:11:05.903556] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T17:11:06.260400] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-26T17:11:06.260832] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-26T17:11:06.261592] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-26T17:11:06.261717] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-26T17:11:06.275908] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T17:11:06.285559] [DEBUG] [LOCAL ] ALSN: Trimmed 62130 records to 43953 (keeping 200 days of data) [2025-09-26T17:11:06.359167] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-26T17:11:06.578417] [DEBUG] [LOCAL ] ALSN: Primary data saved (43953 records). [2025-09-26T17:11:06.578584] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-26T17:11:06.578713] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALSN took 44.2s. Estimated remaining: 4h 46m 54s. Rate: 8.0 symbols/min [2025-09-26T17:11:06.763715] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:06.771554] [DEBUG] [LOCAL ] ALX: Loaded 6059 existing records from primary storage. [2025-09-26T17:11:06.771662] [INFO ] [MAIN ] ALX: Loaded 6059 existing records. [2025-09-26T17:11:06.964458] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:06.964752] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-26T17:11:06.964808] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-26T17:11:06.965111] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-26T17:11:06.965171] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-26T17:11:07.161781] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-26T17:11:07.367380] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:07.385416] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T17:11:07.391467] [INFO ] [REMOTE ] ALTG: Full fetch complete (33723 records). [2025-09-26T17:11:07.391693] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-26T17:11:07.805140] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-26T17:11:07.805228] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-26T17:11:07.805671] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-26T17:11:07.805739] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-26T17:11:07.806699] [DEBUG] [LOCAL ] ALTG: Trimmed 33723 records to 24161 (keeping 200 days of data) [2025-09-26T17:11:07.956848] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-26T17:11:07.962936] [DEBUG] [LOCAL ] ALTG: Primary data saved (24161 records). [2025-09-26T17:11:07.963154] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-26T17:11:07.963315] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 27.4s. Estimated remaining: 4h 44m 8s. Rate: 8.0 symbols/min [2025-09-26T17:11:08.145348] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:08.198391] [DEBUG] [LOCAL ] AM: Loaded 52519 existing records from primary storage. [2025-09-26T17:11:08.198569] [INFO ] [MAIN ] AM: Loaded 52519 existing records. [2025-09-26T17:11:08.385034] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:08.385331] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-26T17:11:08.385381] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-26T17:11:08.386941] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-26T17:11:08.387004] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-26T17:11:08.630628] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-26T17:11:08.760989] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-26T17:11:08.807702] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:08.840621] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T17:11:09.472854] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T17:11:09.556734] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-26T17:11:10.151477] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T17:11:10.356811] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-26T17:11:10.881926] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:11:11.156760] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-26T17:11:11.712910] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T17:11:11.956785] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-26T17:11:12.756783] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-26T17:11:13.556911] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-26T17:11:13.772669] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T17:11:13.844514] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:11:14.356740] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-26T17:11:14.496090] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T17:11:14.498232] [INFO ] [REMOTE ] ALUR: Full fetch complete (20607 records). [2025-09-26T17:11:14.498310] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-26T17:11:14.901594] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-26T17:11:14.901390] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T17:11:14.901870] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-26T17:11:14.904036] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-26T17:11:14.904115] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-26T17:11:14.905063] [DEBUG] [LOCAL ] ALUR: Trimmed 20607 records to 10950 (keeping 200 days of data) [2025-09-26T17:11:14.973252] [DEBUG] [LOCAL ] ALUR: Primary data saved (10950 records). [2025-09-26T17:11:14.973475] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-26T17:11:14.973590] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 27.7s. Estimated remaining: 4h 43m 49s. Rate: 8.0 symbols/min [2025-09-26T17:11:15.158472] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:15.158611] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-26T17:11:15.201692] [DEBUG] [LOCAL ] AMBC: Loaded 37246 existing records from primary storage. [2025-09-26T17:11:15.201920] [INFO ] [MAIN ] AMBC: Loaded 37246 existing records. [2025-09-26T17:11:15.410529] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:15.411065] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-26T17:11:15.411196] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-26T17:11:15.412353] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-26T17:11:15.412419] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-26T17:11:15.741884] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:11:15.823814] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:15.956785] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-26T17:11:16.756774] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-26T17:11:17.556716] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-26T17:11:17.574882] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T17:11:17.615825] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:11:18.356741] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-26T17:11:18.735199] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T17:11:18.825627] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T17:11:19.156761] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-26T17:11:19.956770] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-26T17:11:20.756980] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-26T17:11:20.812874] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:11:20.834061] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:11:21.556767] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-26T17:11:22.158330] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:11:22.356735] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-26T17:11:22.665744] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T17:11:23.156772] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-26T17:11:23.682593] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T17:11:23.956755] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-26T17:11:24.756756] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-26T17:11:24.810429] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:11:24.819667] [INFO ] [REMOTE ] ALV: Full fetch complete (61846 records). [2025-09-26T17:11:24.819919] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-26T17:11:25.276206] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-26T17:11:25.276342] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-26T17:11:25.277276] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-26T17:11:25.277390] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-26T17:11:25.305131] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T17:11:25.312882] [DEBUG] [LOCAL ] ALV: Trimmed 61846 records to 43217 (keeping 200 days of data) [2025-09-26T17:11:25.556990] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-26T17:11:25.613258] [DEBUG] [LOCAL ] ALV: Primary data saved (43217 records). [2025-09-26T17:11:25.613440] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-26T17:11:25.613633] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALV took 35.5s. Estimated remaining: 4h 45m 1s. Rate: 8.0 symbols/min [2025-09-26T17:11:25.741576] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T17:11:25.770851] [INFO ] [REMOTE ] ALX: Full fetch complete (6972 records). [2025-09-26T17:11:25.799437] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-26T17:11:25.830523] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:26.249104] [DEBUG] [LOCAL ] AMBP: Loaded 45578 existing records from primary storage. [2025-09-26T17:11:26.272904] [INFO ] [MAIN ] AMBP: Loaded 45578 existing records. [2025-09-26T17:11:26.307933] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-26T17:11:26.344267] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-26T17:11:26.367324] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-26T17:11:26.374450] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-26T17:11:26.361462] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-26T17:11:26.389442] [DEBUG] [LOCAL ] ALX: Trimmed 6972 records to 6121 (keeping 200 days of data) [2025-09-26T17:11:26.513679] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:26.527076] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-26T17:11:26.530768] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-26T17:11:26.533116] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-26T17:11:26.533337] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-26T17:11:26.595164] [DEBUG] [LOCAL ] ALX: Primary data saved (6121 records). [2025-09-26T17:11:26.614968] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-26T17:11:26.620409] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALX took 20.0s. Estimated remaining: 4h 42m 13s. Rate: 8.1 symbols/min [2025-09-26T17:11:26.961491] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T17:11:27.134847] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:27.161960] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-26T17:11:27.162107] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-26T17:11:27.168493] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-26T17:11:27.256381] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-26T17:11:27.274983] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:27.275364] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-26T17:11:27.275858] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-26T17:11:27.275921] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-26T17:11:27.704323] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:27.956735] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-26T17:11:28.212942] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:28.226187] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-26T17:11:28.255513] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T17:11:28.495614] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:11:28.756751] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-26T17:11:29.556741] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-26T17:11:30.288231] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:11:30.356774] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-26T17:11:31.156732] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-26T17:11:31.380439] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:31.384431] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-26T17:11:31.387942] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T17:11:31.861424] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T17:11:31.956743] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-26T17:11:32.161256] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:32.161695] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-26T17:11:32.756738] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-26T17:11:33.556724] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-26T17:11:33.753882] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:33.754207] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-26T17:11:34.356731] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-26T17:11:34.580200] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:34.602839] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-26T17:11:34.606137] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:11:35.156795] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-26T17:11:35.956786] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-26T17:11:36.158720] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:36.159083] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-26T17:11:36.756764] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-26T17:11:36.824227] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:11:37.556724] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-26T17:11:38.356744] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-26T17:11:38.583699] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:11:38.596243] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:11:38.596534] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-26T17:11:39.145872] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T17:11:39.156816] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-26T17:11:39.956739] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-26T17:11:40.739903] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:11:40.756686] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-26T17:11:41.014747] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T17:11:41.556765] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-26T17:11:42.356784] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-26T17:11:42.496130] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T17:11:42.795971] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T17:11:43.156786] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-26T17:11:43.432031] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T17:11:43.956778] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-26T17:11:44.448590] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:11:44.756777] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-26T17:11:45.236405] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T17:11:45.556742] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-26T17:11:45.763497] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:11:45.775478] [INFO ] [REMOTE ] AM: Full fetch complete (75601 records). [2025-09-26T17:11:45.775755] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-26T17:11:46.206802] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-26T17:11:46.206908] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-26T17:11:46.207897] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-26T17:11:46.207972] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-26T17:11:46.209746] [DEBUG] [LOCAL ] AM: Trimmed 75601 records to 52887 (keeping 200 days of data) [2025-09-26T17:11:46.382628] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-26T17:11:46.531612] [DEBUG] [LOCAL ] AM: Primary data saved (52887 records). [2025-09-26T17:11:46.531807] [INFO ] [MAIN ] AM: Full history saved. [2025-09-26T17:11:46.531905] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AM took 38.6s. Estimated remaining: 4h 47m 11s. Rate: 7.9 symbols/min [2025-09-26T17:11:46.712086] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:46.712318] [DEBUG] [LOCAL ] AMC: No existing data file found in primary storage. [2025-09-26T17:11:46.712371] [WARN ] [MAIN ] AMC: No existing data found, performing full refresh instead. [2025-09-26T17:11:46.712517] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-26T17:11:46.712562] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-26T17:11:46.712611] [DEBUG] [LOCAL ] AMC: No primary data file found to delete. [2025-09-26T17:11:46.712677] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-26T17:11:47.134896] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:47.161467] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-26T17:11:47.168705] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T17:11:47.440345] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T17:11:47.956759] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-26T17:11:48.756755] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-26T17:11:49.221294] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T17:11:49.226470] [INFO ] [REMOTE ] AMBQ: Full fetch complete (8187 records). [2025-09-26T17:11:49.226565] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-26T17:11:49.439271] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 42 unique days, need 200 days [2025-09-26T17:11:49.439681] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:11:49.439757] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:11:49.439807] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-26T17:11:49.439882] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-26T17:11:49.439977] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-26T17:11:49.440033] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-26T17:11:49.440098] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBQ took 22.8s. Estimated remaining: 4h 45m 11s. Rate: 8.0 symbols/min [2025-09-26T17:11:49.561811] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-26T17:11:49.626240] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:49.683410] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-09-26T17:11:49.683567] [INFO ] [MAIN ] AMCR: Loaded 54059 existing records. [2025-09-26T17:11:49.878252] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:49.906102] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-26T17:11:49.909722] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-26T17:11:49.911578] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-26T17:11:49.915666] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-26T17:11:49.923080] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-26T17:11:50.342226] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:50.345265] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T17:11:50.356681] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-26T17:11:51.076233] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T17:11:51.156772] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-26T17:11:51.282275] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:11:51.956812] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-26T17:11:52.756717] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-26T17:11:52.835761] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T17:11:52.889757] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T17:11:52.896666] [INFO ] [REMOTE ] AMBC: Full fetch complete (51087 records). [2025-09-26T17:11:52.896846] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-26T17:11:53.314526] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-26T17:11:53.314626] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-26T17:11:53.315273] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-26T17:11:53.315344] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-26T17:11:53.316682] [DEBUG] [LOCAL ] AMBC: Trimmed 51087 records to 37453 (keeping 200 days of data) [2025-09-26T17:11:53.528621] [DEBUG] [LOCAL ] AMBC: Primary data saved (37453 records). [2025-09-26T17:11:53.528794] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-26T17:11:53.528882] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AMBC took 38.6s. Estimated remaining: 4h 43m 41s. Rate: 8.0 symbols/min [2025-09-26T17:11:53.569472] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-26T17:11:53.734255] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:11:53.789246] [DEBUG] [LOCAL ] AME: Loaded 48905 existing records from primary storage. [2025-09-26T17:11:53.789431] [INFO ] [MAIN ] AME: Loaded 48905 existing records. [2025-09-26T17:11:53.991009] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:11:53.991275] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-26T17:11:53.991324] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-26T17:11:53.992913] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-26T17:11:53.992976] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-26T17:11:54.364082] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-26T17:11:54.389024] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:11:54.807575] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-26T17:11:54.869365] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:11:55.156755] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-26T17:11:55.674435] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T17:11:55.956765] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-26T17:11:56.756754] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-26T17:11:57.412015] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-26T17:11:57.556734] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-26T17:11:57.734891] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T17:11:58.255148] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T17:11:58.356774] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-26T17:11:58.742899] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T17:11:59.156747] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-26T17:11:59.793414] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T17:11:59.956774] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-26T17:12:00.756788] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-26T17:12:01.267099] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-26T17:12:01.350230] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T17:12:01.359799] [INFO ] [REMOTE ] AMBP: Full fetch complete (65848 records). [2025-09-26T17:12:01.359985] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-26T17:12:01.570821] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-26T17:12:01.843851] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-26T17:12:01.843956] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-26T17:12:01.844733] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-26T17:12:01.844835] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-26T17:12:01.846362] [DEBUG] [LOCAL ] AMBP: Trimmed 65848 records to 45863 (keeping 200 days of data) [2025-09-26T17:12:02.127827] [DEBUG] [LOCAL ] AMBP: Primary data saved (45863 records). [2025-09-26T17:12:02.128030] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-26T17:12:02.128177] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBP took 36.5s. Estimated remaining: 4h 44m 0s. Rate: 8.0 symbols/min [2025-09-26T17:12:02.330924] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:02.364587] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-26T17:12:02.371739] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T17:12:02.400493] [DEBUG] [LOCAL ] AMG: Loaded 20906 existing records from primary storage. [2025-09-26T17:12:02.400676] [INFO ] [MAIN ] AMG: Loaded 20906 existing records. [2025-09-26T17:12:02.600099] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:02.600405] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-26T17:12:02.600456] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-26T17:12:02.601135] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-26T17:12:02.601199] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-26T17:12:02.980944] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:03.156747] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-26T17:12:03.762815] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-26T17:12:03.956757] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-26T17:12:04.191084] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:12:04.212279] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T17:12:04.756741] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-26T17:12:05.556730] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-26T17:12:06.133175] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-26T17:12:06.364067] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-26T17:12:06.370222] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T17:12:06.776574] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:12:07.156773] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-26T17:12:07.700304] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:12:07.956736] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-26T17:12:08.756710] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-26T17:12:08.883603] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T17:12:09.556727] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-26T17:12:09.942861] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T17:12:10.269296] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T17:12:10.366770] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-26T17:12:10.387548] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:12:11.156749] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-26T17:12:11.956699] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-26T17:12:12.352810] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T17:12:12.756730] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-26T17:12:12.991634] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-26T17:12:13.512675] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T17:12:13.556722] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-26T17:12:14.217479] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:12:14.356745] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-26T17:12:15.156772] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-26T17:12:15.645750] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T17:12:15.956747] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-26T17:12:16.080217] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T17:12:16.756728] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-26T17:12:16.951813] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T17:12:17.148283] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T17:12:17.556729] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-26T17:12:18.356697] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-26T17:12:18.450758] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:12:19.156725] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-26T17:12:19.732007] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-26T17:12:19.743440] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-26T17:12:19.743631] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-26T17:12:19.964363] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-26T17:12:20.180249] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-26T17:12:20.180344] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-26T17:12:20.181154] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-26T17:12:20.181227] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-26T17:12:20.182841] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 54539 (keeping 200 days of data) [2025-09-26T17:12:20.411404] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T17:12:20.432589] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-26T17:12:20.433586] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-26T17:12:20.984074] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-26T17:12:20.984290] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-26T17:12:21.012496] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-26T17:12:21.014128] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-26T17:12:21.025106] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 54449 (keeping 200 days of data) [2025-09-26T17:12:21.046574] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T17:12:21.056532] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-26T17:12:21.206694] [DEBUG] [LOCAL ] AMC: Primary data saved (54539 records). [2025-09-26T17:12:21.208231] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-26T17:12:21.211215] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 34.7s. Estimated remaining: 4h 48m 24s. Rate: 7.9 symbols/min [2025-09-26T17:12:21.210970] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T17:12:21.426290] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:21.493486] [DEBUG] [LOCAL ] AMH: Loaded 52080 existing records from primary storage. [2025-09-26T17:12:21.575981] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-26T17:12:21.580747] [INFO ] [MAIN ] AMH: Loaded 52080 existing records. [2025-09-26T17:12:21.906669] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:21.912445] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-26T17:12:21.912552] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-26T17:12:21.970731] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-26T17:12:21.971195] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-26T17:12:22.354501] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T17:12:22.381001] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-09-26T17:12:22.387715] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-26T17:12:22.408792] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-26T17:12:22.412264] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMCR took 33.0s. Estimated remaining: 4h 45m 48s. Rate: 8.0 symbols/min [2025-09-26T17:12:22.475338] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:22.659556] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:22.704726] [DEBUG] [LOCAL ] AMN: Loaded 42296 existing records from primary storage. [2025-09-26T17:12:22.704893] [INFO ] [MAIN ] AMN: Loaded 42296 existing records. [2025-09-26T17:12:22.902065] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:22.902545] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-26T17:12:22.902753] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-26T17:12:22.904320] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-26T17:12:22.904386] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-26T17:12:23.138728] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T17:12:23.172548] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-26T17:12:23.366006] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:23.387022] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T17:12:23.956751] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-26T17:12:24.756713] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-26T17:12:24.840091] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:12:25.094847] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T17:12:25.556730] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-26T17:12:26.205914] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T17:12:26.216517] [INFO ] [REMOTE ] AME: Full fetch complete (69806 records). [2025-09-26T17:12:26.216722] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-26T17:12:26.361795] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-26T17:12:26.655003] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-26T17:12:26.655103] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-26T17:12:26.655877] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-26T17:12:26.655958] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-26T17:12:26.657720] [DEBUG] [LOCAL ] AME: Trimmed 69806 records to 49252 (keeping 200 days of data) [2025-09-26T17:12:26.969661] [DEBUG] [LOCAL ] AME: Primary data saved (49252 records). [2025-09-26T17:12:26.969819] [INFO ] [MAIN ] AME: Full history saved. [2025-09-26T17:12:26.971181] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AME took 33.4s. Estimated remaining: 4h 44m 32s. Rate: 8.0 symbols/min [2025-09-26T17:12:27.163167] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-26T17:12:27.167458] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:27.206086] [DEBUG] [LOCAL ] AMP: Loaded 32671 existing records from primary storage. [2025-09-26T17:12:27.206235] [INFO ] [MAIN ] AMP: Loaded 32671 existing records. [2025-09-26T17:12:27.407056] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:27.417117] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-26T17:12:27.431786] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-26T17:12:27.437395] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T17:12:27.437470] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-26T17:12:27.448144] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-26T17:12:27.691117] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:12:27.863042] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:27.956747] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-26T17:12:28.312740] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T17:12:28.756775] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-26T17:12:29.556706] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-26T17:12:29.589630] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:12:30.196004] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T17:12:30.356748] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-26T17:12:30.424440] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T17:12:30.429304] [INFO ] [REMOTE ] AMG: Full fetch complete (29862 records). [2025-09-26T17:12:30.429446] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-26T17:12:30.839309] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-26T17:12:30.839458] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-26T17:12:30.839882] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-26T17:12:30.839947] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-26T17:12:30.840849] [DEBUG] [LOCAL ] AMG: Trimmed 29862 records to 21046 (keeping 200 days of data) [2025-09-26T17:12:30.979208] [DEBUG] [LOCAL ] AMG: Primary data saved (21046 records). [2025-09-26T17:12:30.979354] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-26T17:12:30.979439] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AMG took 28.9s. Estimated remaining: 4h 43m 5s. Rate: 8.0 symbols/min [2025-09-26T17:12:31.161257] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-26T17:12:31.188790] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:31.189016] [DEBUG] [LOCAL ] AMPX: No existing data file found in primary storage. [2025-09-26T17:12:31.189082] [WARN ] [MAIN ] AMPX: No existing data found, performing full refresh instead. [2025-09-26T17:12:31.189550] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-26T17:12:31.189610] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-26T17:12:31.189731] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-09-26T17:12:31.189835] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-26T17:12:31.590964] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:31.622404] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:12:31.956746] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-26T17:12:32.672299] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:12:32.756733] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-26T17:12:33.041500] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T17:12:33.556770] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-26T17:12:34.262623] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:12:34.356753] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-26T17:12:35.141348] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T17:12:35.156698] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-26T17:12:35.956766] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-26T17:12:36.012355] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T17:12:36.756713] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-26T17:12:37.101822] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-26T17:12:37.469548] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:12:37.556728] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-26T17:12:37.933197] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T17:12:38.356937] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-26T17:12:38.927420] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:12:39.156753] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-26T17:12:39.616861] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T17:12:39.956763] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-26T17:12:40.760917] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-26T17:12:40.772439] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T17:12:41.556719] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-26T17:12:41.763174] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T17:12:41.981672] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:12:42.356755] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-26T17:12:43.156735] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-26T17:12:43.235216] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T17:12:43.741046] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:12:43.956800] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-26T17:12:44.571736] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T17:12:44.756847] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-26T17:12:45.532036] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T17:12:45.556729] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-26T17:12:46.145684] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:12:46.356770] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-26T17:12:47.064949] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:12:47.156769] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-26T17:12:47.956741] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-26T17:12:48.077114] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:12:48.496532] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T17:12:48.756787] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-26T17:12:49.556750] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-26T17:12:49.894069] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T17:12:49.906927] [INFO ] [REMOTE ] AMH: Full fetch complete (74785 records). [2025-09-26T17:12:49.907141] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-26T17:12:50.361494] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-26T17:12:50.426378] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-26T17:12:50.426507] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-26T17:12:50.427357] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-26T17:12:50.427475] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-26T17:12:50.446194] [DEBUG] [LOCAL ] AMH: Trimmed 74785 records to 52467 (keeping 200 days of data) [2025-09-26T17:12:50.461706] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:12:50.806295] [DEBUG] [LOCAL ] AMH: Primary data saved (52467 records). [2025-09-26T17:12:50.806494] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-26T17:12:50.806672] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 29.6s. Estimated remaining: 4h 47m 35s. Rate: 7.9 symbols/min [2025-09-26T17:12:50.996093] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:51.017871] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T17:12:51.058610] [DEBUG] [LOCAL ] AMPY: Loaded 37778 existing records from primary storage. [2025-09-26T17:12:51.058825] [INFO ] [MAIN ] AMPY: Loaded 37778 existing records. [2025-09-26T17:12:51.162599] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-26T17:12:51.250165] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:51.250472] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-26T17:12:51.250543] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-26T17:12:51.251754] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-26T17:12:51.251820] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-26T17:12:51.670954] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:51.918278] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T17:12:51.956700] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-26T17:12:52.701420] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:12:52.708355] [INFO ] [REMOTE ] AMP: Full fetch complete (47634 records). [2025-09-26T17:12:52.708476] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-26T17:12:52.761910] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-26T17:12:53.145446] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-26T17:12:53.145683] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-26T17:12:53.146299] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-26T17:12:53.146450] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-26T17:12:53.147696] [DEBUG] [LOCAL ] AMP: Trimmed 47634 records to 32959 (keeping 200 days of data) [2025-09-26T17:12:53.449806] [DEBUG] [LOCAL ] AMP: Primary data saved (32959 records). [2025-09-26T17:12:53.451262] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T17:12:53.451532] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-26T17:12:53.460760] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMP took 26.5s. Estimated remaining: 4h 45m 37s. Rate: 7.9 symbols/min [2025-09-26T17:12:53.565361] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-26T17:12:53.654905] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:12:53.697369] [DEBUG] [LOCAL ] AMR: Loaded 29293 existing records from primary storage. [2025-09-26T17:12:53.697509] [INFO ] [MAIN ] AMR: Loaded 29293 existing records. [2025-09-26T17:12:53.974045] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:12:53.974414] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-26T17:12:53.974472] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-26T17:12:53.975504] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-26T17:12:53.975569] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-26T17:12:54.150905] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T17:12:54.361899] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-26T17:12:54.747746] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:12:55.156790] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-26T17:12:55.962004] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-26T17:12:55.967854] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:12:56.136179] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-26T17:12:56.205877] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T17:12:56.756700] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-26T17:12:56.779406] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T17:12:57.556753] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-26T17:12:58.356692] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-26T17:12:58.825498] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:12:58.952398] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T17:12:59.156735] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-26T17:12:59.783073] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:12:59.956736] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-26T17:13:00.756747] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-26T17:13:01.556723] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-26T17:13:01.722928] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T17:13:01.732626] [INFO ] [REMOTE ] AMN: Full fetch complete (60384 records). [2025-09-26T17:13:01.732842] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-26T17:13:01.988983] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-26T17:13:02.074137] [INFO ] [REMOTE ] AMPX: Full fetch complete (74611 records). [2025-09-26T17:13:02.097779] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-26T17:13:02.154497] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:13:02.357219] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-26T17:13:02.395961] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-26T17:13:02.406568] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-26T17:13:02.412432] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-26T17:13:02.418171] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-26T17:13:02.481020] [DEBUG] [LOCAL ] AMN: Trimmed 60384 records to 42588 (keeping 200 days of data) [2025-09-26T17:13:02.829733] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-26T17:13:02.830705] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-26T17:13:02.834145] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-26T17:13:02.841404] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-26T17:13:02.859250] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T17:13:02.870716] [DEBUG] [LOCAL ] AMPX: Trimmed 74611 records to 52949 (keeping 200 days of data) [2025-09-26T17:13:03.164726] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-26T17:13:03.354675] [DEBUG] [LOCAL ] AMPX: Primary data saved (52949 records). [2025-09-26T17:13:03.355638] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-26T17:13:03.356176] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMPX took 32.4s. Estimated remaining: 4h 46m 21s. Rate: 7.9 symbols/min [2025-09-26T17:13:03.383547] [DEBUG] [LOCAL ] AMN: Primary data saved (42588 records). [2025-09-26T17:13:03.400056] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-26T17:13:03.401159] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMN took 41.0s. Estimated remaining: 4h 43m 30s. Rate: 8.0 symbols/min [2025-09-26T17:13:03.646239] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T17:13:03.747968] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:03.829177] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:03.829450] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-26T17:13:03.829508] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-26T17:13:03.829690] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-26T17:13:03.829746] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-26T17:13:03.829791] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-26T17:13:03.829825] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-26T17:13:03.960855] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-26T17:13:04.041764] [DEBUG] [LOCAL ] AMRC: Loaded 38678 existing records from primary storage. [2025-09-26T17:13:04.060785] [INFO ] [MAIN ] AMRC: Loaded 38678 existing records. [2025-09-26T17:13:04.484446] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:04.484780] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:04.485779] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-26T17:13:04.485870] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-26T17:13:04.486980] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-26T17:13:04.487252] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-26T17:13:04.633318] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T17:13:04.763307] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-26T17:13:04.945876] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:05.010384] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T17:13:05.556745] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-26T17:13:05.783597] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:05.783998] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-26T17:13:05.982202] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:13:06.356734] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-26T17:13:06.573844] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:06.574163] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-26T17:13:07.156760] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-26T17:13:07.956729] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-26T17:13:08.486831] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T17:13:08.756735] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-26T17:13:09.089893] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T17:13:09.556744] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-26T17:13:09.637416] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T17:13:10.356732] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-26T17:13:10.509751] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T17:13:11.156755] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-26T17:13:11.188623] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:13:11.269318] [DEBUG] [REMOTE ] AMPY: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-26T17:13:11.269664] [WARN ] [REMOTE ] AMPY: No data returned for month 2025-06 [2025-09-26T17:13:11.956731] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-26T17:13:12.756725] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-26T17:13:12.968677] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T17:13:13.556724] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-26T17:13:14.017020] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:13:14.356724] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-26T17:13:14.837877] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T17:13:15.156735] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-26T17:13:15.453913] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T17:13:15.956726] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-26T17:13:16.205816] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:16.206129] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-26T17:13:16.447301] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:13:16.756725] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-26T17:13:16.969245] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:16.969689] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-26T17:13:17.556725] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-26T17:13:17.771967] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:17.772280] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-26T17:13:18.356768] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-26T17:13:19.156738] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-26T17:13:19.881851] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:13:19.956733] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-26T17:13:20.314310] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T17:13:20.321789] [INFO ] [REMOTE ] AMPY: Full fetch complete (44329 records). [2025-09-26T17:13:20.321930] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-26T17:13:20.531670] [WARN ] [VALIDATOR ] AMPY: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T17:13:20.532210] [FATAL] [MAIN ] AMPY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:13:20.532287] [WARN ] [MAIN ] AMPY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:13:20.532364] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-26T17:13:20.532458] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-09-26T17:13:20.532511] [INFO ] [LOCAL ] AMPY: Starting deletion of derivative data. [2025-09-26T17:13:20.533057] [DEBUG] [LOCAL ] AMPY: Deleted derivative data file. [2025-09-26T17:13:20.533163] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPY took 29.7s. Estimated remaining: 4h 46m 50s. Rate: 7.9 symbols/min [2025-09-26T17:13:20.715302] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:20.758705] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-26T17:13:20.784010] [DEBUG] [LOCAL ] AMT: Loaded 52833 existing records from primary storage. [2025-09-26T17:13:20.784165] [INFO ] [MAIN ] AMT: Loaded 52833 existing records. [2025-09-26T17:13:20.978795] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:20.979038] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-26T17:13:20.979087] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-26T17:13:20.980579] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-26T17:13:20.980673] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-26T17:13:21.375453] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:21.556754] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-26T17:13:21.657886] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T17:13:22.356710] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-26T17:13:22.651568] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:13:22.651944] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-26T17:13:22.680349] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T17:13:23.156746] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-26T17:13:23.275220] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T17:13:23.956767] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-26T17:13:24.358536] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T17:13:24.756740] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-26T17:13:25.305917] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T17:13:25.312088] [INFO ] [REMOTE ] AMR: Full fetch complete (39827 records). [2025-09-26T17:13:25.312213] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-26T17:13:25.564300] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-26T17:13:25.736197] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-26T17:13:25.736442] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-26T17:13:25.737182] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-26T17:13:25.737264] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-26T17:13:25.756345] [DEBUG] [LOCAL ] AMR: Trimmed 39827 records to 29441 (keeping 200 days of data) [2025-09-26T17:13:25.758046] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:13:25.943320] [DEBUG] [LOCAL ] AMR: Primary data saved (29441 records). [2025-09-26T17:13:25.943468] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-26T17:13:25.943557] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMR took 32.5s. Estimated remaining: 4h 45m 56s. Rate: 7.9 symbols/min [2025-09-26T17:13:26.131089] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:26.152219] [DEBUG] [LOCAL ] AMTB: Loaded 20492 existing records from primary storage. [2025-09-26T17:13:26.152365] [INFO ] [MAIN ] AMTB: Loaded 20492 existing records. [2025-09-26T17:13:26.343952] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:26.344212] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-26T17:13:26.344262] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-26T17:13:26.345034] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-26T17:13:26.345097] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-26T17:13:26.366916] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-26T17:13:26.736234] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:27.156776] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-26T17:13:27.290170] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T17:13:27.831361] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T17:13:27.956767] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-26T17:13:28.037504] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T17:13:28.756774] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-26T17:13:29.450894] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:13:29.511101] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T17:13:29.556703] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-26T17:13:30.356741] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-26T17:13:30.653156] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T17:13:31.156742] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-26T17:13:31.945198] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T17:13:31.956667] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-26T17:13:32.335696] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T17:13:32.756755] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-26T17:13:33.541662] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:13:33.556679] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-26T17:13:33.969850] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T17:13:34.356767] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-26T17:13:35.112014] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:13:35.120393] [INFO ] [REMOTE ] AMRC: Full fetch complete (52817 records). [2025-09-26T17:13:35.120501] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-26T17:13:35.161835] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-26T17:13:35.556697] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-26T17:13:35.556813] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-26T17:13:35.557421] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-26T17:13:35.557489] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-26T17:13:35.558867] [DEBUG] [LOCAL ] AMRC: Trimmed 52817 records to 38981 (keeping 200 days of data) [2025-09-26T17:13:35.794687] [DEBUG] [LOCAL ] AMRC: Primary data saved (38981 records). [2025-09-26T17:13:35.794851] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-26T17:13:35.794943] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMRC took 32.4s. Estimated remaining: 4h 46m 36s. Rate: 7.9 symbols/min [2025-09-26T17:13:35.994218] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:35.961789] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-26T17:13:36.002930] [DEBUG] [LOCAL ] AMTD: Loaded 3578 existing records from primary storage. [2025-09-26T17:13:36.003145] [INFO ] [MAIN ] AMTD: Loaded 3578 existing records. [2025-09-26T17:13:36.144993] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T17:13:36.174514] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T17:13:36.221386] [INFO ] [REMOTE ] AMRZ: Full fetch complete (25745 records). [2025-09-26T17:13:36.242315] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-26T17:13:36.264857] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:36.344740] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-26T17:13:36.356527] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-26T17:13:36.381468] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-26T17:13:36.381628] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-26T17:13:36.646298] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 68 unique days, need 200 days [2025-09-26T17:13:36.662579] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:13:36.663350] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:13:36.663802] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-26T17:13:36.664251] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-26T17:13:36.680409] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-26T17:13:36.735354] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-26T17:13:36.753561] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRZ took 33.3s. Estimated remaining: 4h 44m 10s. Rate: 8.0 symbols/min [2025-09-26T17:13:36.766099] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-26T17:13:37.060318] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:37.172534] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:37.244973] [DEBUG] [LOCAL ] AMTM: Loaded 51110 existing records from primary storage. [2025-09-26T17:13:37.245188] [INFO ] [MAIN ] AMTM: Loaded 51110 existing records. [2025-09-26T17:13:37.521457] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:37.522053] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-26T17:13:37.522128] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-26T17:13:37.556830] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-26T17:13:37.534230] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-26T17:13:37.558852] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-26T17:13:37.593484] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:13:37.891778] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:13:38.127389] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:38.361314] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-26T17:13:38.362335] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T17:13:39.156744] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-26T17:13:39.956751] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-26T17:13:40.269119] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T17:13:40.692085] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T17:13:40.756755] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-26T17:13:41.214257] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T17:13:41.523095] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:13:41.556724] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-26T17:13:42.356775] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-26T17:13:43.156706] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-26T17:13:43.441793] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T17:13:43.534680] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T17:13:43.637754] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T17:13:43.956743] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-26T17:13:44.756765] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-26T17:13:45.556741] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-26T17:13:45.962352] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T17:13:46.050659] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-26T17:13:46.356733] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-26T17:13:46.405367] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T17:13:46.897731] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T17:13:47.156741] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-26T17:13:47.956741] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-26T17:13:48.403114] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T17:13:48.683925] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:13:48.756774] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-26T17:13:49.556737] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-26T17:13:50.356750] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-26T17:13:50.595854] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T17:13:51.068633] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T17:13:51.156740] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-26T17:13:51.325122] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T17:13:51.564292] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-26T17:13:51.956759] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-26T17:13:52.756808] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-26T17:13:53.556722] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-26T17:13:53.872523] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T17:13:53.901509] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T17:13:54.356743] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-26T17:13:55.156745] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-26T17:13:55.458011] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:13:55.956726] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-26T17:13:56.343633] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T17:13:56.352552] [INFO ] [REMOTE ] AMTB: Full fetch complete (30119 records). [2025-09-26T17:13:56.352402] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T17:13:56.363073] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-26T17:13:56.392162] [INFO ] [REMOTE ] AMT: Full fetch complete (76009 records). [2025-09-26T17:13:56.422854] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-26T17:13:56.578849] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T17:13:56.764350] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-26T17:13:57.273364] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-26T17:13:57.287227] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-26T17:13:57.287526] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-26T17:13:57.288448] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-26T17:13:57.288575] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-26T17:13:57.289077] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-26T17:13:57.289265] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-26T17:13:57.289184] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-26T17:13:57.291452] [DEBUG] [LOCAL ] AMTB: Trimmed 30119 records to 20599 (keeping 200 days of data) [2025-09-26T17:13:57.292380] [DEBUG] [LOCAL ] AMT: Trimmed 76009 records to 53212 (keeping 200 days of data) [2025-09-26T17:13:57.513260] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T17:13:57.519207] [INFO ] [REMOTE ] AMTD: Full fetch complete (5602 records). [2025-09-26T17:13:57.519329] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-26T17:13:57.573246] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-26T17:13:57.854062] [DEBUG] [LOCAL ] AMTB: Primary data saved (20599 records). [2025-09-26T17:13:57.870236] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-26T17:13:57.921375] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTB took 32.0s. Estimated remaining: 4h 48m 45s. Rate: 7.8 symbols/min [2025-09-26T17:13:58.212735] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-26T17:13:58.224430] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-26T17:13:58.225250] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-26T17:13:58.236273] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-26T17:13:58.268279] [DEBUG] [LOCAL ] AMTD: Trimmed 5602 records to 3622 (keeping 200 days of data) [2025-09-26T17:13:58.302358] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:58.331689] [DEBUG] [LOCAL ] AMTD: Primary data saved (3622 records). [2025-09-26T17:13:58.333150] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-26T17:13:58.338975] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMTD took 22.5s. Estimated remaining: 4h 46m 9s. Rate: 7.9 symbols/min [2025-09-26T17:13:58.340409] [DEBUG] [LOCAL ] AMWL: Loaded 8731 existing records from primary storage. [2025-09-26T17:13:58.341563] [INFO ] [MAIN ] AMWL: Loaded 8731 existing records. [2025-09-26T17:13:58.710366] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:58.790249] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:58.810030] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-26T17:13:58.812051] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-26T17:13:58.819150] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-26T17:13:58.820787] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-26T17:13:59.130768] [DEBUG] [LOCAL ] AMX: Loaded 49543 existing records from primary storage. [2025-09-26T17:13:59.097295] [DEBUG] [LOCAL ] AMT: Primary data saved (53212 records). [2025-09-26T17:13:59.153382] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-26T17:13:59.163763] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMT took 38.6s. Estimated remaining: 4h 43m 43s. Rate: 8.0 symbols/min [2025-09-26T17:13:59.163932] [INFO ] [MAIN ] AMX: Loaded 49543 existing records. [2025-09-26T17:13:59.525882] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:13:59.549710] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-26T17:13:59.708759] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:13:59.760458] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:13:59.781205] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-26T17:13:59.792737] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-26T17:13:59.794831] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-26T17:13:59.805620] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-26T17:13:59.806788] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-26T17:13:59.848831] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-26T17:14:00.016292] [DEBUG] [LOCAL ] AN: Loaded 32630 existing records from primary storage. [2025-09-26T17:14:00.030674] [INFO ] [MAIN ] AN: Loaded 32630 existing records. [2025-09-26T17:14:00.434133] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:14:00.455186] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-26T17:14:00.477181] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-26T17:14:00.477099] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:00.477546] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-26T17:14:00.479418] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-26T17:14:00.479490] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-26T17:14:00.812032] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:14:00.831022] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-26T17:14:00.890822] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:01.527622] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T17:14:01.556741] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-26T17:14:01.869627] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T17:14:02.061239] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T17:14:02.146773] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T17:14:02.356749] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-26T17:14:03.156735] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-26T17:14:03.956723] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-26T17:14:03.997846] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T17:14:04.756708] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-26T17:14:04.804607] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T17:14:05.426874] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T17:14:05.466707] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T17:14:05.556736] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-26T17:14:06.356741] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-26T17:14:07.161867] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-26T17:14:07.179459] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T17:14:07.374092] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:14:07.662964] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T17:14:07.956733] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-26T17:14:08.756754] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-26T17:14:09.551116] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:14:09.556668] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-26T17:14:09.956254] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T17:14:10.321545] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T17:14:10.356697] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-26T17:14:11.026545] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T17:14:11.156733] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-26T17:14:11.956727] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-26T17:14:12.756740] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-26T17:14:13.307869] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T17:14:13.318553] [INFO ] [REMOTE ] AMTM: Full fetch complete (73974 records). [2025-09-26T17:14:13.318789] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-26T17:14:13.577557] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-26T17:14:13.637225] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:14:13.772020] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-26T17:14:13.772153] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-26T17:14:13.773009] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-26T17:14:13.773100] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-26T17:14:13.775125] [DEBUG] [LOCAL ] AMTM: Trimmed 73974 records to 51451 (keeping 200 days of data) [2025-09-26T17:14:13.862449] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T17:14:14.121821] [DEBUG] [LOCAL ] AMTM: Primary data saved (51451 records). [2025-09-26T17:14:14.121976] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-26T17:14:14.124076] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMTM took 37.4s. Estimated remaining: 4h 46m 5s. Rate: 7.9 symbols/min [2025-09-26T17:14:14.301756] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:14.361563] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-26T17:14:14.363790] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-09-26T17:14:14.364084] [INFO ] [MAIN ] ANET: Loaded 54156 existing records. [2025-09-26T17:14:14.554666] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:14:14.554963] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-26T17:14:14.555027] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-26T17:14:14.556586] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-26T17:14:14.556678] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-26T17:14:14.947741] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:14.969925] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:14:15.156727] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-26T17:14:15.924597] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:14:15.956685] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-26T17:14:16.216023] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:14:16.756718] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-26T17:14:17.186142] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T17:14:17.410598] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T17:14:17.413505] [INFO ] [REMOTE ] AMWL: Full fetch complete (14028 records). [2025-09-26T17:14:17.413602] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-26T17:14:17.569847] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-26T17:14:17.831386] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-26T17:14:17.831469] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-26T17:14:17.831736] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-26T17:14:17.831814] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-26T17:14:17.832359] [DEBUG] [LOCAL ] AMWL: Trimmed 14028 records to 8830 (keeping 200 days of data) [2025-09-26T17:14:17.881053] [DEBUG] [LOCAL ] AMWL: Primary data saved (8830 records). [2025-09-26T17:14:17.881190] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-26T17:14:17.881292] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMWL took 19.9s. Estimated remaining: 4h 44m 41s. Rate: 7.9 symbols/min [2025-09-26T17:14:18.058782] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:18.119975] [DEBUG] [LOCAL ] ANF: Loaded 52603 existing records from primary storage. [2025-09-26T17:14:18.120202] [INFO ] [MAIN ] ANF: Loaded 52603 existing records. [2025-09-26T17:14:18.355899] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:14:18.356235] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-26T17:14:18.356293] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-26T17:14:18.356723] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-26T17:14:18.358001] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-26T17:14:18.358083] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-26T17:14:18.749206] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:19.108942] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T17:14:19.156706] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-26T17:14:19.956778] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-26T17:14:20.401307] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:14:20.448178] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:14:20.756751] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-26T17:14:21.158933] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T17:14:21.556726] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-26T17:14:21.774414] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:14:22.356762] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-26T17:14:22.957964] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:14:23.156737] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-26T17:14:23.588512] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T17:14:23.956738] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-26T17:14:24.756780] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-26T17:14:25.556755] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-26T17:14:25.613509] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-26T17:14:25.693765] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T17:14:26.357725] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-26T17:14:26.361146] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T17:14:26.537066] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T17:14:27.156749] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-26T17:14:27.956782] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-26T17:14:28.616102] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-26T17:14:28.756738] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-26T17:14:28.936812] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T17:14:28.946975] [INFO ] [REMOTE ] AMX: Full fetch complete (70710 records). [2025-09-26T17:14:28.947150] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-26T17:14:29.374510] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-26T17:14:29.374622] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-26T17:14:29.375456] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-26T17:14:29.375534] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-26T17:14:29.377161] [DEBUG] [LOCAL ] AMX: Trimmed 70710 records to 49855 (keeping 200 days of data) [2025-09-26T17:14:29.564151] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-26T17:14:29.702175] [DEBUG] [LOCAL ] AMX: Primary data saved (49855 records). [2025-09-26T17:14:29.702464] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-26T17:14:29.702686] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AMX took 31.4s. Estimated remaining: 4h 45m 58s. Rate: 7.9 symbols/min [2025-09-26T17:14:29.935873] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:29.937307] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-26T17:14:29.939314] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T17:14:29.939529] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-26T17:14:29.952067] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-26T17:14:29.952549] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-26T17:14:29.952637] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-26T17:14:29.952780] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-26T17:14:30.362012] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-26T17:14:30.452967] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:30.811094] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:14:30.822153] [INFO ] [REMOTE ] AN: Full fetch complete (47668 records). [2025-09-26T17:14:30.822364] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-26T17:14:31.165141] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-26T17:14:31.370776] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-26T17:14:31.371133] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-26T17:14:31.371748] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-26T17:14:31.371815] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-26T17:14:31.373164] [DEBUG] [LOCAL ] AN: Trimmed 47668 records to 32842 (keeping 200 days of data) [2025-09-26T17:14:31.412369] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-26T17:14:31.477441] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:31.515801] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-26T17:14:31.636740] [DEBUG] [LOCAL ] AN: Primary data saved (32842 records). [2025-09-26T17:14:31.636904] [INFO ] [MAIN ] AN: Full history saved. [2025-09-26T17:14:31.637014] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AN took 32.4s. Estimated remaining: 4h 43m 59s. Rate: 7.9 symbols/min [2025-09-26T17:14:31.822914] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:31.823089] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-09-26T17:14:31.823129] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-09-26T17:14:31.823276] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-26T17:14:31.823320] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-26T17:14:31.823362] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-09-26T17:14:31.823396] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-26T17:14:31.961820] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-26T17:14:32.226929] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:32.429271] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-26T17:14:32.756759] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-26T17:14:33.556740] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-26T17:14:34.361825] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-26T17:14:34.379330] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-26T17:14:34.457864] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:14:34.490583] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T17:14:34.598090] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:34.598403] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-26T17:14:35.156801] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-26T17:14:35.956772] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-26T17:14:36.167278] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:36.167638] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-26T17:14:36.756742] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-26T17:14:37.471783] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-26T17:14:37.556711] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-26T17:14:38.356794] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-26T17:14:38.564128] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T17:14:38.577178] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:38.577723] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-26T17:14:38.709101] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T17:14:39.156794] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-26T17:14:39.956750] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-26T17:14:40.756748] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-26T17:14:41.166717] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T17:14:41.438033] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-26T17:14:41.556739] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-26T17:14:41.846409] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T17:14:42.356731] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-26T17:14:42.559029] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:42.559455] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-26T17:14:43.156734] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-26T17:14:43.203444] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:14:43.356455] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:43.356872] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-26T17:14:43.956744] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-26T17:14:44.311817] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:44.312179] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-26T17:14:44.756777] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-26T17:14:45.556748] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-26T17:14:46.353278] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:14:46.359515] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-26T17:14:47.042157] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T17:14:47.156771] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-26T17:14:47.364980] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:47.365319] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-26T17:14:47.956733] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-26T17:14:48.177518] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:14:48.177930] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-26T17:14:48.419520] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T17:14:48.756784] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-26T17:14:49.556730] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-26T17:14:50.356712] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-26T17:14:50.457986] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:14:50.465029] [INFO ] [REMOTE ] ANGX: Full fetch complete (3864 records). [2025-09-26T17:14:50.465199] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-26T17:14:50.465736] [FATAL] [VALIDATOR ] ANGX: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:14:50.465837] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:14:50.465882] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:14:50.465925] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-26T17:14:50.466010] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-26T17:14:50.466070] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-26T17:14:50.466132] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-26T17:14:50.466218] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANGX took 20.8s. Estimated remaining: 4h 47m 31s. Rate: 7.8 symbols/min [2025-09-26T17:14:50.659215] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:14:50.684924] [DEBUG] [LOCAL ] ANVS: Loaded 23312 existing records from primary storage. [2025-09-26T17:14:50.685131] [INFO ] [MAIN ] ANVS: Loaded 23312 existing records. [2025-09-26T17:14:50.874990] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:14:50.875260] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-26T17:14:50.875312] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-26T17:14:50.876160] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-26T17:14:50.876249] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-26T17:14:51.157558] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-26T17:14:51.285272] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:14:51.321187] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T17:14:51.903938] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-26T17:14:51.956755] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-26T17:14:52.714419] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T17:14:52.756733] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-26T17:14:53.294094] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T17:14:53.560807] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-26T17:14:53.570400] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T17:14:54.356790] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-26T17:14:54.923386] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T17:14:55.156749] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-26T17:14:55.956715] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-26T17:14:55.992117] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:14:56.003410] [INFO ] [REMOTE ] ANF: Full fetch complete (75644 records). [2025-09-26T17:14:56.003622] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-26T17:14:56.442848] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-26T17:14:56.442969] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-26T17:14:56.443753] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-26T17:14:56.443854] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-26T17:14:56.445494] [DEBUG] [LOCAL ] ANF: Trimmed 75644 records to 52967 (keeping 200 days of data) [2025-09-26T17:14:56.756845] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-26T17:14:56.783583] [DEBUG] [LOCAL ] ANF: Primary data saved (52967 records). [2025-09-26T17:14:56.783777] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-26T17:14:56.784007] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANF took 38.9s. Estimated remaining: 4h 46m 57s. Rate: 7.9 symbols/min [2025-09-26T17:14:57.028559] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:14:57.321576] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T17:14:57.333579] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-26T17:14:57.333795] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-26T17:14:57.568133] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-26T17:14:57.772386] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-26T17:14:57.772503] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-26T17:14:57.773333] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-26T17:14:57.773433] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-26T17:14:57.784496] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 54546 (keeping 200 days of data) [2025-09-26T17:14:57.797947] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:14:58.149665] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-09-26T17:14:58.150127] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-26T17:14:58.151382] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANET took 44.0s. Estimated remaining: 4h 44m 50s. Rate: 7.9 symbols/min [2025-09-26T17:14:58.287288] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T17:14:58.356764] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-26T17:14:59.156808] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-26T17:14:59.574127] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:14:59.777114] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T17:14:59.779896] [INFO ] [REMOTE ] ANRO: Full fetch complete (29998 records). [2025-09-26T17:14:59.779989] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-26T17:14:59.967467] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-26T17:15:00.206699] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-26T17:15:00.206804] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-26T17:15:00.207209] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-26T17:15:00.207273] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-26T17:15:00.208130] [DEBUG] [LOCAL ] ANRO: Trimmed 29998 records to 19387 (keeping 200 days of data) [2025-09-26T17:15:00.333326] [DEBUG] [LOCAL ] ANRO: Primary data saved (19387 records). [2025-09-26T17:15:00.333507] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-26T17:15:00.333664] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANRO took 28.7s. Estimated remaining: 4h 43m 0s. Rate: 8.0 symbols/min [2025-09-26T17:15:01.436585] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T17:15:01.443582] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-26T17:15:02.903511] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:15:02.911139] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-26T17:15:04.454160] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T17:15:04.460427] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-26T17:15:05.846155] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:15:05.853440] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-26T17:15:06.906738] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T17:15:06.912959] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-26T17:15:08.025320] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T17:15:08.033835] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-26T17:15:09.229754] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T17:15:09.233823] [INFO ] [REMOTE ] ANVS: Full fetch complete (36553 records). [2025-09-26T17:15:09.233930] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-26T17:15:09.643909] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-26T17:15:09.644020] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-26T17:15:09.644458] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-26T17:15:09.644501] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-26T17:15:09.645709] [DEBUG] [LOCAL ] ANVS: Trimmed 36553 records to 23508 (keeping 200 days of data) [2025-09-26T17:15:09.793422] [DEBUG] [LOCAL ] ANVS: Primary data saved (23508 records). [2025-09-26T17:15:09.793564] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-26T17:15:09.793675] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANVS took 19.3s. Estimated remaining: 4h 43m 29s. Rate: 7.9 symbols/min [2025-09-26T17:15:10.519146] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:10.512831] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:10.537956] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:10.558912] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-26T17:15:10.558728] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:10.560037] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-26T17:15:10.562570] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-26T17:15:10.562782] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-26T17:15:10.562884] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-26T17:15:10.562972] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-26T17:15:10.680557] [DEBUG] [LOCAL ] AOMR: Loaded 16780 existing records from primary storage. [2025-09-26T17:15:10.693915] [INFO ] [MAIN ] AOMR: Loaded 16780 existing records. [2025-09-26T17:15:10.983668] [DEBUG] [LOCAL ] AOD: Loaded 30246 existing records from primary storage. [2025-09-26T17:15:11.071267] [DEBUG] [LOCAL ] AON: Loaded 45981 existing records from primary storage. [2025-09-26T17:15:11.061017] [INFO ] [MAIN ] AOD: Loaded 30246 existing records. [2025-09-26T17:15:11.111778] [INFO ] [MAIN ] AON: Loaded 45981 existing records. [2025-09-26T17:15:11.111480] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:11.154818] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-26T17:15:11.203684] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-26T17:15:11.317164] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-26T17:15:11.379442] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-26T17:15:11.565736] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:11.661138] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-26T17:15:11.750560] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:11.793488] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-26T17:15:11.793680] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:11.804629] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-26T17:15:11.815204] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-26T17:15:11.815331] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-26T17:15:11.821578] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-26T17:15:11.821512] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-26T17:15:11.843001] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-26T17:15:11.842916] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-26T17:15:12.075298] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:12.197800] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-26T17:15:12.224705] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-26T17:15:12.534495] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:12.647965] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-26T17:15:12.710563] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-26T17:15:12.670862] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:12.756795] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-26T17:15:12.853538] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:12.869373] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-26T17:15:12.945035] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:12.945388] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-26T17:15:13.034979] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:13.035324] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-26T17:15:13.035877] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-26T17:15:13.396293] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:13.396691] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-26T17:15:13.397208] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-26T17:15:13.742436] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:15:13.742788] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-26T17:15:13.743244] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-26T17:15:14.122242] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T17:15:14.125676] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-26T17:15:14.311898] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T17:15:14.319058] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-26T17:15:14.341660] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T17:15:14.356716] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-26T17:15:14.642557] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T17:15:14.894887] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T17:15:14.904204] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T17:15:15.156764] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-26T17:15:15.481461] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T17:15:15.956750] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-26T17:15:16.250588] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-26T17:15:16.689050] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T17:15:16.756796] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-26T17:15:17.262890] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T17:15:17.556744] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-26T17:15:18.356783] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-26T17:15:18.548615] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T17:15:18.872391] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T17:15:18.873490] [INFO ] [REMOTE ] AOMD: Full fetch complete (1808 records). [2025-09-26T17:15:18.873561] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-26T17:15:19.062145] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 86 unique days, need 200 days [2025-09-26T17:15:19.062398] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:15:19.062504] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:15:19.062583] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-26T17:15:19.062681] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-26T17:15:19.062739] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-26T17:15:19.062803] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-26T17:15:19.062904] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 9.3s. Estimated remaining: 4h 43m 53s. Rate: 7.9 symbols/min [2025-09-26T17:15:19.161903] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-26T17:15:19.255715] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:19.286274] [DEBUG] [LOCAL ] AORT: Loaded 29879 existing records from primary storage. [2025-09-26T17:15:19.286468] [INFO ] [MAIN ] AORT: Loaded 29879 existing records. [2025-09-26T17:15:19.474805] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:19.475109] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-26T17:15:19.475171] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-26T17:15:19.476015] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-26T17:15:19.476077] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-26T17:15:19.906924] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:19.956743] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-26T17:15:20.604756] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:15:20.756778] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-26T17:15:20.842685] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T17:15:21.511941] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T17:15:21.556783] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-26T17:15:22.356699] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-26T17:15:22.584286] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T17:15:23.156745] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-26T17:15:23.956702] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-26T17:15:24.043324] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T17:15:24.218931] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T17:15:24.756774] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-26T17:15:24.933380] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T17:15:25.556725] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-26T17:15:25.920453] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:15:26.356766] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-26T17:15:26.555960] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T17:15:27.156770] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-26T17:15:27.956783] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-26T17:15:28.196842] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T17:15:28.340080] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T17:15:28.756797] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-26T17:15:29.548418] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:15:29.556676] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-26T17:15:30.163080] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T17:15:30.356759] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-26T17:15:30.830097] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T17:15:31.101033] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:15:31.156773] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-26T17:15:31.956741] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-26T17:15:32.754586] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T17:15:32.757467] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-26T17:15:33.353618] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:15:33.556740] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-26T17:15:33.680594] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:15:34.356758] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-26T17:15:34.838198] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T17:15:35.156689] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-26T17:15:35.559095] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T17:15:35.956759] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-26T17:15:36.358502] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:15:36.756767] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-26T17:15:37.556709] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-26T17:15:37.597183] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T17:15:37.744961] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T17:15:38.356739] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-26T17:15:38.939680] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T17:15:39.156760] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-26T17:15:39.366382] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T17:15:39.956738] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-26T17:15:40.288354] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T17:15:40.295007] [INFO ] [REMOTE ] AORT: Full fetch complete (41799 records). [2025-09-26T17:15:40.295192] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-26T17:15:40.702146] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-26T17:15:40.702253] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-26T17:15:40.702793] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-26T17:15:40.702860] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-26T17:15:40.704039] [DEBUG] [LOCAL ] AORT: Trimmed 41799 records to 30087 (keeping 200 days of data) [2025-09-26T17:15:40.765094] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-26T17:15:40.890839] [DEBUG] [LOCAL ] AORT: Primary data saved (30087 records). [2025-09-26T17:15:40.891019] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-26T17:15:40.891117] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AORT took 21.8s. Estimated remaining: 4h 48m 8s. Rate: 7.8 symbols/min [2025-09-26T17:15:41.080902] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:41.081315] [DEBUG] [LOCAL ] AOS: No existing data file found in primary storage. [2025-09-26T17:15:41.081527] [WARN ] [MAIN ] AOS: No existing data found, performing full refresh instead. [2025-09-26T17:15:41.081759] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-26T17:15:41.081823] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-26T17:15:41.082148] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-09-26T17:15:41.082214] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-26T17:15:41.180700] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T17:15:41.235839] [INFO ] [REMOTE ] AOD: Full fetch complete (44060 records). [2025-09-26T17:15:41.241336] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-26T17:15:41.560858] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-26T17:15:41.929386] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:42.041139] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-26T17:15:42.041859] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-26T17:15:42.043172] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-26T17:15:42.043279] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-26T17:15:42.042234] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T17:15:42.048080] [DEBUG] [LOCAL ] AOD: Trimmed 44060 records to 30414 (keeping 200 days of data) [2025-09-26T17:15:42.236180] [DEBUG] [LOCAL ] AOD: Primary data saved (30414 records). [2025-09-26T17:15:42.236355] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-26T17:15:42.236472] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOD took 32.4s. Estimated remaining: 4h 46m 5s. Rate: 7.9 symbols/min [2025-09-26T17:15:42.366329] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-26T17:15:42.459278] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:42.468662] [DEBUG] [LOCAL ] AP: Loaded 7174 existing records from primary storage. [2025-09-26T17:15:42.468820] [INFO ] [MAIN ] AP: Loaded 7174 existing records. [2025-09-26T17:15:42.672257] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:42.672528] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-26T17:15:42.672578] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-26T17:15:42.673015] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-26T17:15:42.673076] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-26T17:15:43.093448] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:43.156791] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-26T17:15:43.369766] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T17:15:43.425447] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T17:15:43.956809] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-26T17:15:44.484913] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:15:44.704308] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T17:15:44.708412] [INFO ] [REMOTE ] AOMR: Full fetch complete (23082 records). [2025-09-26T17:15:44.708576] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-26T17:15:44.765546] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-26T17:15:45.109092] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-26T17:15:45.109183] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-26T17:15:45.109493] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-26T17:15:45.109535] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-26T17:15:45.110332] [DEBUG] [LOCAL ] AOMR: Trimmed 23082 records to 16852 (keeping 200 days of data) [2025-09-26T17:15:45.214292] [DEBUG] [LOCAL ] AOMR: Primary data saved (16852 records). [2025-09-26T17:15:45.214447] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-26T17:15:45.214538] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AOMR took 35.4s. Estimated remaining: 4h 44m 33s. Rate: 7.9 symbols/min [2025-09-26T17:15:45.433504] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:45.486221] [DEBUG] [LOCAL ] APAM: Loaded 36716 existing records from primary storage. [2025-09-26T17:15:45.486453] [INFO ] [MAIN ] APAM: Loaded 36716 existing records. [2025-09-26T17:15:45.559058] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-26T17:15:45.572888] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T17:15:45.688787] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:15:45.689099] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-26T17:15:45.689157] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-26T17:15:45.690221] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-26T17:15:45.690284] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-26T17:15:46.072310] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:46.356733] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-26T17:15:47.053354] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T17:15:47.156704] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-26T17:15:47.237611] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T17:15:47.519665] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-26T17:15:47.956815] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-26T17:15:48.530458] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T17:15:48.756760] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-26T17:15:49.219979] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-26T17:15:49.556750] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-26T17:15:50.356738] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-26T17:15:51.135610] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T17:15:51.156745] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-26T17:15:51.342734] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:15:51.956757] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-26T17:15:52.232264] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T17:15:52.478619] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T17:15:52.756765] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-26T17:15:53.556740] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-26T17:15:54.076443] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:15:54.356728] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-26T17:15:55.109294] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:15:55.120017] [INFO ] [REMOTE ] AON: Full fetch complete (64932 records). [2025-09-26T17:15:55.120199] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-26T17:15:55.161986] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-26T17:15:55.565426] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-26T17:15:55.565525] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-26T17:15:55.566171] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-26T17:15:55.566239] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-26T17:15:55.569859] [DEBUG] [LOCAL ] AON: Trimmed 64932 records to 46248 (keeping 200 days of data) [2025-09-26T17:15:55.907961] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T17:15:55.926023] [DEBUG] [LOCAL ] AON: Primary data saved (46248 records). [2025-09-26T17:15:55.926188] [INFO ] [MAIN ] AON: Full history saved. [2025-09-26T17:15:55.926294] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AON took 46.1s. Estimated remaining: 4h 45m 21s. Rate: 7.9 symbols/min [2025-09-26T17:15:55.961838] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-26T17:15:56.113338] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:15:56.113538] [DEBUG] [LOCAL ] APD: No existing data file found in primary storage. [2025-09-26T17:15:56.113577] [WARN ] [MAIN ] APD: No existing data found, performing full refresh instead. [2025-09-26T17:15:56.113749] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-26T17:15:56.113801] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-26T17:15:56.113846] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-26T17:15:56.113881] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-26T17:15:56.521443] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:15:56.524141] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T17:15:56.621285] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T17:15:56.756756] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-26T17:15:57.556760] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-26T17:15:58.204169] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:15:58.356743] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-26T17:15:58.601412] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T17:15:59.156731] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-26T17:15:59.914448] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:15:59.956688] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-26T17:16:00.242916] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:16:00.756739] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-26T17:16:01.381871] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:16:01.556719] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-26T17:16:01.977131] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T17:16:02.356744] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-26T17:16:02.813885] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T17:16:02.868563] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T17:16:03.156724] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-26T17:16:03.935890] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T17:16:03.938114] [INFO ] [REMOTE ] AP: Full fetch complete (8864 records). [2025-09-26T17:16:03.938219] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-26T17:16:03.938861] [FATAL] [VALIDATOR ] AP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:16:03.938953] [FATAL] [MAIN ] AP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:16:03.938999] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:16:03.939039] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-26T17:16:03.939100] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-26T17:16:03.939138] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-09-26T17:16:03.939697] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-09-26T17:16:03.939798] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 21.7s. Estimated remaining: 4h 45m 20s. Rate: 7.9 symbols/min [2025-09-26T17:16:03.962467] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-26T17:16:04.140550] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:04.140797] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-09-26T17:16:04.140854] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-09-26T17:16:04.141005] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-26T17:16:04.141051] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-26T17:16:04.141093] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-26T17:16:04.141126] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-26T17:16:04.540156] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:04.756746] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-26T17:16:05.556744] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-26T17:16:05.789060] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T17:16:06.356808] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-26T17:16:06.362487] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T17:16:06.845734] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T17:16:07.156722] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-26T17:16:07.957687] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-26T17:16:07.957573] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:16:08.159577] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:16:08.756731] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-26T17:16:09.384060] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:16:09.556816] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-26T17:16:09.950387] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T17:16:10.356781] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-26T17:16:10.764880] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T17:16:11.156725] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-26T17:16:11.713808] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T17:16:11.956779] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-26T17:16:12.756842] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-26T17:16:13.009285] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:16:13.189144] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T17:16:13.556747] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-26T17:16:13.919254] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:16:14.356780] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-26T17:16:15.047732] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T17:16:15.156769] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-26T17:16:15.660750] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T17:16:15.667733] [INFO ] [REMOTE ] APAM: Full fetch complete (51617 records). [2025-09-26T17:16:15.667932] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-26T17:16:15.961837] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-26T17:16:16.083783] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-26T17:16:16.083926] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-26T17:16:16.084512] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-26T17:16:16.084577] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-26T17:16:16.085879] [DEBUG] [LOCAL ] APAM: Trimmed 51617 records to 36969 (keeping 200 days of data) [2025-09-26T17:16:16.316375] [DEBUG] [LOCAL ] APAM: Primary data saved (36969 records). [2025-09-26T17:16:16.316531] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-26T17:16:16.316621] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. APAM took 31.1s. Estimated remaining: 4h 46m 37s. Rate: 7.8 symbols/min [2025-09-26T17:16:16.511052] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:16.511370] [DEBUG] [LOCAL ] APH: No existing data file found in primary storage. [2025-09-26T17:16:16.511486] [WARN ] [MAIN ] APH: No existing data found, performing full refresh instead. [2025-09-26T17:16:16.511763] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-26T17:16:16.511972] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-26T17:16:16.512053] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-09-26T17:16:16.512244] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-26T17:16:16.715539] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:16:16.761554] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-26T17:16:16.980980] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:17.440788] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T17:16:17.556744] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-26T17:16:18.356753] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-26T17:16:19.017283] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-26T17:16:19.156741] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-26T17:16:19.624957] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-26T17:16:19.956712] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-26T17:16:20.309390] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T17:16:20.756762] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-26T17:16:21.080113] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T17:16:21.090348] [INFO ] [REMOTE ] AOS: Full fetch complete (70669 records). [2025-09-26T17:16:21.090533] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-26T17:16:21.532783] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-26T17:16:21.532887] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-26T17:16:21.534694] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-26T17:16:21.534773] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-26T17:16:21.536469] [DEBUG] [LOCAL ] AOS: Trimmed 70669 records to 49769 (keeping 200 days of data) [2025-09-26T17:16:21.597153] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-26T17:16:21.694336] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T17:16:21.913979] [DEBUG] [LOCAL ] AOS: Primary data saved (49769 records). [2025-09-26T17:16:21.914175] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-26T17:16:21.914302] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. AOS took 41.0s. Estimated remaining: 4h 45m 53s. Rate: 7.8 symbols/min [2025-09-26T17:16:22.103305] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:22.139776] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T17:16:22.201994] [DEBUG] [LOCAL ] APLE: Loaded 52397 existing records from primary storage. [2025-09-26T17:16:22.202258] [INFO ] [MAIN ] APLE: Loaded 52397 existing records. [2025-09-26T17:16:22.365399] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-26T17:16:22.401523] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:16:22.401888] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-26T17:16:22.401959] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-26T17:16:22.403582] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-26T17:16:22.403673] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-26T17:16:22.935913] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:23.088472] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:16:23.156714] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-26T17:16:23.904035] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T17:16:23.956787] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-26T17:16:24.706895] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:16:24.756768] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-26T17:16:25.451409] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:16:25.556738] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-26T17:16:26.015723] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:16:26.356787] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-26T17:16:27.156761] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-26T17:16:27.591761] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T17:16:27.956777] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-26T17:16:28.425389] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-26T17:16:28.756749] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-26T17:16:28.924407] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T17:16:28.933633] [INFO ] [REMOTE ] APD: Full fetch complete (66296 records). [2025-09-26T17:16:28.933898] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-26T17:16:28.934907] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:16:28.935023] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:16:28.935108] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:16:28.935193] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-26T17:16:28.935272] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-26T17:16:28.935312] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-09-26T17:16:28.935354] [DEBUG] [LOCAL ] APD: No derivative data file found to delete. [2025-09-26T17:16:28.935429] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APD took 33.0s. Estimated remaining: 4h 45m 34s. Rate: 7.9 symbols/min [2025-09-26T17:16:29.125065] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:29.125249] [DEBUG] [LOCAL ] APO: No existing data file found in primary storage. [2025-09-26T17:16:29.125309] [WARN ] [MAIN ] APO: No existing data found, performing full refresh instead. [2025-09-26T17:16:29.125514] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-26T17:16:29.125570] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-26T17:16:29.125616] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-09-26T17:16:29.125679] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-26T17:16:29.540825] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:29.567100] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-26T17:16:29.574254] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T17:16:30.258249] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:16:30.356756] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-26T17:16:31.156705] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-26T17:16:31.492080] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T17:16:31.956720] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-26T17:16:31.993611] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:16:32.003469] [INFO ] [REMOTE ] APG: Full fetch complete (71308 records). [2025-09-26T17:16:32.003633] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-26T17:16:32.004461] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:16:32.004556] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:16:32.004602] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:16:32.004664] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-26T17:16:32.004754] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-26T17:16:32.004791] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-09-26T17:16:32.004849] [DEBUG] [LOCAL ] APG: No derivative data file found to delete. [2025-09-26T17:16:32.004934] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 28.1s. Estimated remaining: 4h 44m 8s. Rate: 7.9 symbols/min [2025-09-26T17:16:32.243781] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:32.253521] [DEBUG] [LOCAL ] APOS: Loaded 7545 existing records from primary storage. [2025-09-26T17:16:32.253636] [INFO ] [MAIN ] APOS: Loaded 7545 existing records. [2025-09-26T17:16:32.458797] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:16:32.459121] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-26T17:16:32.459195] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-26T17:16:32.459898] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-26T17:16:32.459964] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-26T17:16:32.766264] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-26T17:16:32.867748] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:32.906159] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:16:33.211084] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:16:33.556728] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-26T17:16:34.220158] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T17:16:34.356729] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-26T17:16:34.857910] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:16:34.874417] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-26T17:16:35.156762] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-26T17:16:35.781793] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T17:16:35.956781] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-26T17:16:36.756763] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-26T17:16:37.352985] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T17:16:37.556725] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-26T17:16:38.356753] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-26T17:16:38.444375] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:16:38.961769] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T17:16:38.961487] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T17:16:39.156786] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-26T17:16:39.956775] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-26T17:16:40.756737] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-26T17:16:41.078061] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T17:16:41.556737] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-26T17:16:41.865410] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T17:16:42.311203] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:16:42.356719] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-26T17:16:43.156734] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-26T17:16:43.518387] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T17:16:43.764564] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T17:16:43.956703] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-26T17:16:44.094340] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T17:16:44.498169] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T17:16:44.756759] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-26T17:16:45.384078] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T17:16:45.556740] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-26T17:16:46.356747] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-26T17:16:47.156721] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-26T17:16:47.640251] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-26T17:16:47.658794] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T17:16:47.759505] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T17:16:47.956744] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-26T17:16:48.756773] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-26T17:16:49.348448] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:16:49.556725] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-26T17:16:49.616479] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T17:16:50.356745] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-26T17:16:51.156729] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-26T17:16:51.607164] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T17:16:51.623327] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T17:16:51.625375] [INFO ] [REMOTE ] APH: Full fetch complete (77683 records). [2025-09-26T17:16:51.626330] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-26T17:16:51.960923] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-26T17:16:52.054883] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-26T17:16:52.055052] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-26T17:16:52.055918] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-26T17:16:52.056011] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-26T17:16:52.057772] [DEBUG] [LOCAL ] APH: Trimmed 77683 records to 54471 (keeping 200 days of data) [2025-09-26T17:16:52.325108] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-26T17:16:52.459440] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-09-26T17:16:52.459607] [INFO ] [MAIN ] APH: Full history saved. [2025-09-26T17:16:52.459717] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APH took 36.1s. Estimated remaining: 4h 47m 40s. Rate: 7.8 symbols/min [2025-09-26T17:16:52.584502] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T17:16:52.603431] [INFO ] [REMOTE ] APOS: Full fetch complete (10396 records). [2025-09-26T17:16:52.614082] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-26T17:16:52.672332] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:52.673051] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:16:52.673457] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-09-26T17:16:52.673345] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:16:52.673544] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-09-26T17:16:52.673713] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:16:52.673993] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-26T17:16:52.674138] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-26T17:16:52.674235] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-26T17:16:52.674421] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-09-26T17:16:52.674512] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-26T17:16:52.674680] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-09-26T17:16:52.679969] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-09-26T17:16:52.761887] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-26T17:16:52.762001] [DEBUG] [LOCAL ] APOS: Deleted derivative data file. [2025-09-26T17:16:52.793530] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APOS took 20.8s. Estimated remaining: 4h 45m 27s. Rate: 7.8 symbols/min [2025-09-26T17:16:53.195728] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:16:53.279465] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:53.326212] [DEBUG] [LOCAL ] AQN: Loaded 52302 existing records from primary storage. [2025-09-26T17:16:53.326364] [INFO ] [MAIN ] AQN: Loaded 52302 existing records. [2025-09-26T17:16:53.513265] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:16:53.513534] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-26T17:16:53.513582] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-26T17:16:53.515036] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-26T17:16:53.515099] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-26T17:16:53.561855] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-26T17:16:53.900937] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:16:54.356757] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-26T17:16:54.645369] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T17:16:55.156902] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-26T17:16:55.375876] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T17:16:55.834489] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T17:16:55.956734] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-26T17:16:56.606081] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:16:56.756742] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-26T17:16:57.199572] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T17:16:57.556734] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-26T17:16:58.356763] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-26T17:16:58.499172] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T17:16:59.156729] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-26T17:16:59.409179] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T17:16:59.576173] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T17:16:59.956739] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-26T17:17:00.756730] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-26T17:17:01.173432] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T17:17:01.184895] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-09-26T17:17:01.185097] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-26T17:17:01.571855] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-26T17:17:01.638005] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-26T17:17:01.638120] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-26T17:17:01.638994] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-26T17:17:01.639168] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-26T17:17:01.667449] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T17:17:01.667593] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 54162 (keeping 200 days of data) [2025-09-26T17:17:01.678724] [INFO ] [REMOTE ] APLE: Full fetch complete (73888 records). [2025-09-26T17:17:01.678896] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-26T17:17:01.679981] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:17:01.680098] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:17:01.680165] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:17:01.680236] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-26T17:17:01.680305] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-09-26T17:17:01.680343] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-09-26T17:17:01.735789] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-09-26T17:17:01.748897] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APLE took 39.8s. Estimated remaining: 4h 45m 41s. Rate: 7.8 symbols/min [2025-09-26T17:17:01.990253] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:01.991329] [DEBUG] [LOCAL ] AQNB: No existing data file found in primary storage. [2025-09-26T17:17:01.991999] [WARN ] [MAIN ] AQNB: No existing data found, performing full refresh instead. [2025-09-26T17:17:01.992796] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-26T17:17:01.993165] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-26T17:17:01.993607] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-09-26T17:17:01.994912] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-26T17:17:02.431364] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:02.436697] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-26T17:17:02.575286] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T17:17:02.713787] [DEBUG] [LOCAL ] APO: Primary data saved (54162 records). [2025-09-26T17:17:02.713955] [INFO ] [MAIN ] APO: Full history saved. [2025-09-26T17:17:02.714040] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APO took 33.8s. Estimated remaining: 4h 43m 42s. Rate: 7.9 symbols/min [2025-09-26T17:17:02.901815] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:02.957913] [DEBUG] [LOCAL ] AR: Loaded 53974 existing records from primary storage. [2025-09-26T17:17:02.958104] [INFO ] [MAIN ] AR: Loaded 53974 existing records. [2025-09-26T17:17:03.159981] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-26T17:17:03.168062] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:03.168637] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-26T17:17:03.168758] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-26T17:17:03.170256] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-26T17:17:03.170336] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-26T17:17:03.288535] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T17:17:03.394751] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T17:17:03.636929] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:03.956723] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-26T17:17:04.489138] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:17:04.756726] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-26T17:17:04.872440] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T17:17:05.070720] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-26T17:17:05.556720] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-26T17:17:06.356719] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-26T17:17:07.156714] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-26T17:17:07.350015] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:17:07.530788] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-26T17:17:07.761449] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:17:07.956740] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-26T17:17:08.756754] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-26T17:17:09.556743] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-26T17:17:09.760459] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T17:17:10.259381] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T17:17:10.358610] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-26T17:17:10.364603] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:17:11.156789] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-26T17:17:11.956814] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-26T17:17:12.095026] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T17:17:12.654308] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:17:12.756702] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-26T17:17:13.280415] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:17:13.556791] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-26T17:17:14.143149] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:17:14.356836] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-26T17:17:14.841989] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:17:15.031629] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T17:17:15.156819] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-26T17:17:15.956758] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-26T17:17:16.756752] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-26T17:17:16.812151] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T17:17:17.556774] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-26T17:17:17.648058] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:17:18.356719] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-26T17:17:18.688882] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T17:17:18.975094] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T17:17:19.156707] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-26T17:17:19.259819] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:17:19.956800] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-26T17:17:20.288337] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-26T17:17:20.761256] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-26T17:17:20.768213] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:17:21.556770] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-26T17:17:22.356819] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-26T17:17:22.485484] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:17:22.890151] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T17:17:23.156742] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-26T17:17:23.564151] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-26T17:17:23.765558] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T17:17:23.767593] [INFO ] [REMOTE ] AQNB: Full fetch complete (5886 records). [2025-09-26T17:17:23.767708] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-26T17:17:23.959963] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-26T17:17:24.178728] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-26T17:17:24.178821] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-26T17:17:24.179000] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-26T17:17:24.179042] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-26T17:17:24.179458] [DEBUG] [LOCAL ] AQNB: Trimmed 5886 records to 4228 (keeping 200 days of data) [2025-09-26T17:17:24.213553] [DEBUG] [LOCAL ] AQNB: Primary data saved (4228 records). [2025-09-26T17:17:24.213784] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-26T17:17:24.213903] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 22.5s. Estimated remaining: 4h 47m 24s. Rate: 7.8 symbols/min [2025-09-26T17:17:24.407298] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:24.459149] [DEBUG] [LOCAL ] ARCO: Loaded 44935 existing records from primary storage. [2025-09-26T17:17:24.459311] [INFO ] [MAIN ] ARCO: Loaded 44935 existing records. [2025-09-26T17:17:24.652435] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:24.653132] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-26T17:17:24.653195] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-26T17:17:24.654873] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-26T17:17:24.654938] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-26T17:17:24.763881] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-26T17:17:25.042835] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:25.556789] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-26T17:17:25.879912] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T17:17:26.356764] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-26T17:17:26.397679] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:17:26.410352] [INFO ] [REMOTE ] AQN: Full fetch complete (75281 records). [2025-09-26T17:17:26.410532] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-26T17:17:26.859164] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-26T17:17:26.859318] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-26T17:17:26.860233] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-26T17:17:26.860329] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-26T17:17:26.862452] [DEBUG] [LOCAL ] AQN: Trimmed 75281 records to 52684 (keeping 200 days of data) [2025-09-26T17:17:27.001522] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T17:17:27.157406] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-26T17:17:27.252116] [DEBUG] [LOCAL ] AQN: Primary data saved (52684 records). [2025-09-26T17:17:27.252343] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-26T17:17:27.252673] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. AQN took 34.5s. Estimated remaining: 4h 45m 60s. Rate: 7.8 symbols/min [2025-09-26T17:17:27.450513] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:27.472963] [DEBUG] [LOCAL ] ARDC: Loaded 14647 existing records from primary storage. [2025-09-26T17:17:27.473107] [INFO ] [MAIN ] ARDC: Loaded 14647 existing records. [2025-09-26T17:17:27.668782] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:27.669074] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-26T17:17:27.669126] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-26T17:17:27.669899] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-26T17:17:27.669976] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-26T17:17:27.961945] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-26T17:17:28.090228] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:28.189964] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:17:28.202306] [INFO ] [REMOTE ] APTV: Full fetch complete (76027 records). [2025-09-26T17:17:28.202490] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-26T17:17:28.663316] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-26T17:17:28.663436] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-26T17:17:28.664419] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-26T17:17:28.664552] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-26T17:17:28.667105] [DEBUG] [LOCAL ] APTV: Trimmed 76027 records to 52964 (keeping 200 days of data) [2025-09-26T17:17:28.768234] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-26T17:17:28.803691] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:17:29.082631] [DEBUG] [LOCAL ] APTV: Primary data saved (52964 records). [2025-09-26T17:17:29.083118] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-26T17:17:29.083264] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. APTV took 36.6s. Estimated remaining: 4h 44m 17s. Rate: 7.9 symbols/min [2025-09-26T17:17:29.385394] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:29.433208] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T17:17:29.485502] [DEBUG] [LOCAL ] ARDT: Loaded 28351 existing records from primary storage. [2025-09-26T17:17:29.485823] [INFO ] [MAIN ] ARDT: Loaded 28351 existing records. [2025-09-26T17:17:29.562002] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-26T17:17:29.771620] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:29.784418] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:17:29.783936] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-26T17:17:29.788616] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-26T17:17:29.789994] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-26T17:17:29.790063] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-26T17:17:30.216694] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:30.356763] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-26T17:17:30.841018] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T17:17:31.156767] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-26T17:17:31.364559] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T17:17:31.787858] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T17:17:31.956777] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-26T17:17:32.756769] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-26T17:17:33.511376] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:17:33.556704] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-26T17:17:33.694924] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:17:34.356744] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-26T17:17:34.839520] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T17:17:35.155298] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T17:17:35.157366] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-26T17:17:35.956727] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-26T17:17:35.985977] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:17:36.756737] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-26T17:17:37.556715] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-26T17:17:37.732325] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T17:17:37.927664] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-26T17:17:38.356775] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-26T17:17:39.156732] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-26T17:17:39.468559] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T17:17:39.531161] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T17:17:39.815159] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T17:17:39.956766] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-26T17:17:40.756712] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-26T17:17:40.975836] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T17:17:41.556724] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-26T17:17:42.124353] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T17:17:42.203708] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:17:42.356752] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-26T17:17:43.156790] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-26T17:17:43.956772] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-26T17:17:44.027680] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T17:17:44.063029] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T17:17:44.756754] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-26T17:17:45.202001] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T17:17:45.549116] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T17:17:45.556690] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-26T17:17:46.356744] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-26T17:17:47.016953] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:17:47.161330] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-26T17:17:47.163773] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T17:17:47.956750] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-26T17:17:48.756713] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-26T17:17:49.046568] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T17:17:49.058204] [INFO ] [REMOTE ] AR: Full fetch complete (77532 records). [2025-09-26T17:17:49.058396] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-26T17:17:49.494692] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-26T17:17:49.504490] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-26T17:17:49.522000] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-26T17:17:49.522152] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-26T17:17:49.525588] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:17:49.549761] [DEBUG] [LOCAL ] AR: Trimmed 77532 records to 54364 (keeping 200 days of data) [2025-09-26T17:17:49.550714] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T17:17:49.556974] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-26T17:17:49.898468] [DEBUG] [LOCAL ] AR: Primary data saved (54364 records). [2025-09-26T17:17:49.898694] [INFO ] [MAIN ] AR: Full history saved. [2025-09-26T17:17:49.902639] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 47.2s. Estimated remaining: 4h 47m 43s. Rate: 7.8 symbols/min [2025-09-26T17:17:50.088315] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:50.147473] [DEBUG] [LOCAL ] ARE: Loaded 50963 existing records from primary storage. [2025-09-26T17:17:50.147635] [INFO ] [MAIN ] ARE: Loaded 50963 existing records. [2025-09-26T17:17:50.357720] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-26T17:17:50.357946] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:50.359552] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-26T17:17:50.359629] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-26T17:17:50.361180] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-26T17:17:50.361249] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-26T17:17:50.760886] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:51.110616] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:17:51.119304] [INFO ] [REMOTE ] ARCO: Full fetch complete (65574 records). [2025-09-26T17:17:51.119477] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-26T17:17:51.164751] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-26T17:17:51.615107] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-26T17:17:51.615806] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T17:17:51.619602] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-26T17:17:51.620687] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-26T17:17:51.621200] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-26T17:17:51.625109] [DEBUG] [LOCAL ] ARCO: Trimmed 65574 records to 45249 (keeping 200 days of data) [2025-09-26T17:17:51.909518] [DEBUG] [LOCAL ] ARCO: Primary data saved (45249 records). [2025-09-26T17:17:51.909706] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-26T17:17:51.911191] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARCO took 27.7s. Estimated remaining: 4h 46m 3s. Rate: 7.8 symbols/min [2025-09-26T17:17:51.961817] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-26T17:17:52.114352] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:52.114526] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-09-26T17:17:52.114565] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-09-26T17:17:52.114743] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-26T17:17:52.114796] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-26T17:17:52.114839] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-09-26T17:17:52.114872] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-26T17:17:52.525124] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:52.633769] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:17:52.756743] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-26T17:17:53.556716] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-26T17:17:53.624832] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:17:53.645713] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T17:17:53.649864] [INFO ] [REMOTE ] ARDC: Full fetch complete (20449 records). [2025-09-26T17:17:53.649966] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-26T17:17:54.054258] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-26T17:17:54.054350] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-26T17:17:54.054703] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-26T17:17:54.054773] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-26T17:17:54.055746] [DEBUG] [LOCAL ] ARDC: Trimmed 20449 records to 14821 (keeping 200 days of data) [2025-09-26T17:17:54.156501] [DEBUG] [LOCAL ] ARDC: Primary data saved (14821 records). [2025-09-26T17:17:54.156759] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-26T17:17:54.156908] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARDC took 26.9s. Estimated remaining: 4h 44m 29s. Rate: 7.8 symbols/min [2025-09-26T17:17:54.346083] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:54.346304] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-09-26T17:17:54.346364] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-09-26T17:17:54.346518] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-26T17:17:54.346563] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-26T17:17:54.346610] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-09-26T17:17:54.346673] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-26T17:17:54.361868] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-26T17:17:54.600718] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T17:17:54.677289] [INFO ] [REMOTE ] ARDT: Full fetch complete (41190 records). [2025-09-26T17:17:54.680744] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-26T17:17:54.693748] [FATAL] [VALIDATOR ] ARDT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:17:54.704195] [FATAL] [MAIN ] ARDT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:17:54.709505] [WARN ] [MAIN ] ARDT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:17:54.728473] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-26T17:17:54.745300] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-09-26T17:17:54.767980] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:54.768347] [INFO ] [LOCAL ] ARDT: Starting deletion of derivative data. [2025-09-26T17:17:54.769208] [DEBUG] [LOCAL ] ARDT: Deleted derivative data file. [2025-09-26T17:17:54.769371] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 25.7s. Estimated remaining: 4h 42m 30s. Rate: 7.9 symbols/min [2025-09-26T17:17:54.957466] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:17:55.005857] [DEBUG] [LOCAL ] ARIS: Loaded 42320 existing records from primary storage. [2025-09-26T17:17:55.006017] [INFO ] [MAIN ] ARIS: Loaded 42320 existing records. [2025-09-26T17:17:55.161857] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-26T17:17:55.210070] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:17:55.210306] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-26T17:17:55.210356] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-26T17:17:55.211697] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-26T17:17:55.211915] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-26T17:17:55.599480] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:17:55.956735] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-26T17:17:56.192351] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T17:17:56.756744] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-26T17:17:56.950527] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T17:17:57.069691] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:17:57.556735] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-26T17:17:58.104352] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T17:17:58.356734] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-26T17:17:58.817065] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:17:59.156726] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-26T17:17:59.517758] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T17:17:59.956724] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-26T17:18:00.756738] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-26T17:18:01.201185] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T17:18:01.324611] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:18:01.556763] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-26T17:18:01.933830] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T17:18:02.356722] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-26T17:18:03.154262] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:18:03.164530] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-26T17:18:03.431715] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:18:03.956763] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-26T17:18:04.767804] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-26T17:18:04.772948] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T17:18:05.130843] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T17:18:05.556721] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-26T17:18:06.356775] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-26T17:18:06.519146] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:18:06.878216] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:18:07.156787] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-26T17:18:07.647989] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:18:07.956754] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-26T17:18:08.756715] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-26T17:18:08.804670] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T17:18:09.210711] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:18:09.556734] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-26T17:18:10.356691] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-26T17:18:10.447459] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T17:18:11.156705] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-26T17:18:11.312818] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T17:18:11.765580] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T17:18:11.956729] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-26T17:18:12.595739] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:18:12.756812] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-26T17:18:13.380714] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:18:13.556748] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-26T17:18:13.891519] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:18:14.356784] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-26T17:18:14.936861] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:18:15.156768] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-26T17:18:15.748136] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T17:18:15.956747] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-26T17:18:16.291978] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T17:18:16.756770] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-26T17:18:17.447158] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:18:17.556748] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-26T17:18:18.356718] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-26T17:18:18.593846] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T17:18:19.109761] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:18:19.156751] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-26T17:18:19.956744] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-26T17:18:20.013360] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:18:20.542666] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:18:20.756754] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-26T17:18:21.556847] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-26T17:18:22.143348] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-26T17:18:22.156978] [INFO ] [REMOTE ] ARIS: Full fetch complete (59771 records). [2025-09-26T17:18:22.157220] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-26T17:18:22.159048] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:18:22.159253] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:18:22.159315] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:18:22.159404] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-26T17:18:22.159489] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-26T17:18:22.159554] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-09-26T17:18:22.160287] [DEBUG] [LOCAL ] ARIS: Deleted derivative data file. [2025-09-26T17:18:22.160450] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARIS took 27.4s. Estimated remaining: 4h 47m 33s. Rate: 7.8 symbols/min [2025-09-26T17:18:22.357780] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-26T17:18:22.430285] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:22.477907] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:18:22.492686] [INFO ] [REMOTE ] ARES: Full fetch complete (70678 records). [2025-09-26T17:18:22.492950] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-26T17:18:22.724891] [DEBUG] [LOCAL ] ARLO: Loaded 44209 existing records from primary storage. [2025-09-26T17:18:22.742113] [INFO ] [MAIN ] ARLO: Loaded 44209 existing records. [2025-09-26T17:18:23.205209] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:18:23.222575] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-26T17:18:23.223087] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-26T17:18:23.222967] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-26T17:18:23.223231] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-26T17:18:23.224012] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-26T17:18:23.224139] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-26T17:18:23.225607] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-26T17:18:23.225724] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-26T17:18:23.231082] [DEBUG] [LOCAL ] ARES: Trimmed 70678 records to 50322 (keeping 200 days of data) [2025-09-26T17:18:23.737975] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:23.738823] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-26T17:18:23.793386] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-26T17:18:23.957206] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-26T17:18:24.065811] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T17:18:24.092731] [DEBUG] [LOCAL ] ARES: Primary data saved (50322 records). [2025-09-26T17:18:24.092940] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-26T17:18:24.093083] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 32.2s. Estimated remaining: 4h 45m 54s. Rate: 7.8 symbols/min [2025-09-26T17:18:24.281038] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:24.336626] [DEBUG] [LOCAL ] ARMK: Loaded 50735 existing records from primary storage. [2025-09-26T17:18:24.336808] [INFO ] [MAIN ] ARMK: Loaded 50735 existing records. [2025-09-26T17:18:24.524074] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:18:24.524330] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-26T17:18:24.524378] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-26T17:18:24.525896] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-26T17:18:24.525970] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-26T17:18:24.764986] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-26T17:18:24.934125] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:25.059189] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T17:18:25.556727] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-26T17:18:25.785376] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:18:25.796058] [INFO ] [REMOTE ] ARE: Full fetch complete (72589 records). [2025-09-26T17:18:25.796232] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-26T17:18:26.276741] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T17:18:26.275231] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-26T17:18:26.280044] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-26T17:18:26.286790] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-26T17:18:26.287067] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-26T17:18:26.288694] [DEBUG] [LOCAL ] ARE: Trimmed 72589 records to 51319 (keeping 200 days of data) [2025-09-26T17:18:26.358958] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-26T17:18:26.621508] [DEBUG] [LOCAL ] ARE: Primary data saved (51319 records). [2025-09-26T17:18:26.621783] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-26T17:18:26.622686] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARE took 36.7s. Estimated remaining: 4h 44m 27s. Rate: 7.8 symbols/min [2025-09-26T17:18:26.805167] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:26.805362] [DEBUG] [LOCAL ] AROC: No existing data file found in primary storage. [2025-09-26T17:18:26.805405] [WARN ] [MAIN ] AROC: No existing data found, performing full refresh instead. [2025-09-26T17:18:26.805632] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-26T17:18:26.805763] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-26T17:18:26.805844] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-09-26T17:18:26.805918] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-26T17:18:27.162116] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-26T17:18:27.222291] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:27.263365] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T17:18:27.795577] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T17:18:27.804024] [INFO ] [REMOTE ] ARI: Full fetch complete (62715 records). [2025-09-26T17:18:27.804163] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-26T17:18:27.961864] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-26T17:18:28.232912] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-26T17:18:28.233065] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-26T17:18:28.234578] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-26T17:18:28.234697] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-26T17:18:28.236382] [DEBUG] [LOCAL ] ARI: Trimmed 62715 records to 44009 (keeping 200 days of data) [2025-09-26T17:18:28.490902] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T17:18:28.552720] [DEBUG] [LOCAL ] ARI: Primary data saved (44009 records). [2025-09-26T17:18:28.552878] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-26T17:18:28.552992] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARI took 34.4s. Estimated remaining: 4h 42m 51s. Rate: 7.9 symbols/min [2025-09-26T17:18:28.731095] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:28.731270] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-09-26T17:18:28.731309] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-09-26T17:18:28.731459] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-26T17:18:28.731503] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-26T17:18:28.731545] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-09-26T17:18:28.731577] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-26T17:18:28.763132] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-26T17:18:29.145223] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:29.360430] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:18:29.556726] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-26T17:18:30.014357] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:18:30.356756] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-26T17:18:31.156771] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-26T17:18:31.467404] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T17:18:31.956768] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-26T17:18:32.117024] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T17:18:32.761942] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-26T17:18:32.782184] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:18:33.488837] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T17:18:33.556702] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-26T17:18:34.074291] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T17:18:34.356744] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-26T17:18:35.156711] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-26T17:18:35.487841] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-26T17:18:35.957130] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-26T17:18:35.962417] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T17:18:36.468189] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:18:36.756733] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-26T17:18:37.389570] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:18:37.556722] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-26T17:18:38.266813] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:18:38.356760] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-26T17:18:39.117925] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:18:39.156678] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-26T17:18:39.688634] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:18:39.956755] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-26T17:18:40.756738] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-26T17:18:41.355794] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-26T17:18:41.556706] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-26T17:18:41.622597] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T17:18:41.780117] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T17:18:42.356766] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-26T17:18:43.094590] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T17:18:43.156705] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-26T17:18:43.499108] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T17:18:43.956733] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-26T17:18:44.752448] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:18:44.762174] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-26T17:18:45.556700] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-26T17:18:45.795709] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T17:18:46.356703] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-26T17:18:46.452186] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T17:18:47.156731] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-26T17:18:47.359129] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T17:18:47.760103] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:18:47.956735] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-26T17:18:48.603804] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T17:18:48.756755] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-26T17:18:49.563441] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-26T17:18:49.584183] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T17:18:50.013364] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T17:18:50.356720] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-26T17:18:50.905801] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T17:18:51.156748] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-26T17:18:51.867437] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T17:18:51.956744] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-26T17:18:52.759592] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-26T17:18:52.765630] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T17:18:53.356574] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:18:53.556746] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-26T17:18:54.083283] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:18:54.093367] [INFO ] [REMOTE ] ARLO: Full fetch complete (62486 records). [2025-09-26T17:18:54.093548] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-26T17:18:54.364518] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-26T17:18:54.511624] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-26T17:18:54.511743] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-26T17:18:54.512415] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-26T17:18:54.512474] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-26T17:18:54.513920] [DEBUG] [LOCAL ] ARLO: Trimmed 62486 records to 44493 (keeping 200 days of data) [2025-09-26T17:18:54.785448] [DEBUG] [LOCAL ] ARLO: Primary data saved (44493 records). [2025-09-26T17:18:54.785577] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-26T17:18:54.785711] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. ARLO took 32.6s. Estimated remaining: 4h 47m 27s. Rate: 7.7 symbols/min [2025-09-26T17:18:54.973372] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:55.008525] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:18:55.049433] [DEBUG] [LOCAL ] ARW: Loaded 33429 existing records from primary storage. [2025-09-26T17:18:55.049583] [INFO ] [MAIN ] ARW: Loaded 33429 existing records. [2025-09-26T17:18:55.159072] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-26T17:18:55.244956] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:18:55.245195] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-26T17:18:55.245276] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-26T17:18:55.246451] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-26T17:18:55.246515] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-26T17:18:55.632019] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:55.956731] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-26T17:18:56.077518] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T17:18:56.756757] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-26T17:18:57.262413] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T17:18:57.273528] [INFO ] [REMOTE ] ARR: Full fetch complete (75155 records). [2025-09-26T17:18:57.273753] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-26T17:18:57.571607] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-26T17:18:57.639498] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T17:18:57.790092] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-26T17:18:57.790193] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-26T17:18:57.791075] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-26T17:18:57.791152] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-26T17:18:57.792881] [DEBUG] [LOCAL ] ARR: Trimmed 75155 records to 52809 (keeping 200 days of data) [2025-09-26T17:18:58.162737] [DEBUG] [LOCAL ] ARR: Primary data saved (52809 records). [2025-09-26T17:18:58.162891] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-26T17:18:58.162974] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARR took 29.6s. Estimated remaining: 4h 46m 13s. Rate: 7.8 symbols/min [2025-09-26T17:18:58.346806] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:58.347060] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-26T17:18:58.347124] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-26T17:18:58.347269] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-26T17:18:58.347312] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-26T17:18:58.347419] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-26T17:18:58.347468] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-26T17:18:58.361853] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-26T17:18:58.760988] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:18:58.775840] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T17:18:58.786025] [INFO ] [REMOTE ] AROC: Full fetch complete (70711 records). [2025-09-26T17:18:58.786205] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-26T17:18:59.157735] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-26T17:18:59.199161] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-26T17:18:59.199257] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-26T17:18:59.200031] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-26T17:18:59.200101] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-26T17:18:59.202058] [DEBUG] [LOCAL ] AROC: Trimmed 70711 records to 49733 (keeping 200 days of data) [2025-09-26T17:18:59.460082] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:18:59.461795] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-26T17:18:59.539525] [DEBUG] [LOCAL ] AROC: Primary data saved (49733 records). [2025-09-26T17:18:59.539711] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-26T17:18:59.539809] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. AROC took 32.9s. Estimated remaining: 4h 44m 30s. Rate: 7.8 symbols/min [2025-09-26T17:18:59.725479] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:18:59.726268] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-09-26T17:18:59.726383] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-09-26T17:18:59.726592] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-26T17:18:59.726668] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-26T17:18:59.726743] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-26T17:18:59.726781] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-26T17:18:59.957491] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-26T17:19:00.088785] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-26T17:19:00.126895] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T17:19:00.165707] [INFO ] [REMOTE ] ARMK: Full fetch complete (72561 records). [2025-09-26T17:19:00.172960] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-26T17:19:00.198116] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:00.367256] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:00.382457] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-26T17:19:00.630792] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-26T17:19:00.630886] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-26T17:19:00.631639] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-26T17:19:00.631739] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-26T17:19:00.633328] [DEBUG] [LOCAL ] ARMK: Trimmed 72561 records to 51112 (keeping 200 days of data) [2025-09-26T17:19:00.757104] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-26T17:19:00.995821] [DEBUG] [LOCAL ] ARMK: Primary data saved (51112 records). [2025-09-26T17:19:00.995969] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-26T17:19:00.998882] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARMK took 36.9s. Estimated remaining: 4h 42m 50s. Rate: 7.9 symbols/min [2025-09-26T17:19:01.190541] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:01.207109] [DEBUG] [LOCAL ] ASA: Loaded 13926 existing records from primary storage. [2025-09-26T17:19:01.207282] [INFO ] [MAIN ] ASA: Loaded 13926 existing records. [2025-09-26T17:19:01.405932] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:01.406197] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-26T17:19:01.406247] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-26T17:19:01.406955] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-26T17:19:01.407018] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-26T17:19:01.561999] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-26T17:19:01.805071] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:01.875957] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:01.876310] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-26T17:19:02.214446] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T17:19:02.356780] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-26T17:19:03.153578] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T17:19:03.156899] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-26T17:19:03.956769] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-26T17:19:04.171130] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:04.171487] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-26T17:19:04.296912] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:19:04.756775] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-26T17:19:04.968532] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:04.968944] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-26T17:19:05.556735] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-26T17:19:05.765841] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:05.766195] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-26T17:19:06.356745] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-26T17:19:06.566378] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:19:06.566729] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-26T17:19:07.156750] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-26T17:19:07.956735] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-26T17:19:07.999557] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T17:19:08.756739] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-26T17:19:09.051895] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:19:09.302879] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T17:19:09.556755] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-26T17:19:10.356731] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-26T17:19:10.932628] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:19:11.156764] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-26T17:19:11.462019] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T17:19:11.956738] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-26T17:19:12.566535] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:19:12.626401] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T17:19:12.756766] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-26T17:19:13.556745] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-26T17:19:14.356702] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-26T17:19:14.473670] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:19:14.486245] [INFO ] [REMOTE ] ARX: Full fetch complete (14288 records). [2025-09-26T17:19:14.486456] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-26T17:19:14.707768] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 46 unique days, need 200 days [2025-09-26T17:19:14.708093] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:19:14.708166] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:19:14.708242] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-26T17:19:14.708319] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-26T17:19:14.708360] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-26T17:19:14.708402] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-26T17:19:14.708471] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARX took 16.5s. Estimated remaining: 4h 44m 12s. Rate: 7.8 symbols/min [2025-09-26T17:19:14.914721] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:14.950993] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:19:15.008471] [DEBUG] [LOCAL ] ASAN: Loaded 53132 existing records from primary storage. [2025-09-26T17:19:15.008625] [INFO ] [MAIN ] ASAN: Loaded 53132 existing records. [2025-09-26T17:19:15.171270] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-26T17:19:15.217501] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:15.217798] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-26T17:19:15.217852] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-26T17:19:15.219432] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-26T17:19:15.219506] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-26T17:19:15.637989] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:15.684825] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T17:19:15.956771] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-26T17:19:16.756743] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-26T17:19:16.874463] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:19:17.556728] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-26T17:19:17.808835] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T17:19:17.903822] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T17:19:18.356733] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-26T17:19:19.069217] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:19:19.156776] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-26T17:19:19.897860] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T17:19:19.930417] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:19:19.956705] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-26T17:19:20.756770] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-26T17:19:21.531716] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T17:19:21.556672] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-26T17:19:21.779846] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:19:22.356731] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-26T17:19:22.943549] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T17:19:23.156753] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-26T17:19:23.823728] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T17:19:23.860372] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T17:19:23.956770] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-26T17:19:24.756732] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-26T17:19:25.556736] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-26T17:19:25.689790] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T17:19:26.102476] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T17:19:26.202252] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T17:19:26.356791] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-26T17:19:27.156761] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-26T17:19:27.611680] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:19:27.616491] [INFO ] [REMOTE ] ASA: Full fetch complete (18588 records). [2025-09-26T17:19:27.616614] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-26T17:19:27.961857] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-26T17:19:28.023369] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-26T17:19:28.023456] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-26T17:19:28.023793] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-26T17:19:28.023858] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-26T17:19:28.024560] [DEBUG] [LOCAL ] ASA: Trimmed 18588 records to 14109 (keeping 200 days of data) [2025-09-26T17:19:28.110620] [DEBUG] [LOCAL ] ASA: Primary data saved (14109 records). [2025-09-26T17:19:28.110802] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-26T17:19:28.110926] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ASA took 27.1s. Estimated remaining: 4h 45m 28s. Rate: 7.8 symbols/min [2025-09-26T17:19:28.290672] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:28.338638] [DEBUG] [LOCAL ] ASB: Loaded 49933 existing records from primary storage. [2025-09-26T17:19:28.338839] [INFO ] [MAIN ] ASB: Loaded 49933 existing records. [2025-09-26T17:19:28.529242] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:28.549377] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-26T17:19:28.550091] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-26T17:19:28.552505] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T17:19:28.559291] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-26T17:19:28.559979] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-26T17:19:28.758311] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-26T17:19:28.948716] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:29.556719] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-26T17:19:29.821980] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:19:29.855549] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:19:30.356740] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-26T17:19:31.033974] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T17:19:31.156728] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-26T17:19:31.285691] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:19:31.956770] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-26T17:19:32.548437] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T17:19:32.756741] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-26T17:19:33.454085] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:19:33.556734] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-26T17:19:34.351601] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:19:34.363630] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-26T17:19:34.838632] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T17:19:35.156793] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-26T17:19:35.956695] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-26T17:19:36.037729] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:19:36.756699] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-26T17:19:37.077073] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T17:19:37.088817] [INFO ] [REMOTE ] AS: Full fetch complete (76522 records). [2025-09-26T17:19:37.089046] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-26T17:19:37.249924] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:19:37.297777] [INFO ] [REMOTE ] ARW: Full fetch complete (47891 records). [2025-09-26T17:19:37.321796] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-26T17:19:37.558095] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-26T17:19:37.787718] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-26T17:19:37.790409] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-26T17:19:37.792627] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-26T17:19:37.792778] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-26T17:19:37.910149] [DEBUG] [LOCAL ] AS: Trimmed 76522 records to 53854 (keeping 200 days of data) [2025-09-26T17:19:38.112158] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-26T17:19:38.112378] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-26T17:19:38.113376] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-26T17:19:38.113826] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-26T17:19:38.118519] [DEBUG] [LOCAL ] ARW: Trimmed 47891 records to 33660 (keeping 200 days of data) [2025-09-26T17:19:38.252226] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T17:19:38.361180] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-26T17:19:38.522772] [DEBUG] [LOCAL ] ARW: Primary data saved (33660 records). [2025-09-26T17:19:38.524323] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-26T17:19:38.524474] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ARW took 43.7s. Estimated remaining: 4h 46m 0s. Rate: 7.8 symbols/min [2025-09-26T17:19:38.789137] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:38.792680] [DEBUG] [LOCAL ] ASBA: No existing data file found in primary storage. [2025-09-26T17:19:38.793288] [WARN ] [MAIN ] ASBA: No existing data found, performing full refresh instead. [2025-09-26T17:19:38.794943] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-26T17:19:38.795572] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-26T17:19:38.796277] [DEBUG] [LOCAL ] ASBA: No primary data file found to delete. [2025-09-26T17:19:38.796927] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-26T17:19:39.113297] [DEBUG] [LOCAL ] AS: Primary data saved (53854 records). [2025-09-26T17:19:39.144959] [INFO ] [MAIN ] AS: Full history saved. [2025-09-26T17:19:39.176405] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. AS took 39.6s. Estimated remaining: 4h 44m 10s. Rate: 7.8 symbols/min [2025-09-26T17:19:39.267538] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:39.273243] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-26T17:19:39.450798] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:39.482152] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-26T17:19:39.535365] [DEBUG] [LOCAL ] ASC: Loaded 37925 existing records from primary storage. [2025-09-26T17:19:39.535518] [INFO ] [MAIN ] ASC: Loaded 37925 existing records. [2025-09-26T17:19:39.728794] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:39.729074] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-26T17:19:39.729127] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-26T17:19:39.730249] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-26T17:19:39.730314] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-26T17:19:39.957236] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-26T17:19:39.972858] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T17:19:40.145786] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:40.176865] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T17:19:40.756758] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-26T17:19:41.556731] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-26T17:19:42.170725] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T17:19:42.174197] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-26T17:19:42.275217] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:19:42.356719] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-26T17:19:42.934914] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-26T17:19:43.156766] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-26T17:19:43.501281] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T17:19:43.956768] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-26T17:19:44.756750] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-26T17:19:45.556767] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-26T17:19:46.001759] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T17:19:46.064477] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T17:19:46.356741] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-26T17:19:46.733323] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T17:19:46.769497] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T17:19:47.156746] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-26T17:19:47.956815] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-26T17:19:48.532005] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:19:48.660260] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T17:19:48.756756] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-26T17:19:49.556747] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-26T17:19:50.272327] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T17:19:50.356732] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-26T17:19:51.156728] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-26T17:19:51.435932] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T17:19:51.864510] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:19:51.956781] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-26T17:19:52.756756] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-26T17:19:53.394840] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T17:19:53.407919] [INFO ] [REMOTE ] ASAN: Full fetch complete (76542 records). [2025-09-26T17:19:53.408126] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-26T17:19:53.560482] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-26T17:19:53.671263] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T17:19:53.913871] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-26T17:19:53.913965] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-26T17:19:53.914824] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-26T17:19:53.914897] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-26T17:19:53.916487] [DEBUG] [LOCAL ] ASAN: Trimmed 76542 records to 53512 (keeping 200 days of data) [2025-09-26T17:19:54.233954] [DEBUG] [LOCAL ] ASAN: Primary data saved (53512 records). [2025-09-26T17:19:54.234115] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-26T17:19:54.234212] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 39.5s. Estimated remaining: 4h 45m 48s. Rate: 7.8 symbols/min [2025-09-26T17:19:54.361842] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-26T17:19:54.428166] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:54.432578] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T17:19:54.454471] [DEBUG] [LOCAL ] ASG: Loaded 20501 existing records from primary storage. [2025-09-26T17:19:54.454618] [INFO ] [MAIN ] ASG: Loaded 20501 existing records. [2025-09-26T17:19:54.688206] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:54.688770] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-26T17:19:54.704872] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-26T17:19:54.718097] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-26T17:19:54.719446] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-26T17:19:54.719293] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T17:19:55.120434] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:55.156741] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-26T17:19:55.861719] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T17:19:55.956731] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-26T17:19:56.756746] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-26T17:19:57.008551] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T17:19:57.018844] [INFO ] [REMOTE ] ASB: Full fetch complete (71577 records). [2025-09-26T17:19:57.019055] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-26T17:19:57.474268] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-26T17:19:57.475137] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-26T17:19:57.476288] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-26T17:19:57.475388] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T17:19:57.476468] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-26T17:19:57.490270] [DEBUG] [LOCAL ] ASB: Trimmed 71577 records to 50299 (keeping 200 days of data) [2025-09-26T17:19:57.506963] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:19:57.568406] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-26T17:19:57.841825] [DEBUG] [LOCAL ] ASB: Primary data saved (50299 records). [2025-09-26T17:19:57.841982] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-26T17:19:57.842897] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASB took 29.7s. Estimated remaining: 4h 44m 41s. Rate: 7.8 symbols/min [2025-09-26T17:19:58.033814] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:19:58.059335] [DEBUG] [LOCAL ] ASGI: Loaded 22522 existing records from primary storage. [2025-09-26T17:19:58.059496] [INFO ] [MAIN ] ASGI: Loaded 22522 existing records. [2025-09-26T17:19:58.271757] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:19:58.272088] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-26T17:19:58.272139] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-26T17:19:58.273058] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-26T17:19:58.273124] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-26T17:19:58.361787] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-26T17:19:58.679925] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:19:58.837092] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:19:58.867210] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T17:19:59.156729] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-26T17:19:59.956743] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-26T17:20:00.295667] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T17:20:00.756777] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-26T17:20:01.068055] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T17:20:01.556740] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-26T17:20:01.883039] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:20:02.356738] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-26T17:20:02.813981] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:20:03.156766] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-26T17:20:03.630594] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:20:03.861710] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T17:20:03.863524] [INFO ] [REMOTE ] ASBA: Full fetch complete (5235 records). [2025-09-26T17:20:03.863674] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-26T17:20:03.961960] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-26T17:20:04.259523] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-26T17:20:04.259605] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-26T17:20:04.259865] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-26T17:20:04.259961] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-26T17:20:04.260404] [DEBUG] [LOCAL ] ASBA: Trimmed 5235 records to 3458 (keeping 200 days of data) [2025-09-26T17:20:04.283261] [DEBUG] [LOCAL ] ASBA: Primary data saved (3458 records). [2025-09-26T17:20:04.283404] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-26T17:20:04.283561] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASBA took 25.8s. Estimated remaining: 4h 44m 16s. Rate: 7.8 symbols/min [2025-09-26T17:20:04.466249] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:04.466463] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-09-26T17:20:04.466520] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-09-26T17:20:04.466714] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-26T17:20:04.466769] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-26T17:20:04.466815] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-09-26T17:20:04.466863] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-26T17:20:04.761992] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-26T17:20:04.850851] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:05.566243] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-26T17:20:05.574083] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:20:05.581419] [INFO ] [REMOTE ] ASC: Full fetch complete (56677 records). [2025-09-26T17:20:05.581550] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-26T17:20:05.584709] [FATAL] [VALIDATOR ] ASC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:20:05.584834] [FATAL] [MAIN ] ASC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:20:05.584910] [WARN ] [MAIN ] ASC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:20:05.584989] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-26T17:20:05.585067] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-09-26T17:20:05.585125] [INFO ] [LOCAL ] ASC: Starting deletion of derivative data. [2025-09-26T17:20:05.585598] [DEBUG] [LOCAL ] ASC: Deleted derivative data file. [2025-09-26T17:20:05.586865] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASC took 26.4s. Estimated remaining: 4h 42m 38s. Rate: 7.8 symbols/min [2025-09-26T17:20:06.356773] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-26T17:20:06.408970] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T17:20:06.810410] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T17:20:07.156777] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-26T17:20:07.602361] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:20:07.851482] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T17:20:07.956742] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-26T17:20:08.756776] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-26T17:20:09.250778] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:20:09.493995] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T17:20:09.556739] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-26T17:20:10.356708] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-26T17:20:10.515280] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T17:20:11.156758] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-26T17:20:11.448407] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T17:20:11.956742] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-26T17:20:12.289902] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T17:20:12.756748] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-26T17:20:13.556739] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-26T17:20:14.352028] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T17:20:14.361371] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-26T17:20:14.393464] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-26T17:20:14.468701] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T17:20:15.156773] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-26T17:20:15.691910] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:20:15.945010] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T17:20:15.949099] [INFO ] [REMOTE ] ASG: Full fetch complete (31171 records). [2025-09-26T17:20:15.949221] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-26T17:20:15.949870] [FATAL] [VALIDATOR ] ASG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:20:15.949995] [FATAL] [MAIN ] ASG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:20:15.950041] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:20:15.950092] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-26T17:20:15.950189] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-26T17:20:15.950316] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-09-26T17:20:15.951080] [DEBUG] [LOCAL ] ASG: Deleted derivative data file. [2025-09-26T17:20:15.951185] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASG took 21.7s. Estimated remaining: 4h 43m 8s. Rate: 7.8 symbols/min [2025-09-26T17:20:15.956679] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-26T17:20:16.756780] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-26T17:20:17.538382] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T17:20:17.556692] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-26T17:20:17.592483] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T17:20:18.356781] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-26T17:20:18.686392] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T17:20:19.156779] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-26T17:20:19.340280] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T17:20:19.874710] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T17:20:19.956754] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-26T17:20:20.756692] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-26T17:20:21.216341] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T17:20:21.556726] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-26T17:20:21.912834] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T17:20:22.356730] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-26T17:20:22.876639] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T17:20:23.156777] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-26T17:20:24.175935] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T17:20:24.185692] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-26T17:20:24.202356] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T17:20:24.756740] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-26T17:20:25.478908] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:20:25.486576] [INFO ] [REMOTE ] ASGN: Full fetch complete (51932 records). [2025-09-26T17:20:25.486734] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-26T17:20:25.908971] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-26T17:20:25.909118] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-26T17:20:25.909760] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-26T17:20:25.909843] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-26T17:20:25.925781] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T17:20:25.932877] [INFO ] [REMOTE ] ASGI: Full fetch complete (33468 records). [2025-09-26T17:20:25.933063] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-26T17:20:25.933271] [DEBUG] [LOCAL ] ASGN: Trimmed 51932 records to 36554 (keeping 200 days of data) [2025-09-26T17:20:26.469036] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-26T17:20:26.469415] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-26T17:20:26.470288] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-26T17:20:26.470672] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-26T17:20:26.474193] [DEBUG] [LOCAL ] ASGI: Trimmed 33468 records to 22711 (keeping 200 days of data) [2025-09-26T17:20:26.731991] [DEBUG] [LOCAL ] ASGI: Primary data saved (22711 records). [2025-09-26T17:20:26.732997] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-26T17:20:26.733193] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASGI took 28.9s. Estimated remaining: 4h 43m 44s. Rate: 7.8 symbols/min [2025-09-26T17:20:26.763927] [DEBUG] [LOCAL ] ASGN: Primary data saved (36554 records). [2025-09-26T17:20:26.764116] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-26T17:20:26.764209] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 22.5s. Estimated remaining: 4h 41m 50s. Rate: 7.8 symbols/min [2025-09-26T17:20:27.360857] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:27.533993] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:27.561528] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:27.539897] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:27.592503] [DEBUG] [LOCAL ] ASR: Loaded 9322 existing records from primary storage. [2025-09-26T17:20:27.592880] [INFO ] [MAIN ] ASR: Loaded 9322 existing records. [2025-09-26T17:20:27.691479] [DEBUG] [LOCAL ] ASIX: Loaded 22682 existing records from primary storage. [2025-09-26T17:20:27.714517] [INFO ] [MAIN ] ASIX: Loaded 22682 existing records. [2025-09-26T17:20:27.984725] [DEBUG] [LOCAL ] ASH: Loaded 38035 existing records from primary storage. [2025-09-26T17:20:28.076193] [INFO ] [MAIN ] ASH: Loaded 38035 existing records. [2025-09-26T17:20:28.104217] [DEBUG] [LOCAL ] ASPN: Loaded 49938 existing records from primary storage. [2025-09-26T17:20:28.204967] [INFO ] [MAIN ] ASPN: Loaded 49938 existing records. [2025-09-26T17:20:28.250095] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:20:28.313561] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-26T17:20:28.342226] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-26T17:20:28.440183] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-26T17:20:28.506811] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-26T17:20:28.523260] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:20:28.671541] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-26T17:20:28.778611] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-26T17:20:28.876814] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-26T17:20:28.876741] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:20:28.920104] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-26T17:20:28.920000] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-26T17:20:28.938822] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-26T17:20:28.955959] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-26T17:20:29.005720] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:20:28.970337] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-26T17:20:29.163900] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-26T17:20:29.223041] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-26T17:20:29.387945] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-26T17:20:29.414598] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-26T17:20:29.626195] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:29.651366] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-26T17:20:30.218050] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:30.313753] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:30.298911] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-26T17:20:30.327712] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-26T17:20:30.476037] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:30.476954] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T17:20:30.478987] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-26T17:20:30.479494] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-26T17:20:31.093909] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T17:20:31.096013] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-26T17:20:31.213311] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T17:20:31.217160] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-26T17:20:31.568453] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T17:20:31.570823] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-26T17:20:31.790752] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T17:20:31.956704] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-26T17:20:32.124899] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T17:20:32.143521] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T17:20:32.157018] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:20:32.756754] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-26T17:20:33.453859] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T17:20:33.556760] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-26T17:20:33.594600] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T17:20:34.356756] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-26T17:20:34.577007] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T17:20:35.156742] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-26T17:20:35.485700] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:20:35.956458] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T17:20:35.957334] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-26T17:20:36.756746] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-26T17:20:37.557884] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-26T17:20:37.564714] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T17:20:37.808597] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T17:20:38.303155] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T17:20:38.356736] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-26T17:20:39.156706] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-26T17:20:39.234680] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:20:39.956753] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-26T17:20:40.752944] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:20:40.761273] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-26T17:20:41.219579] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T17:20:41.556741] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-26T17:20:42.356695] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-26T17:20:42.367701] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T17:20:42.510387] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T17:20:43.156742] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-26T17:20:43.912859] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T17:20:43.956702] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-26T17:20:44.573046] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:20:44.756729] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-26T17:20:45.202686] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:20:45.304336] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T17:20:45.556767] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-26T17:20:46.356705] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-26T17:20:46.758569] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:20:47.156731] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-26T17:20:47.945754] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T17:20:47.956677] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-26T17:20:48.267332] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T17:20:48.756684] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-26T17:20:48.934801] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T17:20:49.556818] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-26T17:20:49.567277] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T17:20:49.570580] [INFO ] [REMOTE ] ASR: Full fetch complete (12375 records). [2025-09-26T17:20:49.570753] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-26T17:20:49.972752] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-26T17:20:49.972888] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-26T17:20:49.973388] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-26T17:20:49.973433] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-26T17:20:49.974049] [DEBUG] [LOCAL ] ASR: Trimmed 12375 records to 9381 (keeping 200 days of data) [2025-09-26T17:20:50.043756] [DEBUG] [LOCAL ] ASR: Primary data saved (9381 records). [2025-09-26T17:20:50.043999] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-26T17:20:50.044129] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASR took 23.3s. Estimated remaining: 4h 45m 17s. Rate: 7.7 symbols/min [2025-09-26T17:20:50.237676] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:50.237962] [DEBUG] [LOCAL ] ASX: No existing data file found in primary storage. [2025-09-26T17:20:50.238002] [WARN ] [MAIN ] ASX: No existing data found, performing full refresh instead. [2025-09-26T17:20:50.238162] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-26T17:20:50.238235] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-26T17:20:50.238279] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-09-26T17:20:50.238313] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-26T17:20:50.361858] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-26T17:20:50.662189] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:51.105507] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T17:20:51.156746] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-26T17:20:51.221871] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T17:20:51.226954] [INFO ] [REMOTE ] ASIX: Full fetch complete (29913 records). [2025-09-26T17:20:51.227156] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-26T17:20:51.639021] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-26T17:20:51.639144] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-26T17:20:51.639606] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-26T17:20:51.639695] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-26T17:20:51.640952] [DEBUG] [LOCAL ] ASIX: Trimmed 29913 records to 22834 (keeping 200 days of data) [2025-09-26T17:20:51.801356] [DEBUG] [LOCAL ] ASIX: Primary data saved (22834 records). [2025-09-26T17:20:51.801563] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-26T17:20:51.801770] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASIX took 25.0s. Estimated remaining: 4h 43m 47s. Rate: 7.8 symbols/min [2025-09-26T17:20:51.963158] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-26T17:20:52.000114] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:20:52.000304] [DEBUG] [LOCAL ] ATEN: No existing data file found in primary storage. [2025-09-26T17:20:52.000359] [WARN ] [MAIN ] ATEN: No existing data found, performing full refresh instead. [2025-09-26T17:20:52.000542] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-26T17:20:52.000604] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-26T17:20:52.000699] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-09-26T17:20:52.000759] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-26T17:20:52.411730] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:20:52.439716] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T17:20:52.756726] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-26T17:20:53.398751] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:20:53.556719] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-26T17:20:53.960706] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T17:20:54.356757] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-26T17:20:55.010104] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T17:20:55.156778] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-26T17:20:55.448986] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T17:20:55.956751] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-26T17:20:56.464238] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T17:20:56.756767] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-26T17:20:57.546847] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:20:57.558530] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-26T17:20:58.233446] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T17:20:58.356774] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-26T17:20:59.156713] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-26T17:20:59.335747] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T17:20:59.689422] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:20:59.696880] [INFO ] [REMOTE ] ASH: Full fetch complete (54837 records). [2025-09-26T17:20:59.697021] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-26T17:20:59.962060] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-26T17:21:00.136167] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-26T17:21:00.136293] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-26T17:21:00.137158] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-26T17:21:00.137230] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-26T17:21:00.138755] [DEBUG] [LOCAL ] ASH: Trimmed 54837 records to 38339 (keeping 200 days of data) [2025-09-26T17:21:00.391608] [DEBUG] [LOCAL ] ASH: Primary data saved (38339 records). [2025-09-26T17:21:00.391803] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-26T17:21:00.391976] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASH took 33.6s. Estimated remaining: 4h 43m 52s. Rate: 7.8 symbols/min [2025-09-26T17:21:00.593460] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:00.630673] [DEBUG] [LOCAL ] ATGE: Loaded 32073 existing records from primary storage. [2025-09-26T17:21:00.630834] [INFO ] [MAIN ] ATGE: Loaded 32073 existing records. [2025-09-26T17:21:00.761970] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-26T17:21:00.844572] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:00.844920] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-26T17:21:00.844971] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-26T17:21:00.846151] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-26T17:21:00.846221] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-26T17:21:01.267009] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:01.302399] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-26T17:21:01.556752] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-26T17:21:01.938618] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T17:21:02.276717] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T17:21:02.356728] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-26T17:21:02.912693] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:21:03.156752] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-26T17:21:03.957686] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-26T17:21:03.964928] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:21:04.131750] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T17:21:04.756763] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-26T17:21:05.137510] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T17:21:05.556817] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-26T17:21:06.356734] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-26T17:21:06.718032] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T17:21:07.156721] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-26T17:21:07.348016] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:21:07.836202] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T17:21:07.956772] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-26T17:21:08.175063] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:21:08.756873] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-26T17:21:09.556739] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-26T17:21:09.746075] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T17:21:09.756617] [INFO ] [REMOTE ] ASPN: Full fetch complete (72282 records). [2025-09-26T17:21:09.756847] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-26T17:21:10.361556] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-26T17:21:10.419243] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:21:10.454032] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-26T17:21:10.454310] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-26T17:21:10.455104] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-26T17:21:10.455222] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-26T17:21:10.457005] [DEBUG] [LOCAL ] ASPN: Trimmed 72282 records to 50293 (keeping 200 days of data) [2025-09-26T17:21:10.764352] [DEBUG] [LOCAL ] ASPN: Primary data saved (50293 records). [2025-09-26T17:21:10.764515] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-26T17:21:10.765787] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 44.0s. Estimated remaining: 4h 44m 20s. Rate: 7.8 symbols/min [2025-09-26T17:21:10.964660] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:11.002735] [DEBUG] [LOCAL ] ATHM: Loaded 32842 existing records from primary storage. [2025-09-26T17:21:11.002918] [INFO ] [MAIN ] ATHM: Loaded 32842 existing records. [2025-09-26T17:21:11.161855] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-26T17:21:11.211342] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:11.211633] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-26T17:21:11.211744] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-26T17:21:11.212625] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-26T17:21:11.212732] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-26T17:21:11.638640] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:11.714480] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T17:21:11.730374] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:21:11.956774] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-26T17:21:12.366546] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T17:21:12.756748] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-26T17:21:13.556739] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-26T17:21:13.761038] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:21:14.356773] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-26T17:21:14.577091] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T17:21:14.829319] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:21:14.837465] [INFO ] [REMOTE ] ATEN: Full fetch complete (57407 records). [2025-09-26T17:21:14.837681] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-26T17:21:15.161878] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-26T17:21:15.248897] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-26T17:21:15.248989] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-26T17:21:15.249659] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-26T17:21:15.249744] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-26T17:21:15.251101] [DEBUG] [LOCAL ] ATEN: Trimmed 57407 records to 40398 (keeping 200 days of data) [2025-09-26T17:21:15.519127] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T17:21:15.558574] [DEBUG] [LOCAL ] ATEN: Primary data saved (40398 records). [2025-09-26T17:21:15.558736] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-26T17:21:15.558825] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ATEN took 23.8s. Estimated remaining: 4h 43m 33s. Rate: 7.8 symbols/min [2025-09-26T17:21:15.761739] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:15.762024] [DEBUG] [LOCAL ] ATHS: No existing data file found in primary storage. [2025-09-26T17:21:15.762101] [WARN ] [MAIN ] ATHS: No existing data found, performing full refresh instead. [2025-09-26T17:21:15.762342] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-26T17:21:15.762413] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-26T17:21:15.762494] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-09-26T17:21:15.762559] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-26T17:21:15.967843] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-26T17:21:16.156691] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:16.729207] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T17:21:16.756721] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-26T17:21:17.227328] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:21:17.556752] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-26T17:21:18.325579] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:21:18.356727] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-26T17:21:18.963036] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T17:21:19.156779] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-26T17:21:19.956783] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-26T17:21:20.009500] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T17:21:20.263249] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T17:21:20.278845] [INFO ] [REMOTE ] ASX: Full fetch complete (76613 records). [2025-09-26T17:21:20.279023] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-26T17:21:20.767881] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-26T17:21:20.851970] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-26T17:21:20.852089] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-26T17:21:20.853081] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-26T17:21:20.853240] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-26T17:21:20.855388] [DEBUG] [LOCAL ] ASX: Trimmed 76613 records to 53639 (keeping 200 days of data) [2025-09-26T17:21:21.351008] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T17:21:21.391799] [DEBUG] [LOCAL ] ASX: Primary data saved (53639 records). [2025-09-26T17:21:21.391976] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-26T17:21:21.392107] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ASX took 31.3s. Estimated remaining: 4h 43m 0s. Rate: 7.8 symbols/min [2025-09-26T17:21:21.561431] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-26T17:21:21.645833] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:21.701443] [DEBUG] [LOCAL ] ATI: Loaded 51903 existing records from primary storage. [2025-09-26T17:21:21.701636] [INFO ] [MAIN ] ATI: Loaded 51903 existing records. [2025-09-26T17:21:21.916440] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:21.917145] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-26T17:21:21.917216] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-26T17:21:21.918740] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-26T17:21:21.918807] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-26T17:21:22.163067] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T17:21:22.345763] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:22.363487] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-26T17:21:22.368353] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:21:23.156741] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-26T17:21:23.957298] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-26T17:21:23.960851] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T17:21:24.396918] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T17:21:24.431053] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:21:24.756764] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-26T17:21:25.556736] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-26T17:21:26.318433] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:21:26.356718] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-26T17:21:26.867635] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T17:21:27.156757] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-26T17:21:27.786849] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T17:21:27.956798] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-26T17:21:28.610966] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:21:28.756791] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-26T17:21:29.535954] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T17:21:29.556690] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-26T17:21:29.787615] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T17:21:30.128909] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T17:21:30.356753] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-26T17:21:30.850789] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:21:31.156752] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-26T17:21:31.929216] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:21:31.956706] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-26T17:21:32.679153] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T17:21:32.756759] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-26T17:21:33.556721] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-26T17:21:34.008293] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T17:21:34.356736] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-26T17:21:35.156793] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-26T17:21:35.298747] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T17:21:35.405326] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T17:21:35.565276] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-26T17:21:35.956756] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-26T17:21:36.756752] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-26T17:21:37.524837] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T17:21:37.526586] [INFO ] [REMOTE ] ATHS: Full fetch complete (10052 records). [2025-09-26T17:21:37.526693] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-26T17:21:37.559637] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-26T17:21:37.935231] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-26T17:21:37.935421] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-26T17:21:37.935791] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-26T17:21:37.935877] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-26T17:21:37.965758] [DEBUG] [LOCAL ] ATHS: Trimmed 10052 records to 7145 (keeping 200 days of data) [2025-09-26T17:21:37.988599] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T17:21:38.033616] [DEBUG] [LOCAL ] ATHS: Primary data saved (7145 records). [2025-09-26T17:21:38.033793] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-26T17:21:38.033893] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATHS took 22.5s. Estimated remaining: 4h 44m 50s. Rate: 7.7 symbols/min [2025-09-26T17:21:38.224107] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:38.265636] [DEBUG] [LOCAL ] ATKR: Loaded 35914 existing records from primary storage. [2025-09-26T17:21:38.265840] [INFO ] [MAIN ] ATKR: Loaded 35914 existing records. [2025-09-26T17:21:38.365506] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-26T17:21:38.461067] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:38.461489] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-26T17:21:38.461550] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-26T17:21:38.462785] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-26T17:21:38.462852] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-26T17:21:38.882627] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:38.907014] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T17:21:39.156750] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-26T17:21:39.732009] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T17:21:39.956760] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-26T17:21:40.154834] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:21:40.160138] [INFO ] [REMOTE ] ATHM: Full fetch complete (51599 records). [2025-09-26T17:21:40.160269] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-26T17:21:40.574462] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-26T17:21:40.574561] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-26T17:21:40.575155] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-26T17:21:40.575220] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-26T17:21:40.576464] [DEBUG] [LOCAL ] ATHM: Trimmed 51599 records to 33015 (keeping 200 days of data) [2025-09-26T17:21:40.761412] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-26T17:21:40.788836] [DEBUG] [LOCAL ] ATHM: Primary data saved (33015 records). [2025-09-26T17:21:40.789001] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-26T17:21:40.792001] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ATHM took 30.0s. Estimated remaining: 4h 43m 37s. Rate: 7.8 symbols/min [2025-09-26T17:21:40.972481] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:40.972695] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-09-26T17:21:40.972752] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-09-26T17:21:40.972895] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-26T17:21:40.972938] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-26T17:21:40.972980] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-09-26T17:21:40.973013] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-26T17:21:41.386983] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:41.504263] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T17:21:41.556709] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-26T17:21:42.356743] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-26T17:21:42.618584] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T17:21:42.973926] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T17:21:43.156738] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-26T17:21:43.753994] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:21:43.956724] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-26T17:21:44.648890] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T17:21:44.756740] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-26T17:21:45.295707] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:21:45.556746] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-26T17:21:45.856407] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T17:21:46.356732] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-26T17:21:47.125557] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:21:47.156724] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-26T17:21:47.662007] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:21:47.956780] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-26T17:21:48.167913] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T17:21:48.756791] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-26T17:21:49.539136] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:21:49.556673] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-26T17:21:49.888297] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:21:50.356763] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-26T17:21:51.156738] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-26T17:21:51.409799] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T17:21:51.665239] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T17:21:51.956785] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-26T17:21:52.246746] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:21:52.756786] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-26T17:21:53.563949] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-26T17:21:53.581784] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:21:53.593476] [INFO ] [REMOTE ] ATI: Full fetch complete (73906 records). [2025-09-26T17:21:53.593883] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-26T17:21:53.730202] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:21:54.054050] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-26T17:21:54.054146] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-26T17:21:54.054964] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-26T17:21:54.055045] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-26T17:21:54.056958] [DEBUG] [LOCAL ] ATI: Trimmed 73906 records to 52283 (keeping 200 days of data) [2025-09-26T17:21:54.357997] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-26T17:21:54.371066] [DEBUG] [LOCAL ] ATI: Primary data saved (52283 records). [2025-09-26T17:21:54.371420] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-26T17:21:54.371542] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATI took 33.0s. Estimated remaining: 4h 44m 46s. Rate: 7.7 symbols/min [2025-09-26T17:21:54.574071] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:54.636397] [DEBUG] [LOCAL ] ATO: Loaded 42204 existing records from primary storage. [2025-09-26T17:21:54.636634] [INFO ] [MAIN ] ATO: Loaded 42204 existing records. [2025-09-26T17:21:54.843040] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:54.843296] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-26T17:21:54.843353] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-26T17:21:54.845030] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-26T17:21:54.845107] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-26T17:21:55.119547] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:21:55.162110] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-26T17:21:55.187880] [INFO ] [REMOTE ] ATGE: Full fetch complete (46245 records). [2025-09-26T17:21:55.193529] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-26T17:21:55.477986] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:55.812681] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-26T17:21:55.812894] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-26T17:21:55.813557] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-26T17:21:55.813680] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-26T17:21:55.837870] [DEBUG] [LOCAL ] ATGE: Trimmed 46245 records to 32251 (keeping 200 days of data) [2025-09-26T17:21:55.838702] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T17:21:55.958946] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-26T17:21:56.058204] [DEBUG] [LOCAL ] ATGE: Primary data saved (32251 records). [2025-09-26T17:21:56.058474] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-26T17:21:56.061881] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATGE took 55.7s. Estimated remaining: 4h 43m 19s. Rate: 7.8 symbols/min [2025-09-26T17:21:56.270210] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:21:56.315149] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T17:21:56.336479] [DEBUG] [LOCAL ] ATR: Loaded 30652 existing records from primary storage. [2025-09-26T17:21:56.336687] [INFO ] [MAIN ] ATR: Loaded 30652 existing records. [2025-09-26T17:21:56.570846] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:21:56.571142] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-26T17:21:56.571192] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-26T17:21:56.572331] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-26T17:21:56.572398] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-26T17:21:56.761879] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-26T17:21:56.965318] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:21:57.064989] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T17:21:57.556729] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-26T17:21:58.181144] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T17:21:58.356749] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-26T17:21:58.529951] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T17:21:59.156768] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-26T17:21:59.676295] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:21:59.956750] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-26T17:22:00.088308] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:22:00.756795] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-26T17:22:01.399253] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:22:01.556917] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-26T17:22:01.854716] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T17:22:02.356758] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-26T17:22:03.103824] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T17:22:03.156694] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-26T17:22:03.956707] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-26T17:22:04.057546] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:22:04.756773] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-26T17:22:04.805893] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:22:04.815620] [INFO ] [REMOTE ] ATKR: Full fetch complete (53681 records). [2025-09-26T17:22:04.815886] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-26T17:22:05.281162] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-26T17:22:05.281307] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-26T17:22:05.282026] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-26T17:22:05.282117] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-26T17:22:05.303163] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T17:22:05.302265] [DEBUG] [LOCAL ] ATKR: Trimmed 53681 records to 36196 (keeping 200 days of data) [2025-09-26T17:22:05.536837] [DEBUG] [LOCAL ] ATKR: Primary data saved (36196 records). [2025-09-26T17:22:05.537026] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-26T17:22:05.537177] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATKR took 27.5s. Estimated remaining: 4h 43m 34s. Rate: 7.8 symbols/min [2025-09-26T17:22:05.561905] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-26T17:22:05.730427] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:05.748593] [DEBUG] [LOCAL ] ATS: Loaded 18022 existing records from primary storage. [2025-09-26T17:22:05.748776] [INFO ] [MAIN ] ATS: Loaded 18022 existing records. [2025-09-26T17:22:05.940493] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:05.940789] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-26T17:22:05.940845] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-26T17:22:05.941530] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-26T17:22:05.941607] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-26T17:22:06.330901] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:06.356731] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-26T17:22:06.547860] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:22:06.955216] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T17:22:07.156699] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-26T17:22:07.173582] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T17:22:07.956785] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-26T17:22:08.544764] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:22:08.756782] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-26T17:22:09.332464] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:22:09.556732] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-26T17:22:10.098436] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T17:22:10.107868] [INFO ] [REMOTE ] ATMU: Full fetch complete (56938 records). [2025-09-26T17:22:10.108063] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-26T17:22:10.361960] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-26T17:22:10.542166] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-26T17:22:10.542295] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-26T17:22:10.543032] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-26T17:22:10.543104] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-26T17:22:10.544677] [DEBUG] [LOCAL ] ATMU: Trimmed 56938 records to 40274 (keeping 200 days of data) [2025-09-26T17:22:10.810550] [DEBUG] [LOCAL ] ATMU: Primary data saved (40274 records). [2025-09-26T17:22:10.810857] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-26T17:22:10.811069] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATMU took 30.0s. Estimated remaining: 4h 42m 55s. Rate: 7.8 symbols/min [2025-09-26T17:22:10.989625] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:10.990114] [DEBUG] [LOCAL ] ATUS: No existing data file found in primary storage. [2025-09-26T17:22:10.990282] [WARN ] [MAIN ] ATUS: No existing data found, performing full refresh instead. [2025-09-26T17:22:10.990531] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-26T17:22:10.990757] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-26T17:22:10.990965] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-26T17:22:10.991022] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-26T17:22:11.161709] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-26T17:22:11.177425] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T17:22:11.442342] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:11.771223] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T17:22:11.904932] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T17:22:11.956698] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-26T17:22:12.756721] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-26T17:22:13.067121] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T17:22:13.556756] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-26T17:22:14.134085] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:22:14.356799] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-26T17:22:14.684871] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T17:22:15.156786] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-26T17:22:15.956808] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-26T17:22:16.116193] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:22:16.384533] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T17:22:16.625748] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T17:22:16.756827] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-26T17:22:17.556746] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-26T17:22:17.986395] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T17:22:18.356737] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-26T17:22:18.835034] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T17:22:19.156742] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-26T17:22:19.786180] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T17:22:19.794439] [INFO ] [REMOTE ] ATO: Full fetch complete (60452 records). [2025-09-26T17:22:19.794582] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-26T17:22:19.963333] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-26T17:22:20.224447] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-26T17:22:20.224825] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-26T17:22:20.225530] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-26T17:22:20.225628] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-26T17:22:20.227429] [DEBUG] [LOCAL ] ATO: Trimmed 60452 records to 42489 (keeping 200 days of data) [2025-09-26T17:22:20.383940] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T17:22:20.536115] [DEBUG] [LOCAL ] ATO: Primary data saved (42489 records). [2025-09-26T17:22:20.536284] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-26T17:22:20.536387] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATO took 26.2s. Estimated remaining: 4h 43m 13s. Rate: 7.8 symbols/min [2025-09-26T17:22:20.720338] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:20.734723] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T17:22:20.756762] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-26T17:22:20.798708] [DEBUG] [LOCAL ] AU: Loaded 53326 existing records from primary storage. [2025-09-26T17:22:20.798876] [INFO ] [MAIN ] AU: Loaded 53326 existing records. [2025-09-26T17:22:21.023487] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:21.023857] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-26T17:22:21.023928] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-26T17:22:21.025809] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-26T17:22:21.025877] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-26T17:22:21.516800] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:21.556735] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-26T17:22:22.357159] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-26T17:22:22.363433] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T17:22:22.385377] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:22:23.156733] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-26T17:22:23.956707] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-26T17:22:24.366032] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T17:22:24.405958] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T17:22:24.756768] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-26T17:22:25.556747] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-26T17:22:25.595100] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:22:25.674885] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T17:22:26.356790] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-26T17:22:26.717763] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T17:22:27.159762] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-26T17:22:27.163751] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T17:22:27.167817] [INFO ] [REMOTE ] ATS: Full fetch complete (25623 records). [2025-09-26T17:22:27.167931] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-26T17:22:27.643018] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-26T17:22:27.643214] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-26T17:22:27.643850] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-26T17:22:27.643971] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-26T17:22:27.650345] [DEBUG] [LOCAL ] ATS: Trimmed 25623 records to 18145 (keeping 200 days of data) [2025-09-26T17:22:27.843598] [DEBUG] [LOCAL ] ATS: Primary data saved (18145 records). [2025-09-26T17:22:27.843883] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-26T17:22:27.844261] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATS took 22.3s. Estimated remaining: 4h 42m 60s. Rate: 7.8 symbols/min [2025-09-26T17:22:27.961918] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-26T17:22:28.089226] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:28.142617] [DEBUG] [LOCAL ] AUB: Loaded 46780 existing records from primary storage. [2025-09-26T17:22:28.142818] [INFO ] [MAIN ] AUB: Loaded 46780 existing records. [2025-09-26T17:22:28.349269] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:28.358114] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-26T17:22:28.369976] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-26T17:22:28.371767] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T17:22:28.378586] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-26T17:22:28.379067] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-26T17:22:28.761918] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-26T17:22:28.795297] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:29.556735] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-26T17:22:29.933206] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T17:22:30.196630] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:22:30.356747] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-26T17:22:31.156741] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-26T17:22:31.323839] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T17:22:31.748847] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:22:31.956759] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-26T17:22:32.482083] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:22:32.756731] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-26T17:22:33.509419] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T17:22:33.556747] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-26T17:22:34.026616] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:22:34.356752] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-26T17:22:34.761517] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T17:22:35.156752] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-26T17:22:35.589171] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T17:22:35.597357] [INFO ] [REMOTE ] ATR: Full fetch complete (43440 records). [2025-09-26T17:22:35.597479] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-26T17:22:35.965463] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-26T17:22:36.018714] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-26T17:22:36.018815] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-26T17:22:36.019349] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-26T17:22:36.019399] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-26T17:22:36.022697] [DEBUG] [LOCAL ] ATR: Trimmed 43440 records to 30839 (keeping 200 days of data) [2025-09-26T17:22:36.251524] [DEBUG] [LOCAL ] ATR: Primary data saved (30839 records). [2025-09-26T17:22:36.251729] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-26T17:22:36.252580] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATR took 40.2s. Estimated remaining: 4h 43m 1s. Rate: 7.8 symbols/min [2025-09-26T17:22:36.446818] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:36.455596] [DEBUG] [LOCAL ] AUNA: Loaded 4907 existing records from primary storage. [2025-09-26T17:22:36.455761] [INFO ] [MAIN ] AUNA: Loaded 4907 existing records. [2025-09-26T17:22:36.654799] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:36.655096] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-26T17:22:36.655146] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-26T17:22:36.655681] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-26T17:22:36.655747] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-26T17:22:36.761860] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-26T17:22:37.079221] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:37.110486] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T17:22:37.152677] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T17:22:37.556732] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-26T17:22:38.356795] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-26T17:22:38.620970] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:22:39.069329] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:22:39.156931] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-26T17:22:39.956720] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-26T17:22:40.225682] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T17:22:40.481214] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T17:22:40.756724] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-26T17:22:41.354169] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T17:22:41.556718] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-26T17:22:42.356756] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-26T17:22:42.542326] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T17:22:42.851360] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:22:42.945254] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T17:22:43.156739] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-26T17:22:43.956738] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-26T17:22:44.573225] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T17:22:44.756730] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-26T17:22:45.551554] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T17:22:45.561000] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-26T17:22:45.562952] [INFO ] [REMOTE ] ATUS: Full fetch complete (70932 records). [2025-09-26T17:22:45.563159] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-26T17:22:46.022447] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-26T17:22:46.022831] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-26T17:22:46.024114] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-26T17:22:46.024423] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-26T17:22:46.044589] [DEBUG] [LOCAL ] ATUS: Trimmed 70932 records to 49958 (keeping 200 days of data) [2025-09-26T17:22:46.059924] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:22:46.362329] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-26T17:22:46.398983] [DEBUG] [LOCAL ] ATUS: Primary data saved (49958 records). [2025-09-26T17:22:46.399102] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-26T17:22:46.399188] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. ATUS took 35.6s. Estimated remaining: 4h 43m 23s. Rate: 7.7 symbols/min [2025-09-26T17:22:46.578218] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:46.620079] [DEBUG] [LOCAL ] AVA: Loaded 39928 existing records from primary storage. [2025-09-26T17:22:46.620266] [INFO ] [MAIN ] AVA: Loaded 39928 existing records. [2025-09-26T17:22:46.815144] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:46.815495] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-26T17:22:46.815561] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-26T17:22:46.816809] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-26T17:22:46.816873] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-26T17:22:46.940866] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T17:22:47.161821] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-26T17:22:47.228287] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:47.483337] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-26T17:22:47.956735] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-26T17:22:48.632441] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:22:48.756734] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-26T17:22:49.556727] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-26T17:22:50.071277] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-26T17:22:50.278500] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T17:22:50.356748] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-26T17:22:50.925125] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T17:22:50.934799] [INFO ] [REMOTE ] AUB: Full fetch complete (65529 records). [2025-09-26T17:22:50.935024] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-26T17:22:51.157492] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-26T17:22:51.402256] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-26T17:22:51.402483] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-26T17:22:51.403613] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-26T17:22:51.403777] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-26T17:22:51.425345] [DEBUG] [LOCAL ] AUB: Trimmed 65529 records to 47072 (keeping 200 days of data) [2025-09-26T17:22:51.426159] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T17:22:51.737351] [DEBUG] [LOCAL ] AUB: Primary data saved (47072 records). [2025-09-26T17:22:51.737607] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-26T17:22:51.737785] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. AUB took 23.9s. Estimated remaining: 4h 42m 45s. Rate: 7.8 symbols/min [2025-09-26T17:22:51.930960] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:22:51.941227] [DEBUG] [LOCAL ] AVAL: Loaded 9011 existing records from primary storage. [2025-09-26T17:22:51.941359] [INFO ] [MAIN ] AVAL: Loaded 9011 existing records. [2025-09-26T17:22:51.962992] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-26T17:22:52.134424] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:22:52.134746] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-26T17:22:52.134805] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-26T17:22:52.135164] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-26T17:22:52.135227] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-26T17:22:52.522313] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:22:52.756783] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-26T17:22:53.322558] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-26T17:22:53.556790] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-26T17:22:54.357006] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-26T17:23:04.683243] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (11.93 seconds). [2025-09-26T17:23:04.685336] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-26T17:23:04.809175] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (11.25 seconds). [2025-09-26T17:23:04.811477] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-26T17:23:05.421569] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (13.46 seconds). [2025-09-26T17:23:05.428997] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-26T17:23:05.947087] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T17:23:05.948956] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-26T17:23:06.408378] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (12.05 seconds). [2025-09-26T17:23:06.440174] [INFO ] [REMOTE ] AU: Full fetch complete (75883 records). [2025-09-26T17:23:06.442830] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T17:23:06.441993] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-26T17:23:06.447893] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-26T17:23:06.449724] [FATAL] [VALIDATOR ] AU: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:23:06.449860] [FATAL] [MAIN ] AU: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:23:06.449940] [WARN ] [MAIN ] AU: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:23:06.450112] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-26T17:23:06.450249] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-09-26T17:23:06.450507] [INFO ] [LOCAL ] AU: Starting deletion of derivative data. [2025-09-26T17:23:06.451313] [DEBUG] [LOCAL ] AU: Deleted derivative data file. [2025-09-26T17:23:06.451510] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AU took 45.9s. Estimated remaining: 4h 44m 4s. Rate: 7.7 symbols/min [2025-09-26T17:23:06.652744] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:06.676305] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:23:06.679239] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-26T17:23:06.723390] [DEBUG] [LOCAL ] AVB: Loaded 42140 existing records from primary storage. [2025-09-26T17:23:06.724191] [INFO ] [MAIN ] AVB: Loaded 42140 existing records. [2025-09-26T17:23:07.025069] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:07.025348] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-26T17:23:07.025405] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-26T17:23:07.026674] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-26T17:23:07.026738] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-26T17:23:07.145730] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-26T17:23:07.163498] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-26T17:23:07.479313] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:07.489710] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-26T17:23:07.490891] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:23:07.505416] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-26T17:23:07.532924] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T17:23:07.545128] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-26T17:23:08.007828] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T17:23:08.010697] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-26T17:23:08.238604] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T17:23:08.243043] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-26T17:23:08.368475] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T17:23:08.370247] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-26T17:23:08.716532] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T17:23:08.732782] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-26T17:23:08.733019] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-26T17:23:08.736045] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-26T17:23:08.819739] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:23:08.827841] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-26T17:23:08.839755] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T17:23:08.843700] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-26T17:23:09.385506] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T17:23:09.387563] [INFO ] [REMOTE ] AUNA: Full fetch complete (7633 records). [2025-09-26T17:23:09.387638] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-26T17:23:09.727948] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T17:23:09.747764] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-26T17:23:09.830187] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-26T17:23:09.830280] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-26T17:23:09.830531] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-26T17:23:09.830594] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-26T17:23:09.831155] [DEBUG] [LOCAL ] AUNA: Trimmed 7633 records to 4966 (keeping 200 days of data) [2025-09-26T17:23:09.863696] [DEBUG] [LOCAL ] AUNA: Primary data saved (4966 records). [2025-09-26T17:23:09.863852] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-26T17:23:09.863969] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AUNA took 33.6s. Estimated remaining: 4h 43m 2s. Rate: 7.7 symbols/min [2025-09-26T17:23:10.089810] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:10.090576] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-26T17:23:10.090715] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-26T17:23:10.091371] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-26T17:23:10.091618] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-26T17:23:10.091943] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-26T17:23:10.092500] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-26T17:23:10.249030] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:23:10.296999] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-26T17:23:10.425109] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T17:23:10.509119] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-26T17:23:10.661125] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:10.662219] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T17:23:11.156738] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-26T17:23:11.755319] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T17:23:11.845758] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:23:11.956747] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-26T17:23:12.011611] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T17:23:12.756768] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-26T17:23:12.969389] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:12.969735] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-26T17:23:13.419970] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:23:13.556727] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-26T17:23:13.782269] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:13.782598] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-26T17:23:14.356786] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-26T17:23:15.156760] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-26T17:23:15.956760] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-26T17:23:16.084874] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:23:16.129246] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:23:16.168681] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:16.169038] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-26T17:23:16.756760] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-26T17:23:17.556755] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-26T17:23:17.997230] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T17:23:18.077367] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T17:23:18.080227] [INFO ] [REMOTE ] AVAL: Full fetch complete (14645 records). [2025-09-26T17:23:18.080321] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-26T17:23:18.361991] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-26T17:23:18.511277] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-26T17:23:18.511357] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-26T17:23:18.511622] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-26T17:23:18.511694] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-26T17:23:18.512229] [DEBUG] [LOCAL ] AVAL: Trimmed 14645 records to 9040 (keeping 200 days of data) [2025-09-26T17:23:18.570342] [DEBUG] [LOCAL ] AVAL: Primary data saved (9040 records). [2025-09-26T17:23:18.570705] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-26T17:23:18.570832] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVAL took 26.8s. Estimated remaining: 4h 43m 6s. Rate: 7.7 symbols/min [2025-09-26T17:23:18.668067] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:18.698524] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-26T17:23:18.783494] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:18.806795] [DEBUG] [LOCAL ] AVD: Loaded 22939 existing records from primary storage. [2025-09-26T17:23:18.806964] [INFO ] [MAIN ] AVD: Loaded 22939 existing records. [2025-09-26T17:23:19.061582] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:19.061866] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-26T17:23:19.061917] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-26T17:23:19.062928] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-26T17:23:19.062993] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-26T17:23:19.161881] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-26T17:23:19.538829] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:19.956747] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-26T17:23:20.668949] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:23:20.756769] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-26T17:23:21.425464] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:23:21.556732] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-26T17:23:21.764313] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:21.764688] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-26T17:23:22.145286] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:23:22.356753] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-26T17:23:23.156763] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-26T17:23:23.284356] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:23:23.956734] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-26T17:23:24.479967] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:23:24.488112] [INFO ] [REMOTE ] AVA: Full fetch complete (55713 records). [2025-09-26T17:23:24.488281] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-26T17:23:24.767144] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-26T17:23:24.947308] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-26T17:23:24.947445] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-26T17:23:24.948725] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-26T17:23:24.948834] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-26T17:23:24.950295] [DEBUG] [LOCAL ] AVA: Trimmed 55713 records to 40183 (keeping 200 days of data) [2025-09-26T17:23:25.202421] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T17:23:25.243618] [DEBUG] [LOCAL ] AVA: Primary data saved (40183 records). [2025-09-26T17:23:25.243786] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-26T17:23:25.244838] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 38.8s. Estimated remaining: 4h 42m 46s. Rate: 7.7 symbols/min [2025-09-26T17:23:25.468017] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:25.493683] [DEBUG] [LOCAL ] AVK: Loaded 17966 existing records from primary storage. [2025-09-26T17:23:25.493839] [INFO ] [MAIN ] AVK: Loaded 17966 existing records. [2025-09-26T17:23:25.561922] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-26T17:23:25.746623] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:25.747026] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-26T17:23:25.747113] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-26T17:23:25.747858] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-26T17:23:25.747927] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-26T17:23:25.872100] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:25.897597] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-26T17:23:26.350530] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:26.361859] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-26T17:23:26.383091] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T17:23:27.156778] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-26T17:23:27.334947] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T17:23:27.956754] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-26T17:23:28.173282] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:28.173625] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-26T17:23:28.451240] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:23:28.756759] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-26T17:23:29.556731] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-26T17:23:29.628208] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T17:23:29.757202] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:23:29.757548] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-26T17:23:30.356753] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-26T17:23:31.156806] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-26T17:23:31.737971] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T17:23:31.956718] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-26T17:23:32.079909] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T17:23:32.756712] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-26T17:23:32.897384] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T17:23:32.900503] [INFO ] [REMOTE ] AVBC: Full fetch complete (4719 records). [2025-09-26T17:23:32.900606] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-26T17:23:33.107734] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 40 unique days, need 200 days [2025-09-26T17:23:33.107977] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:23:33.108049] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:23:33.108125] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-26T17:23:33.108195] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-26T17:23:33.108232] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-26T17:23:33.108308] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-26T17:23:33.108394] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVBC took 23.2s. Estimated remaining: 4h 42m 39s. Rate: 7.7 symbols/min [2025-09-26T17:23:33.299931] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:33.348555] [DEBUG] [LOCAL ] AVNS: Loaded 33862 existing records from primary storage. [2025-09-26T17:23:33.348757] [INFO ] [MAIN ] AVNS: Loaded 33862 existing records. [2025-09-26T17:23:33.549782] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:33.550221] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-26T17:23:33.550308] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-26T17:23:33.551417] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-26T17:23:33.551485] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-26T17:23:33.563399] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-26T17:23:33.913838] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T17:23:33.996745] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:34.356731] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-26T17:23:35.163060] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-26T17:23:35.182098] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T17:23:35.235857] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T17:23:35.956718] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-26T17:23:36.113581] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:23:36.674798] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T17:23:36.756720] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-26T17:23:37.556743] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-26T17:23:37.706843] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T17:23:38.356728] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-26T17:23:38.743023] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-26T17:23:39.156780] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-26T17:23:39.633152] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T17:23:39.956801] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-26T17:23:40.541244] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T17:23:40.550387] [INFO ] [REMOTE ] AVB: Full fetch complete (58415 records). [2025-09-26T17:23:40.550523] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-26T17:23:40.761548] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-26T17:23:40.927173] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:23:41.027966] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-26T17:23:41.028079] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-26T17:23:41.028759] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-26T17:23:41.028840] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-26T17:23:41.030350] [DEBUG] [LOCAL ] AVB: Trimmed 58415 records to 42457 (keeping 200 days of data) [2025-09-26T17:23:41.315575] [DEBUG] [LOCAL ] AVB: Primary data saved (42457 records). [2025-09-26T17:23:41.315764] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-26T17:23:41.315896] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVB took 34.9s. Estimated remaining: 4h 42m 37s. Rate: 7.7 symbols/min [2025-09-26T17:23:41.509864] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:41.554780] [DEBUG] [LOCAL ] AVNT: Loaded 39555 existing records from primary storage. [2025-09-26T17:23:41.555001] [INFO ] [MAIN ] AVNT: Loaded 39555 existing records. [2025-09-26T17:23:41.567151] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-26T17:23:41.786746] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:23:41.787399] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-26T17:23:41.787473] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-26T17:23:41.789771] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-26T17:23:41.789836] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-26T17:23:42.231188] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T17:23:42.244207] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:42.341244] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T17:23:42.356696] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-26T17:23:43.156696] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-26T17:23:43.474606] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T17:23:43.862436] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T17:23:43.956770] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-26T17:23:44.756766] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-26T17:23:45.039504] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T17:23:45.556744] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-26T17:23:45.832193] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T17:23:46.356721] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-26T17:23:46.682200] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T17:23:46.686537] [INFO ] [REMOTE ] AVK: Full fetch complete (26501 records). [2025-09-26T17:23:46.686717] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-26T17:23:47.076015] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-26T17:23:47.076104] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-26T17:23:47.076487] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-26T17:23:47.076584] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-26T17:23:47.077580] [DEBUG] [LOCAL ] AVK: Trimmed 26501 records to 18064 (keeping 200 days of data) [2025-09-26T17:23:47.158723] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-26T17:23:47.193363] [DEBUG] [LOCAL ] AVK: Primary data saved (18064 records). [2025-09-26T17:23:47.193519] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-26T17:23:47.193615] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVK took 21.9s. Estimated remaining: 4h 42m 7s. Rate: 7.8 symbols/min [2025-09-26T17:23:47.375015] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:47.375158] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-09-26T17:23:47.375195] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-09-26T17:23:47.375343] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-26T17:23:47.375388] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-26T17:23:47.375430] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-09-26T17:23:47.375462] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-26T17:23:47.770243] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:23:47.793848] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:23:47.956758] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-26T17:23:48.268954] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:23:48.756726] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-26T17:23:49.556719] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-26T17:23:49.704448] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T17:23:50.257987] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T17:23:50.356794] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-26T17:23:51.043145] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:23:51.156788] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-26T17:23:51.893264] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T17:23:51.956757] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-26T17:23:52.484076] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T17:23:52.756748] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-26T17:23:53.222351] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:23:53.556734] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-26T17:23:53.821786] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:23:54.356740] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-26T17:23:54.596857] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T17:23:55.156825] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-26T17:23:55.465202] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T17:23:55.956815] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-26T17:23:56.644525] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:23:56.756771] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-26T17:23:57.561870] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-26T17:23:57.588298] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:23:57.698734] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T17:23:58.356740] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-26T17:23:58.885031] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:23:58.893166] [INFO ] [REMOTE ] AVNS: Full fetch complete (48077 records). [2025-09-26T17:23:58.893412] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-26T17:23:59.161836] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-26T17:23:59.345209] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-26T17:23:59.345467] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-26T17:23:59.346384] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-26T17:23:59.346531] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-26T17:23:59.365517] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T17:23:59.371450] [DEBUG] [LOCAL ] AVNS: Trimmed 48077 records to 34132 (keeping 200 days of data) [2025-09-26T17:23:59.588413] [DEBUG] [LOCAL ] AVNS: Primary data saved (34132 records). [2025-09-26T17:23:59.588799] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-26T17:23:59.591513] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVNS took 26.5s. Estimated remaining: 4h 42m 54s. Rate: 7.7 symbols/min [2025-09-26T17:23:59.777129] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:23:59.777321] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-09-26T17:23:59.777360] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-09-26T17:23:59.777520] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-26T17:23:59.777563] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-26T17:23:59.777604] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-09-26T17:23:59.777637] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-26T17:23:59.962323] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-26T17:24:00.174922] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:00.756718] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-26T17:24:01.072138] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T17:24:01.479483] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:24:01.556760] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-26T17:24:01.672300] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T17:24:01.679027] [INFO ] [REMOTE ] AVD: Full fetch complete (33821 records). [2025-09-26T17:24:01.679222] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-26T17:24:02.105133] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-26T17:24:02.105233] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-26T17:24:02.105761] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-26T17:24:02.105829] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-26T17:24:02.107131] [DEBUG] [LOCAL ] AVD: Trimmed 33821 records to 23030 (keeping 200 days of data) [2025-09-26T17:24:02.237927] [DEBUG] [LOCAL ] AVD: Primary data saved (23030 records). [2025-09-26T17:24:02.238154] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-26T17:24:02.238266] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVD took 43.7s. Estimated remaining: 4h 41m 46s. Rate: 7.8 symbols/min [2025-09-26T17:24:02.361883] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-26T17:24:02.431986] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:02.459511] [DEBUG] [LOCAL ] AWF: Loaded 24455 existing records from primary storage. [2025-09-26T17:24:02.459695] [INFO ] [MAIN ] AWF: Loaded 24455 existing records. [2025-09-26T17:24:02.692000] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:02.692430] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-26T17:24:02.692584] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-26T17:24:02.693465] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-26T17:24:02.693530] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-26T17:24:03.104841] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:03.131701] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T17:24:03.156722] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-26T17:24:03.648765] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:24:03.956748] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-26T17:24:04.410304] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:24:04.756772] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-26T17:24:05.021355] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T17:24:05.556733] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-26T17:24:05.840269] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T17:24:06.356755] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-26T17:24:06.772818] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T17:24:07.156780] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-26T17:24:07.956738] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-26T17:24:08.151986] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T17:24:08.625896] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:24:08.756734] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-26T17:24:09.155226] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T17:24:09.556916] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-26T17:24:09.941866] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T17:24:09.949957] [INFO ] [REMOTE ] AVNT: Full fetch complete (56217 records). [2025-09-26T17:24:09.950110] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-26T17:24:10.365566] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-26T17:24:10.452097] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-26T17:24:10.452222] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-26T17:24:10.452861] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-26T17:24:10.452930] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-26T17:24:10.454289] [DEBUG] [LOCAL ] AVNT: Trimmed 56217 records to 39887 (keeping 200 days of data) [2025-09-26T17:24:10.704755] [DEBUG] [LOCAL ] AVNT: Primary data saved (39887 records). [2025-09-26T17:24:10.704940] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-26T17:24:10.705051] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVNT took 29.4s. Estimated remaining: 4h 41m 47s. Rate: 7.8 symbols/min [2025-09-26T17:24:10.903542] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:10.953623] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T17:24:10.977101] [DEBUG] [LOCAL ] AWI: Loaded 26071 existing records from primary storage. [2025-09-26T17:24:10.977264] [INFO ] [MAIN ] AWI: Loaded 26071 existing records. [2025-09-26T17:24:11.162068] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-26T17:24:11.187979] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:11.189341] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-26T17:24:11.189395] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-26T17:24:11.190586] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-26T17:24:11.190708] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-26T17:24:11.613722] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:11.706361] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:24:11.956747] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-26T17:24:12.756732] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-26T17:24:12.851173] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T17:24:13.047830] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T17:24:13.556742] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-26T17:24:14.264443] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:24:14.356770] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-26T17:24:14.652000] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T17:24:15.156772] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-26T17:24:15.512466] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T17:24:15.956767] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-26T17:24:16.008714] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T17:24:16.756769] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-26T17:24:17.489178] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:24:17.556723] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-26T17:24:18.078873] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T17:24:18.356780] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-26T17:24:18.621311] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T17:24:19.156815] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-26T17:24:19.281929] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:24:19.956790] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-26T17:24:20.756721] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-26T17:24:20.967613] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:24:20.979818] [INFO ] [REMOTE ] AVY: Full fetch complete (55939 records). [2025-09-26T17:24:20.980069] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-26T17:24:20.982228] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:24:20.982386] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:24:20.982492] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:24:20.982606] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-26T17:24:20.982724] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-09-26T17:24:20.982797] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-09-26T17:24:20.982883] [DEBUG] [LOCAL ] AVY: No derivative data file found to delete. [2025-09-26T17:24:20.983025] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVY took 21.4s. Estimated remaining: 4h 42m 9s. Rate: 7.7 symbols/min [2025-09-26T17:24:21.239921] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:21.317104] [DEBUG] [LOCAL ] AWK: Loaded 49161 existing records from primary storage. [2025-09-26T17:24:21.317323] [INFO ] [MAIN ] AWK: Loaded 49161 existing records. [2025-09-26T17:24:21.562942] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-26T17:24:21.589708] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:21.590517] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-26T17:24:21.590636] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-26T17:24:21.592478] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-26T17:24:21.592546] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-26T17:24:21.943612] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-26T17:24:22.101006] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:24:22.108351] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:22.356781] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-26T17:24:22.927195] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:24:23.156772] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-26T17:24:23.956774] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-26T17:24:24.188432] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T17:24:24.302736] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T17:24:24.756762] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-26T17:24:24.949682] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T17:24:25.556733] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-26T17:24:26.158983] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:24:26.356769] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-26T17:24:27.114895] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:24:27.156759] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-26T17:24:27.956746] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-26T17:24:28.149421] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T17:24:28.160757] [INFO ] [REMOTE ] AVTR: Full fetch complete (77442 records). [2025-09-26T17:24:28.160948] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-26T17:24:28.619705] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-26T17:24:28.619928] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-26T17:24:28.620975] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-26T17:24:28.621081] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-26T17:24:28.634296] [DEBUG] [LOCAL ] AVTR: Trimmed 77442 records to 54345 (keeping 200 days of data) [2025-09-26T17:24:28.656727] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T17:24:28.733466] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T17:24:28.776439] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-26T17:24:29.038056] [DEBUG] [LOCAL ] AVTR: Primary data saved (54345 records). [2025-09-26T17:24:29.038220] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-26T17:24:29.038305] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AVTR took 41.8s. Estimated remaining: 4h 42m 5s. Rate: 7.7 symbols/min [2025-09-26T17:24:29.232748] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:29.255678] [DEBUG] [LOCAL ] AWP: Loaded 21735 existing records from primary storage. [2025-09-26T17:24:29.255823] [INFO ] [MAIN ] AWP: Loaded 21735 existing records. [2025-09-26T17:24:29.455410] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:29.455774] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-26T17:24:29.455828] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-26T17:24:29.456939] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-26T17:24:29.457001] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-26T17:24:29.561847] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-26T17:24:29.983661] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:30.000106] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:24:30.356739] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-26T17:24:30.858862] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:24:31.083329] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T17:24:31.156750] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-26T17:24:31.956729] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-26T17:24:32.376931] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T17:24:32.756756] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-26T17:24:33.137279] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:24:33.556723] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-26T17:24:33.646796] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:24:34.356778] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-26T17:24:35.101553] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:24:35.132545] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T17:24:35.156722] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-26T17:24:35.784407] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:24:35.956805] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-26T17:24:36.756794] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-26T17:24:36.916950] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T17:24:37.556793] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-26T17:24:38.318915] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:24:38.356774] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-26T17:24:38.882104] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:24:38.887482] [INFO ] [REMOTE ] AWI: Full fetch complete (35420 records). [2025-09-26T17:24:38.887675] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-26T17:24:39.166385] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-26T17:24:39.304025] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-26T17:24:39.304117] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-26T17:24:39.304638] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-26T17:24:39.304824] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-26T17:24:39.306049] [DEBUG] [LOCAL ] AWI: Trimmed 35420 records to 26185 (keeping 200 days of data) [2025-09-26T17:24:39.499166] [DEBUG] [LOCAL ] AWI: Primary data saved (26185 records). [2025-09-26T17:24:39.499318] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-26T17:24:39.499414] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AWI took 28.8s. Estimated remaining: 4h 42m 28s. Rate: 7.7 symbols/min [2025-09-26T17:24:39.692579] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:39.710586] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T17:24:39.737374] [DEBUG] [LOCAL ] AWR: Loaded 22806 existing records from primary storage. [2025-09-26T17:24:39.737527] [INFO ] [MAIN ] AWR: Loaded 22806 existing records. [2025-09-26T17:24:39.943786] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:39.944070] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-26T17:24:39.944131] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-26T17:24:39.944918] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-26T17:24:39.944982] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-26T17:24:39.959989] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-26T17:24:40.398285] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:40.423224] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T17:24:40.756777] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-26T17:24:41.556737] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-26T17:24:41.678919] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T17:24:41.757142] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:24:41.765510] [INFO ] [REMOTE ] AWF: Full fetch complete (35960 records). [2025-09-26T17:24:41.765730] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-26T17:24:42.215263] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-26T17:24:42.215374] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-26T17:24:42.215912] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-26T17:24:42.215979] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-26T17:24:42.217294] [DEBUG] [LOCAL ] AWF: Trimmed 35960 records to 24608 (keeping 200 days of data) [2025-09-26T17:24:42.358513] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-26T17:24:42.372119] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T17:24:42.422683] [DEBUG] [LOCAL ] AWF: Primary data saved (24608 records). [2025-09-26T17:24:42.422840] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-26T17:24:42.422964] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWF took 40.2s. Estimated remaining: 4h 41m 25s. Rate: 7.7 symbols/min [2025-09-26T17:24:42.627357] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:42.657845] [DEBUG] [LOCAL ] AX: Loaded 28738 existing records from primary storage. [2025-09-26T17:24:42.658004] [INFO ] [MAIN ] AX: Loaded 28738 existing records. [2025-09-26T17:24:42.865771] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:42.866040] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-26T17:24:42.866087] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-26T17:24:42.866945] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-26T17:24:42.867010] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-26T17:24:43.164585] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-26T17:24:43.332212] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:43.956719] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-26T17:24:44.164562] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T17:24:44.211386] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T17:24:44.756731] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-26T17:24:44.879484] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T17:24:45.556947] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-26T17:24:46.361839] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-26T17:24:46.374824] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:24:46.583739] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:24:47.156783] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-26T17:24:47.505153] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T17:24:47.956765] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-26T17:24:48.703567] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T17:24:48.756745] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-26T17:24:49.053191] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T17:24:49.556931] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-26T17:24:49.603339] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T17:24:50.356734] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-26T17:24:51.156716] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-26T17:24:51.271837] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T17:24:51.689304] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T17:24:51.956760] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-26T17:24:52.028698] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T17:24:52.756726] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-26T17:24:53.556695] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-26T17:24:53.660937] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:24:53.671463] [INFO ] [REMOTE ] AWK: Full fetch complete (70499 records). [2025-09-26T17:24:53.671611] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-26T17:24:54.151025] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:24:54.151269] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-26T17:24:54.157708] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-26T17:24:54.158859] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-26T17:24:54.158927] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-26T17:24:54.160730] [DEBUG] [LOCAL ] AWK: Trimmed 70499 records to 49489 (keeping 200 days of data) [2025-09-26T17:24:54.371107] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-26T17:24:54.453071] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-26T17:24:54.536211] [DEBUG] [LOCAL ] AWK: Primary data saved (49489 records). [2025-09-26T17:24:54.536357] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-26T17:24:54.537311] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWK took 33.6s. Estimated remaining: 4h 42m 7s. Rate: 7.7 symbols/min [2025-09-26T17:24:54.733176] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:54.791046] [DEBUG] [LOCAL ] AXL: Loaded 50863 existing records from primary storage. [2025-09-26T17:24:54.791203] [INFO ] [MAIN ] AXL: Loaded 50863 existing records. [2025-09-26T17:24:55.003102] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:24:55.003366] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-26T17:24:55.003415] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-26T17:24:55.004561] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-26T17:24:55.004635] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-26T17:24:55.161886] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-26T17:24:55.446978] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:55.830950] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:24:55.956754] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-26T17:24:56.070022] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T17:24:56.074668] [INFO ] [REMOTE ] AWP: Full fetch complete (32517 records). [2025-09-26T17:24:56.074775] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-26T17:24:56.485146] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-26T17:24:56.485279] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-26T17:24:56.485746] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-26T17:24:56.485812] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-26T17:24:56.486934] [DEBUG] [LOCAL ] AWP: Trimmed 32517 records to 21835 (keeping 200 days of data) [2025-09-26T17:24:56.630122] [DEBUG] [LOCAL ] AWP: Primary data saved (21835 records). [2025-09-26T17:24:56.630268] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-26T17:24:56.630362] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWP took 27.6s. Estimated remaining: 4h 40m 55s. Rate: 7.8 symbols/min [2025-09-26T17:24:56.758665] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-26T17:24:56.837984] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:24:56.838189] [DEBUG] [LOCAL ] AXP: No existing data file found in primary storage. [2025-09-26T17:24:56.838247] [WARN ] [MAIN ] AXP: No existing data found, performing full refresh instead. [2025-09-26T17:24:56.838401] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-26T17:24:56.838446] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-26T17:24:56.838489] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-09-26T17:24:56.838560] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-26T17:24:57.261284] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:24:57.502351] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T17:24:57.556765] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-26T17:24:58.068805] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:24:58.356726] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-26T17:24:58.876697] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T17:24:59.156776] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-26T17:24:59.609411] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:24:59.956776] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-26T17:25:00.756773] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-26T17:25:00.796706] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T17:25:01.278803] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-26T17:25:01.556741] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-26T17:25:01.904074] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T17:25:02.356733] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-26T17:25:03.156749] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-26T17:25:03.837552] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-26T17:25:03.906299] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T17:25:03.956710] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-26T17:25:03.986184] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:25:04.756792] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-26T17:25:05.360944] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:25:05.550201] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T17:25:05.556732] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-26T17:25:06.356715] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-26T17:25:07.156732] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-26T17:25:07.851083] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-26T17:25:07.956789] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-26T17:25:08.202239] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T17:25:08.397839] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T17:25:08.756772] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-26T17:25:09.556740] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-26T17:25:10.077544] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:25:10.086491] [INFO ] [REMOTE ] AX: Full fetch complete (42679 records). [2025-09-26T17:25:10.086639] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-26T17:25:10.363232] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-26T17:25:10.511470] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-26T17:25:10.511728] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-26T17:25:10.512297] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-26T17:25:10.512384] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-26T17:25:10.513826] [DEBUG] [LOCAL ] AX: Trimmed 42679 records to 28929 (keeping 200 days of data) [2025-09-26T17:25:10.643837] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-26T17:25:10.743860] [DEBUG] [LOCAL ] AX: Primary data saved (28929 records). [2025-09-26T17:25:10.744033] [INFO ] [MAIN ] AX: Full history saved. [2025-09-26T17:25:10.744191] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AX took 28.3s. Estimated remaining: 4h 41m 59s. Rate: 7.7 symbols/min [2025-09-26T17:25:10.931003] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:10.949351] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:25:10.959185] [DEBUG] [LOCAL ] AXR: Loaded 3174 existing records from primary storage. [2025-09-26T17:25:10.959332] [INFO ] [MAIN ] AXR: Loaded 3174 existing records. [2025-09-26T17:25:11.162208] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-26T17:25:11.167440] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:11.168025] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-26T17:25:11.168705] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-26T17:25:11.169033] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-26T17:25:11.169095] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-26T17:25:11.585461] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:11.956778] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-26T17:25:12.334151] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T17:25:12.756780] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-26T17:25:13.045376] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T17:25:13.052180] [INFO ] [REMOTE ] AWR: Full fetch complete (31704 records). [2025-09-26T17:25:13.052363] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-26T17:25:13.053034] [FATAL] [VALIDATOR ] AWR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:25:13.053142] [FATAL] [MAIN ] AWR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:25:13.053215] [WARN ] [MAIN ] AWR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:25:13.053315] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-26T17:25:13.053419] [DEBUG] [LOCAL ] AWR: No primary data file found to delete. [2025-09-26T17:25:13.053481] [INFO ] [LOCAL ] AWR: Starting deletion of derivative data. [2025-09-26T17:25:13.053939] [DEBUG] [LOCAL ] AWR: Deleted derivative data file. [2025-09-26T17:25:13.054057] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AWR took 33.6s. Estimated remaining: 4h 40m 50s. Rate: 7.7 symbols/min [2025-09-26T17:25:13.267156] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:13.306760] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-26T17:25:13.326927] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T17:25:13.357974] [DEBUG] [LOCAL ] AXS: Loaded 38615 existing records from primary storage. [2025-09-26T17:25:13.358139] [INFO ] [MAIN ] AXS: Loaded 38615 existing records. [2025-09-26T17:25:13.554853] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:13.555156] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-26T17:25:13.555218] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-26T17:25:13.556413] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-26T17:25:13.556478] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-26T17:25:13.561832] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-26T17:25:14.121531] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:14.356739] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-26T17:25:15.156767] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-26T17:25:15.279446] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:25:15.567351] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T17:25:15.956754] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-26T17:25:16.423397] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T17:25:16.490483] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-26T17:25:16.756732] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-26T17:25:17.556744] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-26T17:25:18.356711] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-26T17:25:18.939388] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-26T17:25:19.150978] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:25:19.159061] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-26T17:25:19.517319] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T17:25:19.940360] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T17:25:19.956698] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-26T17:25:20.756738] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-26T17:25:21.493088] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T17:25:21.491491] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:25:21.556734] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-26T17:25:22.050787] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:25:22.356717] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-26T17:25:22.765130] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T17:25:23.156743] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-26T17:25:23.956725] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-26T17:25:24.756739] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-26T17:25:24.948002] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T17:25:24.982360] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T17:25:25.556729] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-26T17:25:26.356730] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-26T17:25:26.806102] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T17:25:26.833924] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-26T17:25:26.999993] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T17:25:27.156764] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-26T17:25:27.749315] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T17:25:27.750797] [INFO ] [REMOTE ] AXR: Full fetch complete (5009 records). [2025-09-26T17:25:27.750963] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-26T17:25:27.970754] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-26T17:25:28.194868] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-26T17:25:28.194980] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-26T17:25:28.195213] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-26T17:25:28.195287] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-26T17:25:28.195876] [DEBUG] [LOCAL ] AXR: Trimmed 5009 records to 3220 (keeping 200 days of data) [2025-09-26T17:25:28.216111] [DEBUG] [LOCAL ] AXR: Primary data saved (3220 records). [2025-09-26T17:25:28.216279] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-26T17:25:28.216410] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXR took 17.5s. Estimated remaining: 4h 42m 4s. Rate: 7.7 symbols/min [2025-09-26T17:25:28.403824] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:28.459425] [DEBUG] [LOCAL ] AXTA: Loaded 52445 existing records from primary storage. [2025-09-26T17:25:28.459570] [INFO ] [MAIN ] AXTA: Loaded 52445 existing records. [2025-09-26T17:25:28.677917] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:28.678194] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-26T17:25:28.678257] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-26T17:25:28.679598] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-26T17:25:28.679871] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-26T17:25:28.761846] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-26T17:25:29.077272] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:29.479433] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T17:25:29.556917] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-26T17:25:30.356712] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-26T17:25:30.909967] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T17:25:31.023867] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:25:31.156767] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-26T17:25:31.647425] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T17:25:31.956766] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-26T17:25:32.756720] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-26T17:25:33.194438] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:25:33.249058] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:25:33.556746] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-26T17:25:34.273312] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T17:25:34.290713] [INFO ] [REMOTE ] AXL: Full fetch complete (72551 records). [2025-09-26T17:25:34.290937] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-26T17:25:34.366274] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-26T17:25:34.756009] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-26T17:25:34.756596] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-26T17:25:34.757609] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-26T17:25:34.757782] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-26T17:25:34.760885] [DEBUG] [LOCAL ] AXL: Trimmed 72551 records to 51239 (keeping 200 days of data) [2025-09-26T17:25:34.891809] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:25:35.142358] [DEBUG] [LOCAL ] AXL: Primary data saved (51239 records). [2025-09-26T17:25:35.142537] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-26T17:25:35.143453] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXL took 40.6s. Estimated remaining: 4h 41m 47s. Rate: 7.7 symbols/min [2025-09-26T17:25:35.156740] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-26T17:25:35.956796] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-26T17:25:36.252124] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:25:36.384637] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T17:25:36.395939] [INFO ] [REMOTE ] AXP: Full fetch complete (76898 records). [2025-09-26T17:25:36.396193] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-26T17:25:36.761885] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-26T17:25:36.910862] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-26T17:25:36.910995] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-26T17:25:36.911901] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-26T17:25:36.911977] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-26T17:25:36.914039] [DEBUG] [LOCAL ] AXP: Trimmed 76898 records to 53999 (keeping 200 days of data) [2025-09-26T17:25:37.223747] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:25:37.335238] [DEBUG] [LOCAL ] AXP: Primary data saved (53999 records). [2025-09-26T17:25:37.335406] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-26T17:25:37.335495] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 40.7s. Estimated remaining: 4h 40m 38s. Rate: 7.7 symbols/min [2025-09-26T17:25:37.556854] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-26T17:25:37.991419] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T17:25:38.356715] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-26T17:25:38.890836] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:25:39.156772] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-26T17:25:39.685410] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T17:25:39.956759] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-26T17:25:40.593842] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:25:40.756736] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-26T17:25:41.052865] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T17:25:41.556737] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-26T17:25:42.314283] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T17:25:42.356750] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-26T17:25:42.768985] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T17:25:42.777345] [INFO ] [REMOTE ] AXS: Full fetch complete (55561 records). [2025-09-26T17:25:42.777508] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-26T17:25:43.189542] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-26T17:25:43.189662] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-26T17:25:43.190556] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-26T17:25:43.190605] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-26T17:25:43.191947] [DEBUG] [LOCAL ] AXS: Trimmed 55561 records to 38920 (keeping 200 days of data) [2025-09-26T17:25:43.434455] [DEBUG] [LOCAL ] AXS: Primary data saved (38920 records). [2025-09-26T17:25:43.434630] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-26T17:25:43.434762] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 30.4s. Estimated remaining: 4h 40m 12s. Rate: 7.8 symbols/min [2025-09-26T17:25:43.868527] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T17:25:43.879873] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-26T17:25:45.595625] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T17:25:45.608148] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-26T17:25:47.248477] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T17:25:47.260422] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-26T17:25:48.868364] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:25:48.879742] [INFO ] [REMOTE ] AXTA: Full fetch complete (74910 records). [2025-09-26T17:25:48.879957] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-26T17:25:49.321051] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-26T17:25:49.321147] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-26T17:25:49.321908] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-26T17:25:49.321980] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-26T17:25:49.323541] [DEBUG] [LOCAL ] AXTA: Trimmed 74910 records to 52835 (keeping 200 days of data) [2025-09-26T17:25:49.646749] [DEBUG] [LOCAL ] AXTA: Primary data saved (52835 records). [2025-09-26T17:25:49.646948] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-26T17:25:49.647112] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 21.4s. Estimated remaining: 4h 39m 48s. Rate: 7.8 symbols/min [2025-09-26T17:25:50.273421] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:50.367421] [DEBUG] [LOCAL ] AZZ: No existing data file found in primary storage. [2025-09-26T17:25:50.362219] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:50.403030] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:50.393775] [WARN ] [MAIN ] AZZ: No existing data found, performing full refresh instead. [2025-09-26T17:25:50.441731] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-26T17:25:50.463821] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:25:50.463911] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-26T17:25:50.464318] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-26T17:25:50.464399] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-09-26T17:25:50.464495] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-26T17:25:50.464765] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-26T17:25:50.464833] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-26T17:25:50.464889] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-26T17:25:50.464949] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-26T17:25:50.464563] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-26T17:25:50.629160] [DEBUG] [LOCAL ] AZO: Loaded 11599 existing records from primary storage. [2025-09-26T17:25:50.686051] [INFO ] [MAIN ] AZO: Loaded 11599 existing records. [2025-09-26T17:25:50.709114] [DEBUG] [LOCAL ] AYI: Loaded 25307 existing records from primary storage. [2025-09-26T17:25:50.767254] [INFO ] [MAIN ] AYI: Loaded 25307 existing records. [2025-09-26T17:25:51.518018] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:51.671888] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:25:51.671710] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-26T17:25:51.677833] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-26T17:25:51.739247] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:51.744430] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-26T17:25:51.724899] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-26T17:25:51.762425] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-26T17:25:51.762028] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-26T17:25:51.767805] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-26T17:25:51.803749] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-26T17:25:51.811679] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:51.819575] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-26T17:25:51.818953] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-26T17:25:52.574616] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:52.597812] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-26T17:25:52.637908] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:25:52.638278] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-26T17:25:53.084552] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:25:53.089052] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-26T17:25:53.244332] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T17:25:53.251515] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-26T17:25:53.405555] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T17:25:53.409493] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-26T17:25:53.845871] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:25:53.850955] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-26T17:25:53.935596] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:25:53.941359] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-26T17:25:54.219719] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:25:54.225926] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-26T17:25:54.258419] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:25:54.261327] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-26T17:25:54.617391] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:25:54.617768] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-26T17:25:54.618285] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-26T17:25:54.685465] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:25:54.789514] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:25:54.828235] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:25:54.828923] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-26T17:25:55.156755] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-26T17:25:55.374743] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:25:55.956727] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-26T17:25:56.039495] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T17:25:56.756744] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-26T17:25:56.889345] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T17:25:57.556726] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-26T17:25:57.978889] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T17:25:58.356719] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-26T17:25:58.831726] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T17:25:59.108102] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T17:25:59.156680] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-26T17:25:59.956735] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-26T17:26:00.547249] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T17:26:00.756747] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-26T17:26:00.895168] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T17:26:00.994834] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:26:00.995172] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-26T17:26:01.556750] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-26T17:26:02.298083] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:26:02.356681] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-26T17:26:03.156824] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-26T17:26:03.794220] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T17:26:03.956747] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-26T17:26:04.771992] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-26T17:26:04.776450] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T17:26:05.214118] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T17:26:05.556740] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-26T17:26:05.707636] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:26:06.356716] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-26T17:26:07.156722] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-26T17:26:07.341195] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T17:26:07.956728] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-26T17:26:08.053999] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T17:26:08.116716] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:26:08.121184] [INFO ] [REMOTE ] AZZ: Full fetch complete (30859 records). [2025-09-26T17:26:08.121331] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-26T17:26:08.536436] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-26T17:26:08.536547] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-26T17:26:08.537014] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-26T17:26:08.537125] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-26T17:26:08.538088] [DEBUG] [LOCAL ] AZZ: Trimmed 30859 records to 22359 (keeping 200 days of data) [2025-09-26T17:26:08.679713] [DEBUG] [LOCAL ] AZZ: Primary data saved (22359 records). [2025-09-26T17:26:08.679854] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-26T17:26:08.679935] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. AZZ took 19.0s. Estimated remaining: 4h 41m 42s. Rate: 7.7 symbols/min [2025-09-26T17:26:08.763739] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-26T17:26:08.878220] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:08.934104] [DEBUG] [LOCAL ] BA: Loaded 54181 existing records from primary storage. [2025-09-26T17:26:08.934256] [INFO ] [MAIN ] BA: Loaded 54181 existing records. [2025-09-26T17:26:09.132916] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:09.133174] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-26T17:26:09.133222] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-26T17:26:09.134721] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-26T17:26:09.134792] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-26T17:26:09.522822] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:09.532338] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:26:09.556737] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-26T17:26:10.026812] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T17:26:10.356772] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-26T17:26:10.659312] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:26:11.156717] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-26T17:26:11.243497] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:26:11.956753] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-26T17:26:12.756730] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-26T17:26:13.348798] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:26:13.497136] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-26T17:26:13.518842] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-26T17:26:13.556733] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-26T17:26:14.356734] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-26T17:26:15.156730] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-26T17:26:15.235317] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T17:26:15.831741] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-26T17:26:15.956725] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-26T17:26:16.121475] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:26:16.124496] [INFO ] [REMOTE ] AZO: Full fetch complete (16385 records). [2025-09-26T17:26:16.124604] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-26T17:26:16.589516] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-26T17:26:16.589605] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-26T17:26:16.590093] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-26T17:26:16.590160] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-26T17:26:16.590959] [DEBUG] [LOCAL ] AZO: Trimmed 16385 records to 11687 (keeping 200 days of data) [2025-09-26T17:26:16.677496] [DEBUG] [LOCAL ] AZO: Primary data saved (11687 records). [2025-09-26T17:26:16.677711] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-26T17:26:16.677845] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZO took 27.0s. Estimated remaining: 4h 41m 37s. Rate: 7.7 symbols/min [2025-09-26T17:26:16.765403] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-26T17:26:16.872097] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:16.944427] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-09-26T17:26:16.944582] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-09-26T17:26:17.139804] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:17.140104] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-26T17:26:17.140162] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-26T17:26:17.142293] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-26T17:26:17.142359] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-26T17:26:17.555191] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:17.556666] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-26T17:26:18.148106] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-26T17:26:18.356734] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-26T17:26:18.752775] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T17:26:19.156716] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-26T17:26:19.192022] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:26:19.814349] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-26T17:26:19.956725] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-26T17:26:20.756728] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-26T17:26:21.306152] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-26T17:26:21.556725] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-26T17:26:22.151805] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-26T17:26:22.356720] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-26T17:26:22.791736] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T17:26:22.802541] [INFO ] [REMOTE ] B: Full fetch complete (45487 records). [2025-09-26T17:26:22.802730] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-26T17:26:23.011028] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-26T17:26:23.011707] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:26:23.011787] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:26:23.011845] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-26T17:26:23.011931] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-26T17:26:23.011991] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-26T17:26:23.012066] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-26T17:26:23.012163] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. B took 33.4s. Estimated remaining: 4h 41m 13s. Rate: 7.7 symbols/min [2025-09-26T17:26:23.161927] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-26T17:26:23.240680] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:23.322469] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-09-26T17:26:23.322702] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-09-26T17:26:23.553110] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:23.553496] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-26T17:26:23.553557] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-26T17:26:23.555310] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-26T17:26:23.555382] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-26T17:26:23.939754] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:23.964260] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-26T17:26:23.992912] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-26T17:26:24.057915] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T17:26:24.065639] [INFO ] [REMOTE ] AYI: Full fetch complete (36526 records). [2025-09-26T17:26:24.065840] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-26T17:26:24.067708] [FATAL] [VALIDATOR ] AYI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:26:24.067825] [FATAL] [MAIN ] AYI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:26:24.067895] [WARN ] [MAIN ] AYI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:26:24.067991] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-26T17:26:24.068111] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-09-26T17:26:24.068192] [INFO ] [LOCAL ] AYI: Starting deletion of derivative data. [2025-09-26T17:26:24.068696] [DEBUG] [LOCAL ] AYI: Deleted derivative data file. [2025-09-26T17:26:24.068868] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. AYI took 34.4s. Estimated remaining: 4h 39m 54s. Rate: 7.7 symbols/min [2025-09-26T17:26:24.274816] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:24.358734] [DEBUG] [LOCAL ] BAH: Loaded 52108 existing records from primary storage. [2025-09-26T17:26:24.358963] [INFO ] [MAIN ] BAH: Loaded 52108 existing records. [2025-09-26T17:26:24.563757] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:24.564196] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-26T17:26:24.564268] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-26T17:26:24.566129] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-26T17:26:24.566239] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-26T17:26:24.780909] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-26T17:26:24.902539] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-26T17:26:25.046920] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:25.556720] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-26T17:26:25.972680] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-26T17:26:26.356724] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-26T17:26:27.138354] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-26T17:26:27.156674] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-26T17:26:27.550253] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T17:26:27.956795] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-26T17:26:28.476739] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T17:26:28.756751] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-26T17:26:29.403506] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-26T17:26:29.445935] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T17:26:29.556740] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-26T17:26:30.356732] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-26T17:26:30.809367] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-26T17:26:31.156773] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-26T17:26:31.960141] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-26T17:26:31.974382] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-26T17:26:32.756732] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-26T17:26:33.143253] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-26T17:26:33.556705] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-26T17:26:33.735807] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-26T17:26:33.779558] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T17:26:34.356719] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-26T17:26:35.049281] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-26T17:26:35.156759] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-26T17:26:35.925497] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T17:26:35.956770] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-26T17:26:36.150895] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-26T17:26:36.756723] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-26T17:26:37.276543] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T17:26:37.290703] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-26T17:26:37.290886] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-26T17:26:37.563770] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-26T17:26:37.736446] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-26T17:26:37.736544] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-26T17:26:37.737460] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-26T17:26:37.737542] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-26T17:26:37.742947] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 54571 (keeping 200 days of data) [2025-09-26T17:26:38.106675] [DEBUG] [LOCAL ] BA: Primary data saved (54571 records). [2025-09-26T17:26:38.106837] [INFO ] [MAIN ] BA: Full history saved. [2025-09-26T17:26:38.106945] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 29.4s. Estimated remaining: 4h 40m 53s. Rate: 7.7 symbols/min [2025-09-26T17:26:38.308158] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:38.347200] [DEBUG] [LOCAL ] BAK: Loaded 39033 existing records from primary storage. [2025-09-26T17:26:38.347352] [INFO ] [MAIN ] BAK: Loaded 39033 existing records. [2025-09-26T17:26:38.544800] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:38.545183] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-26T17:26:38.545245] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-26T17:26:38.546877] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-26T17:26:38.546946] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-26T17:26:38.777851] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-26T17:26:38.882208] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-26T17:26:39.006845] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:39.059170] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T17:26:39.156701] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-26T17:26:39.269008] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-26T17:26:39.956756] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-26T17:26:40.756742] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-26T17:26:40.947750] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:26:41.261563] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-26T17:26:41.556736] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-26T17:26:42.356735] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-26T17:26:42.518868] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:26:42.570164] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-26T17:26:43.156778] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-26T17:26:43.628016] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-26T17:26:43.836061] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T17:26:43.956737] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-26T17:26:44.756783] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-26T17:26:45.541402] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-26T17:26:45.563536] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-26T17:26:45.588498] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T17:26:46.356742] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-26T17:26:47.084449] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T17:26:47.156748] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-26T17:26:47.384797] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-26T17:26:47.956743] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-26T17:26:48.230419] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T17:26:48.500562] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:26:48.756803] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-26T17:26:49.556778] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-26T17:26:50.356721] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-26T17:26:50.537851] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-26T17:26:51.106491] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:26:51.156699] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-26T17:26:51.706190] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-26T17:26:51.717429] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-26T17:26:51.717780] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-26T17:26:51.962186] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-26T17:26:52.143196] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T17:26:52.220745] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-26T17:26:52.220870] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-26T17:26:52.221751] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-26T17:26:52.221818] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-26T17:26:52.223947] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54600 (keeping 200 days of data) [2025-09-26T17:26:52.498932] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T17:26:52.626201] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-09-26T17:26:52.626364] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-26T17:26:52.627930] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BABA took 35.9s. Estimated remaining: 4h 41m 56s. Rate: 7.7 symbols/min [2025-09-26T17:26:52.761916] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-26T17:26:52.814007] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:52.877212] [DEBUG] [LOCAL ] BALL: Loaded 52197 existing records from primary storage. [2025-09-26T17:26:52.877367] [INFO ] [MAIN ] BALL: Loaded 52197 existing records. [2025-09-26T17:26:53.068707] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:53.069008] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-26T17:26:53.069073] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-26T17:26:53.070524] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-26T17:26:53.070586] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-26T17:26:53.449215] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:53.556724] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-26T17:26:54.356960] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-26T17:26:54.412012] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T17:26:54.511627] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-26T17:26:54.523480] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-26T17:26:54.523684] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-26T17:26:54.967695] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-26T17:26:54.967866] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-26T17:26:54.968733] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-26T17:26:54.968906] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-26T17:26:54.970959] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54588 (keeping 200 days of data) [2025-09-26T17:26:55.095460] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T17:26:55.196436] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-26T17:26:55.368981] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-09-26T17:26:55.369129] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-26T17:26:55.369218] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAC took 32.4s. Estimated remaining: 4h 40m 55s. Rate: 7.7 symbols/min [2025-09-26T17:26:55.549496] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:55.549714] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-26T17:26:55.549764] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-26T17:26:55.549908] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-26T17:26:55.549952] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-26T17:26:55.549995] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-26T17:26:55.550027] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-26T17:26:55.940308] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:55.967255] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-26T17:26:55.973594] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T17:26:55.985146] [INFO ] [REMOTE ] BAH: Full fetch complete (74824 records). [2025-09-26T17:26:55.985324] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-26T17:26:56.396665] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-26T17:26:56.396766] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-26T17:26:56.397537] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-26T17:26:56.397606] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-26T17:26:56.401328] [DEBUG] [LOCAL ] BAH: Trimmed 74824 records to 52477 (keeping 200 days of data) [2025-09-26T17:26:56.737835] [DEBUG] [LOCAL ] BAH: Primary data saved (52477 records). [2025-09-26T17:26:56.737989] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-26T17:26:56.738935] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BAH took 32.7s. Estimated remaining: 4h 39m 41s. Rate: 7.7 symbols/min [2025-09-26T17:26:56.761957] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-26T17:26:56.932844] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:26:56.990388] [DEBUG] [LOCAL ] BAM: Loaded 52391 existing records from primary storage. [2025-09-26T17:26:56.990559] [INFO ] [MAIN ] BAM: Loaded 52391 existing records. [2025-09-26T17:26:57.188631] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:26:57.189096] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-26T17:26:57.189178] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-26T17:26:57.200137] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-26T17:26:57.215577] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-26T17:26:57.291342] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T17:26:57.557221] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-26T17:26:57.651715] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:26:57.663861] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:26:58.207146] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:26:58.356742] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-26T17:26:58.865006] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:26:59.156753] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-26T17:26:59.933278] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T17:26:59.956743] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-26T17:27:00.715827] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T17:27:00.756773] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-26T17:27:01.556711] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-26T17:27:01.611355] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T17:27:02.356775] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-26T17:27:02.681866] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T17:27:03.131246] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:27:03.156683] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-26T17:27:03.270847] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T17:27:03.956776] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-26T17:27:04.611099] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T17:27:04.756700] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-26T17:27:04.850296] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T17:27:04.858007] [INFO ] [REMOTE ] BAK: Full fetch complete (56955 records). [2025-09-26T17:27:04.858159] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-26T17:27:05.272200] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-26T17:27:05.272330] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-26T17:27:05.273017] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-26T17:27:05.273085] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-26T17:27:05.274508] [DEBUG] [LOCAL ] BAK: Trimmed 56955 records to 39413 (keeping 200 days of data) [2025-09-26T17:27:05.508502] [DEBUG] [LOCAL ] BAK: Primary data saved (39413 records). [2025-09-26T17:27:05.508702] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-26T17:27:05.508842] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BAK took 27.4s. Estimated remaining: 4h 39m 43s. Rate: 7.7 symbols/min [2025-09-26T17:27:05.567131] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-26T17:27:05.693002] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:05.752289] [DEBUG] [LOCAL ] BANC: Loaded 51644 existing records from primary storage. [2025-09-26T17:27:05.752533] [INFO ] [MAIN ] BANC: Loaded 51644 existing records. [2025-09-26T17:27:05.948242] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:05.948776] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-26T17:27:05.948962] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-26T17:27:05.950563] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-26T17:27:05.950631] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-26T17:27:06.202419] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:27:06.306517] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T17:27:06.362373] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-26T17:27:06.394783] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:07.136964] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T17:27:07.156733] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-26T17:27:07.956757] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-26T17:27:08.141334] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T17:27:08.756777] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-26T17:27:09.556755] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-26T17:27:09.598185] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:27:10.356715] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-26T17:27:10.376728] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T17:27:10.590990] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T17:27:11.156748] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-26T17:27:11.956742] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-26T17:27:12.413275] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T17:27:12.756742] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-26T17:27:12.957013] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:27:13.229242] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T17:27:13.556705] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-26T17:27:13.636173] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T17:27:14.356729] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-26T17:27:15.156697] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-26T17:27:15.250500] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T17:27:15.572424] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T17:27:15.911576] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T17:27:15.956727] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-26T17:27:16.756754] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-26T17:27:17.558482] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-26T17:27:17.558384] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:27:18.080237] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:27:18.356726] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-26T17:27:19.085231] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:27:19.156720] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-26T17:27:19.956696] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-26T17:27:20.089006] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T17:27:20.756787] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-26T17:27:21.018201] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:27:21.556758] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-26T17:27:21.830108] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T17:27:22.356758] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-26T17:27:22.426669] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T17:27:23.166347] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-26T17:27:23.188304] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:27:23.820788] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T17:27:23.956783] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-26T17:27:24.756767] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-26T17:27:24.759080] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T17:27:25.556752] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-26T17:27:25.623878] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T17:27:25.635910] [INFO ] [REMOTE ] BAM: Full fetch complete (74174 records). [2025-09-26T17:27:25.636196] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-26T17:27:25.783503] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T17:27:25.822504] [INFO ] [REMOTE ] BALY: Full fetch complete (17169 records). [2025-09-26T17:27:25.829131] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-26T17:27:26.256300] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T17:27:26.295670] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:27:26.303782] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:27:26.303916] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-26T17:27:26.326136] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-26T17:27:26.326413] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-26T17:27:26.326339] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-26T17:27:26.326528] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-26T17:27:26.327453] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-26T17:27:26.327563] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-26T17:27:26.327628] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-26T17:27:26.328000] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BALY took 31.0s. Estimated remaining: 4h 41m 50s. Rate: 7.7 symbols/min [2025-09-26T17:27:26.361909] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-26T17:27:26.410725] [DEBUG] [LOCAL ] BAM: Trimmed 74174 records to 52779 (keeping 200 days of data) [2025-09-26T17:27:26.635183] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:26.749601] [DEBUG] [LOCAL ] BAP: Loaded 26518 existing records from primary storage. [2025-09-26T17:27:26.758625] [INFO ] [MAIN ] BAP: Loaded 26518 existing records. [2025-09-26T17:27:27.034898] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:27.036209] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-26T17:27:27.039127] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-26T17:27:27.044210] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-26T17:27:27.046176] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-26T17:27:27.387319] [DEBUG] [LOCAL ] BAM: Primary data saved (52779 records). [2025-09-26T17:27:27.416968] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-26T17:27:27.476850] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BAM took 30.7s. Estimated remaining: 4h 40m 34s. Rate: 7.7 symbols/min [2025-09-26T17:27:27.670154] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:27.679792] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-26T17:27:27.804354] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:27.802330] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T17:27:27.817891] [INFO ] [REMOTE ] BALL: Full fetch complete (75382 records). [2025-09-26T17:27:27.818150] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-26T17:27:28.190325] [DEBUG] [LOCAL ] BARK: Loaded 38678 existing records from primary storage. [2025-09-26T17:27:28.190767] [INFO ] [MAIN ] BARK: Loaded 38678 existing records. [2025-09-26T17:27:28.429393] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-26T17:27:28.470722] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-26T17:27:28.489486] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-26T17:27:28.489671] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-26T17:27:28.488585] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-26T17:27:28.547759] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:28.549427] [DEBUG] [LOCAL ] BALL: Trimmed 75382 records to 52583 (keeping 200 days of data) [2025-09-26T17:27:28.549184] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-26T17:27:28.549485] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-26T17:27:28.550915] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-26T17:27:28.552089] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-26T17:27:28.552187] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-26T17:27:29.136985] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:29.138003] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-26T17:27:29.139426] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T17:27:29.379663] [DEBUG] [LOCAL ] BALL: Primary data saved (52583 records). [2025-09-26T17:27:29.379836] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-26T17:27:29.380595] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BALL took 36.8s. Estimated remaining: 4h 39m 26s. Rate: 7.7 symbols/min [2025-09-26T17:27:29.574023] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:29.569025] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-26T17:27:29.574701] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-09-26T17:27:29.575520] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-09-26T17:27:29.575779] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-26T17:27:29.575866] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-26T17:27:29.575918] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-26T17:27:29.575957] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-26T17:27:29.982254] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:30.357448] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-26T17:27:30.360960] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T17:27:30.842222] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T17:27:30.866772] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T17:27:31.156732] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-26T17:27:31.956690] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-26T17:27:32.068225] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T17:27:32.367964] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T17:27:32.761823] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-26T17:27:32.771522] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T17:27:33.556793] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-26T17:27:34.356764] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-26T17:27:34.712703] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T17:27:34.900386] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:27:35.156763] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-26T17:27:35.956789] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-26T17:27:36.170003] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:27:36.299054] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:27:36.756782] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-26T17:27:37.556710] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-26T17:27:37.733273] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T17:27:37.743936] [INFO ] [REMOTE ] BANC: Full fetch complete (74184 records). [2025-09-26T17:27:37.744121] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-26T17:27:38.175839] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-26T17:27:38.175935] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-26T17:27:38.176768] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-26T17:27:38.176850] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-26T17:27:38.178478] [DEBUG] [LOCAL ] BANC: Trimmed 74184 records to 52019 (keeping 200 days of data) [2025-09-26T17:27:38.361748] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-26T17:27:38.524313] [DEBUG] [LOCAL ] BANC: Primary data saved (52019 records). [2025-09-26T17:27:38.524507] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-26T17:27:38.524636] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 33.0s. Estimated remaining: 4h 39m 32s. Rate: 7.7 symbols/min [2025-09-26T17:27:38.750444] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:38.754496] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T17:27:38.818730] [DEBUG] [LOCAL ] BB: Loaded 53311 existing records from primary storage. [2025-09-26T17:27:38.819086] [INFO ] [MAIN ] BB: Loaded 53311 existing records. [2025-09-26T17:27:38.929745] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:27:39.046155] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:39.046437] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-26T17:27:39.046498] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-26T17:27:39.047897] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-26T17:27:39.047962] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-26T17:27:39.157381] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-26T17:27:39.445632] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:39.710432] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T17:27:39.956734] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-26T17:27:40.701529] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:27:40.756771] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-26T17:27:41.556703] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-26T17:27:41.642347] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T17:27:42.126021] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T17:27:42.356745] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-26T17:27:43.156768] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-26T17:27:43.761400] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:27:43.888537] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-26T17:27:43.956759] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-26T17:27:43.988035] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:27:44.756740] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-26T17:27:45.556720] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-26T17:27:45.839002] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T17:27:46.356742] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-26T17:27:46.418716] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T17:27:46.447125] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:27:47.156771] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-26T17:27:47.956979] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-26T17:27:48.307995] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T17:27:48.489439] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T17:27:48.756728] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-26T17:27:49.363466] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T17:27:49.556743] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-26T17:27:50.045147] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:27:50.356736] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-26T17:27:51.156778] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-26T17:27:51.301010] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T17:27:51.704209] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:27:51.956747] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-26T17:27:52.401370] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T17:27:52.756771] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-26T17:27:53.049978] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T17:27:53.556746] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-26T17:27:54.363751] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-26T17:27:54.390115] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:27:54.445444] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T17:27:54.452515] [INFO ] [REMOTE ] BAP: Full fetch complete (37758 records). [2025-09-26T17:27:54.452713] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-26T17:27:54.897999] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-26T17:27:54.898127] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-26T17:27:54.898828] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-26T17:27:54.898911] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-26T17:27:54.900366] [DEBUG] [LOCAL ] BAP: Trimmed 37758 records to 26635 (keeping 200 days of data) [2025-09-26T17:27:55.081844] [DEBUG] [LOCAL ] BAP: Primary data saved (26635 records). [2025-09-26T17:27:55.081996] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-26T17:27:55.082110] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAP took 28.8s. Estimated remaining: 4h 40m 53s. Rate: 7.7 symbols/min [2025-09-26T17:27:55.163296] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-26T17:27:55.278048] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:55.337599] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-09-26T17:27:55.337798] [INFO ] [MAIN ] BBAI: Loaded 54210 existing records. [2025-09-26T17:27:55.530791] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:55.531128] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-26T17:27:55.531185] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-26T17:27:55.532677] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-26T17:27:55.532740] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-26T17:27:55.919494] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:55.956718] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-26T17:27:56.267322] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:27:56.457681] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:27:56.465076] [INFO ] [REMOTE ] BARK: Full fetch complete (56850 records). [2025-09-26T17:27:56.465245] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-26T17:27:56.762585] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-26T17:27:56.930181] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-26T17:27:56.930275] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-26T17:27:56.931198] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-26T17:27:56.931276] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-26T17:27:56.932880] [DEBUG] [LOCAL ] BARK: Trimmed 56850 records to 38893 (keeping 200 days of data) [2025-09-26T17:27:57.219986] [DEBUG] [LOCAL ] BARK: Primary data saved (38893 records). [2025-09-26T17:27:57.220148] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-26T17:27:57.220243] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BARK took 29.7s. Estimated remaining: 4h 39m 48s. Rate: 7.7 symbols/min [2025-09-26T17:27:57.400768] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:27:57.447939] [DEBUG] [LOCAL ] BBAR: Loaded 41667 existing records from primary storage. [2025-09-26T17:27:57.448126] [INFO ] [MAIN ] BBAR: Loaded 41667 existing records. [2025-09-26T17:27:57.559115] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-26T17:27:57.649201] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:27:57.649696] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-26T17:27:57.649855] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-26T17:27:57.651378] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-26T17:27:57.651448] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-26T17:27:57.998300] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T17:27:58.110168] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:27:58.356728] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-26T17:27:58.442420] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T17:27:59.156728] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-26T17:27:59.956750] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-26T17:28:00.005850] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:28:00.017296] [INFO ] [REMOTE ] BAX: Full fetch complete (77441 records). [2025-09-26T17:28:00.017469] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-26T17:28:00.465074] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-26T17:28:00.465255] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-26T17:28:00.466257] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-26T17:28:00.466379] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-26T17:28:00.503505] [DEBUG] [LOCAL ] BAX: Trimmed 77441 records to 54273 (keeping 200 days of data) [2025-09-26T17:28:00.504771] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.95 seconds). [2025-09-26T17:28:00.756869] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-26T17:28:00.870415] [DEBUG] [LOCAL ] BAX: Primary data saved (54273 records). [2025-09-26T17:28:00.870573] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-26T17:28:00.870689] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 31.5s. Estimated remaining: 4h 38m 59s. Rate: 7.7 symbols/min [2025-09-26T17:28:01.053713] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:01.108037] [DEBUG] [LOCAL ] BBD: Loaded 53571 existing records from primary storage. [2025-09-26T17:28:01.108187] [INFO ] [MAIN ] BBD: Loaded 53571 existing records. [2025-09-26T17:28:01.353196] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:01.356475] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-26T17:28:01.367183] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-26T17:28:01.368739] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-26T17:28:01.371070] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-26T17:28:01.371159] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-26T17:28:01.564086] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-26T17:28:01.820378] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T17:28:01.862866] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:02.356739] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-26T17:28:03.156764] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-26T17:28:03.381183] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-26T17:28:03.629116] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T17:28:03.956750] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-26T17:28:04.026572] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T17:28:04.725988] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T17:28:04.756673] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-26T17:28:05.561811] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-26T17:28:05.579146] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T17:28:06.083954] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T17:28:06.356734] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-26T17:28:07.156733] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-26T17:28:07.956769] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-26T17:28:08.214784] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-26T17:28:08.650959] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T17:28:08.756756] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-26T17:28:08.868671] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-26T17:28:08.880257] [INFO ] [REMOTE ] BB: Full fetch complete (76984 records). [2025-09-26T17:28:08.880454] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-26T17:28:09.425987] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-26T17:28:09.426190] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-26T17:28:09.427839] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-26T17:28:09.428136] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-26T17:28:09.431166] [DEBUG] [LOCAL ] BB: Trimmed 76984 records to 53701 (keeping 200 days of data) [2025-09-26T17:28:09.565368] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-26T17:28:09.608895] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T17:28:09.937237] [DEBUG] [LOCAL ] BB: Primary data saved (53701 records). [2025-09-26T17:28:09.937458] [INFO ] [MAIN ] BB: Full history saved. [2025-09-26T17:28:09.937638] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BB took 31.4s. Estimated remaining: 4h 39m 4s. Rate: 7.7 symbols/min [2025-09-26T17:28:10.202388] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:10.246930] [DEBUG] [LOCAL ] BBDC: Loaded 33540 existing records from primary storage. [2025-09-26T17:28:10.247193] [INFO ] [MAIN ] BBDC: Loaded 33540 existing records. [2025-09-26T17:28:10.361878] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-26T17:28:10.473321] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:10.473629] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-26T17:28:10.473715] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-26T17:28:10.474752] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-26T17:28:10.474816] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-26T17:28:10.869706] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:11.108596] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:28:11.156733] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-26T17:28:11.497521] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-26T17:28:11.845482] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:28:11.956748] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-26T17:28:12.378417] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T17:28:12.756733] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-26T17:28:13.556741] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-26T17:28:14.132741] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:28:14.300448] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-26T17:28:14.356719] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-26T17:28:15.158979] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-26T17:28:15.162324] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T17:28:15.956734] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-26T17:28:16.756720] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-26T17:28:16.864454] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-26T17:28:16.901870] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T17:28:17.556727] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-26T17:28:17.755996] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:28:18.356699] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-26T17:28:18.435158] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T17:28:19.156708] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-26T17:28:19.337301] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T17:28:19.843074] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-26T17:28:19.956746] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-26T17:28:20.583105] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T17:28:20.756748] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-26T17:28:21.556715] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-26T17:28:22.356706] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-26T17:28:22.441568] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T17:28:22.494795] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-26T17:28:22.528160] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T17:28:23.156723] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-26T17:28:23.529375] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:28:23.956734] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-26T17:28:24.188713] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T17:28:24.756757] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-26T17:28:25.547786] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:28:25.556733] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-26T17:28:26.356754] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-26T17:28:26.749303] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T17:28:27.156777] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-26T17:28:27.905063] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:28:27.915110] [INFO ] [REMOTE ] BBAR: Full fetch complete (60747 records). [2025-09-26T17:28:27.915445] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-26T17:28:27.962688] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-26T17:28:28.378152] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-09-26T17:28:28.378485] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-26T17:28:28.390116] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-26T17:28:28.391351] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-26T17:28:28.392059] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-26T17:28:28.393886] [DEBUG] [LOCAL ] BBAR: Trimmed 60747 records to 41988 (keeping 200 days of data) [2025-09-26T17:28:28.514635] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:28:28.689296] [DEBUG] [LOCAL ] BBAR: Primary data saved (41988 records). [2025-09-26T17:28:28.689452] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-26T17:28:28.690751] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BBAR took 31.5s. Estimated remaining: 4h 40m 45s. Rate: 7.7 symbols/min [2025-09-26T17:28:28.761815] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-26T17:28:28.916630] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:28.925390] [DEBUG] [LOCAL ] BBDO: Loaded 5030 existing records from primary storage. [2025-09-26T17:28:28.925529] [INFO ] [MAIN ] BBDO: Loaded 5030 existing records. [2025-09-26T17:28:29.112027] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:29.112339] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-26T17:28:29.112407] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-26T17:28:29.112895] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-26T17:28:29.112960] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-26T17:28:29.506606] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:29.556706] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-26T17:28:29.683364] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:28:29.695849] [INFO ] [REMOTE ] BBD: Full fetch complete (77118 records). [2025-09-26T17:28:29.696029] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-26T17:28:30.124260] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-26T17:28:30.124354] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-26T17:28:30.125194] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-26T17:28:30.125267] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-26T17:28:30.127460] [DEBUG] [LOCAL ] BBD: Trimmed 77118 records to 53959 (keeping 200 days of data) [2025-09-26T17:28:30.233092] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T17:28:30.361105] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-26T17:28:30.491362] [DEBUG] [LOCAL ] BBD: Primary data saved (53959 records). [2025-09-26T17:28:30.491527] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-26T17:28:30.492796] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBD took 29.6s. Estimated remaining: 4h 39m 38s. Rate: 7.7 symbols/min [2025-09-26T17:28:30.725325] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:30.750117] [DEBUG] [LOCAL ] BBN: Loaded 18100 existing records from primary storage. [2025-09-26T17:28:30.750260] [INFO ] [MAIN ] BBN: Loaded 18100 existing records. [2025-09-26T17:28:30.890320] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:28:30.960495] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:30.960803] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-26T17:28:30.960857] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-26T17:28:30.961536] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-26T17:28:30.961599] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-26T17:28:31.161848] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-26T17:28:31.356327] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:31.387899] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-26T17:28:31.398680] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-26T17:28:31.398844] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-26T17:28:31.795779] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:28:31.823197] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-26T17:28:31.823282] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-26T17:28:31.824133] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-26T17:28:31.824202] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-26T17:28:31.825817] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-09-26T17:28:31.989275] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-26T17:28:32.144475] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-09-26T17:28:32.144619] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-26T17:28:32.144736] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBAI took 37.1s. Estimated remaining: 4h 38m 30s. Rate: 7.7 symbols/min [2025-09-26T17:28:32.322938] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:32.323114] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-26T17:28:32.323153] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-26T17:28:32.323301] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-26T17:28:32.323346] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-26T17:28:32.323390] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-26T17:28:32.323427] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-26T17:28:32.699407] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:32.756677] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-26T17:28:33.149910] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:33.150238] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-26T17:28:33.330799] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T17:28:33.556718] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-26T17:28:33.771299] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:33.771623] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-26T17:28:34.356771] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-26T17:28:35.156748] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-26T17:28:35.632386] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T17:28:35.956755] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-26T17:28:36.211056] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T17:28:36.338630] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-26T17:28:36.756765] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-26T17:28:36.956512] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:36.956882] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-26T17:28:37.556731] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-26T17:28:37.757743] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:37.758127] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-26T17:28:38.356756] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-26T17:28:39.096279] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T17:28:39.156770] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-26T17:28:39.956705] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-26T17:28:40.125267] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:28:40.461501] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T17:28:40.756770] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-26T17:28:40.971314] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:40.971636] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-26T17:28:41.556717] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-26T17:28:41.763063] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:41.763373] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-26T17:28:42.356731] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-26T17:28:43.156738] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-26T17:28:43.218523] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T17:28:43.568589] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T17:28:43.956738] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-26T17:28:44.756737] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-26T17:28:45.077502] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:45.077875] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-26T17:28:45.099502] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T17:28:45.556738] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-26T17:28:45.760391] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:45.760739] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-26T17:28:46.356730] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-26T17:28:46.559391] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:28:46.559741] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-26T17:28:47.156751] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-26T17:28:47.753095] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:28:47.956741] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-26T17:28:48.304751] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T17:28:48.756766] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-26T17:28:49.556742] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-26T17:28:50.056075] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T17:28:50.061432] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T17:28:50.072383] [INFO ] [REMOTE ] BBDO: Full fetch complete (7688 records). [2025-09-26T17:28:50.072533] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-26T17:28:50.361880] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-26T17:28:50.465580] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-26T17:28:50.465688] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-26T17:28:50.465913] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-26T17:28:50.466008] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-26T17:28:50.466814] [DEBUG] [LOCAL ] BBDO: Trimmed 7688 records to 5051 (keeping 200 days of data) [2025-09-26T17:28:50.500235] [DEBUG] [LOCAL ] BBDO: Primary data saved (5051 records). [2025-09-26T17:28:50.500345] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-26T17:28:50.500523] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBDO took 21.8s. Estimated remaining: 4h 40m 5s. Rate: 7.7 symbols/min [2025-09-26T17:28:50.675187] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:50.682719] [DEBUG] [LOCAL ] BBU: Loaded 4332 existing records from primary storage. [2025-09-26T17:28:50.682801] [INFO ] [MAIN ] BBU: Loaded 4332 existing records. [2025-09-26T17:28:50.867471] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:50.867729] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-26T17:28:50.867786] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-26T17:28:50.868117] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-26T17:28:50.868187] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-26T17:28:51.158461] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-26T17:28:51.264316] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:51.273390] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T17:28:51.956761] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-26T17:28:52.419352] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T17:28:52.441569] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T17:28:52.449742] [INFO ] [REMOTE ] BBDC: Full fetch complete (48839 records). [2025-09-26T17:28:52.449879] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-26T17:28:52.761822] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-26T17:28:52.882309] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-26T17:28:52.882408] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-26T17:28:52.882998] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-26T17:28:52.883064] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-26T17:28:52.885408] [DEBUG] [LOCAL ] BBDC: Trimmed 48839 records to 33756 (keeping 200 days of data) [2025-09-26T17:28:53.111517] [DEBUG] [LOCAL ] BBDC: Primary data saved (33756 records). [2025-09-26T17:28:53.111694] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-26T17:28:53.111833] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBDC took 43.2s. Estimated remaining: 4h 39m 7s. Rate: 7.7 symbols/min [2025-09-26T17:28:53.313011] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:53.329304] [DEBUG] [LOCAL ] BBUC: Loaded 13336 existing records from primary storage. [2025-09-26T17:28:53.329474] [INFO ] [MAIN ] BBUC: Loaded 13336 existing records. [2025-09-26T17:28:53.525628] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:53.526603] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-26T17:28:53.526684] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-26T17:28:53.527713] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-26T17:28:53.527774] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-26T17:28:53.561880] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-26T17:28:53.953634] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:54.356709] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-26T17:28:54.547920] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T17:28:54.560716] [INFO ] [REMOTE ] BBT: Full fetch complete (5611 records). [2025-09-26T17:28:54.561026] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-26T17:28:54.698098] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:28:54.802297] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 19 unique days, need 200 days [2025-09-26T17:28:54.802614] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:28:54.802741] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:28:54.802834] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-26T17:28:54.803276] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-26T17:28:54.803396] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-26T17:28:54.809008] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-26T17:28:54.809151] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBT took 22.7s. Estimated remaining: 4h 38m 1s. Rate: 7.7 symbols/min [2025-09-26T17:28:54.815636] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T17:28:55.000014] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:28:55.066965] [DEBUG] [LOCAL ] BBVA: Loaded 49832 existing records from primary storage. [2025-09-26T17:28:55.067201] [INFO ] [MAIN ] BBVA: Loaded 49832 existing records. [2025-09-26T17:28:55.161821] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-26T17:28:55.263254] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:28:55.263510] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-26T17:28:55.263561] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-26T17:28:55.265056] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-26T17:28:55.265117] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-26T17:28:55.653580] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:28:55.756552] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T17:28:55.956727] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-26T17:28:56.451204] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T17:28:56.756745] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-26T17:28:57.556722] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-26T17:28:57.963848] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-26T17:28:58.356697] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-26T17:28:58.609277] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T17:28:58.872627] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:28:59.156767] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-26T17:28:59.956690] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-26T17:29:00.315394] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T17:29:00.756745] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-26T17:29:01.556880] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-26T17:29:01.734780] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T17:29:01.774791] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:29:02.087812] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:29:02.356814] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-26T17:29:03.115417] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T17:29:03.156712] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-26T17:29:03.644483] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T17:29:03.956759] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-26T17:29:04.681465] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T17:29:04.756720] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-26T17:29:05.227351] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T17:29:05.556721] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-26T17:29:06.303365] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T17:29:06.356736] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-26T17:29:07.156738] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-26T17:29:07.963617] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-26T17:29:07.982843] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:29:08.037838] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T17:29:08.760270] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-26T17:29:08.762812] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T17:29:09.556713] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-26T17:29:09.645912] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T17:29:10.356723] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-26T17:29:10.412309] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T17:29:10.417792] [INFO ] [REMOTE ] BBN: Full fetch complete (26742 records). [2025-09-26T17:29:10.417912] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-26T17:29:10.830277] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-26T17:29:10.830407] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-26T17:29:10.830878] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-26T17:29:10.830948] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-26T17:29:10.831951] [DEBUG] [LOCAL ] BBN: Trimmed 26742 records to 18193 (keeping 200 days of data) [2025-09-26T17:29:10.960672] [DEBUG] [LOCAL ] BBN: Primary data saved (18193 records). [2025-09-26T17:29:10.960865] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-26T17:29:10.961004] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBN took 40.5s. Estimated remaining: 4h 39m 13s. Rate: 7.7 symbols/min [2025-09-26T17:29:11.143379] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:11.160094] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-26T17:29:11.173365] [DEBUG] [LOCAL ] BBW: Loaded 26921 existing records from primary storage. [2025-09-26T17:29:11.174056] [INFO ] [MAIN ] BBW: Loaded 26921 existing records. [2025-09-26T17:29:11.369910] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:11.370288] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-26T17:29:11.370380] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-26T17:29:11.371282] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-26T17:29:11.371347] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-26T17:29:11.779949] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:11.819948] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T17:29:11.953722] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:29:11.964284] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-26T17:29:12.672344] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T17:29:12.756722] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-26T17:29:13.552899] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T17:29:13.556029] [INFO ] [REMOTE ] BBU: Full fetch complete (6398 records). [2025-09-26T17:29:13.556155] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-26T17:29:13.561873] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-26T17:29:13.971368] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-26T17:29:13.971474] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-26T17:29:13.971713] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-26T17:29:13.971777] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-26T17:29:13.972221] [DEBUG] [LOCAL ] BBU: Trimmed 6398 records to 4478 (keeping 200 days of data) [2025-09-26T17:29:14.003451] [DEBUG] [LOCAL ] BBU: Primary data saved (4478 records). [2025-09-26T17:29:14.003593] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-26T17:29:14.003757] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBU took 23.5s. Estimated remaining: 4h 38m 20s. Rate: 7.7 symbols/min [2025-09-26T17:29:14.196560] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:14.276531] [DEBUG] [LOCAL ] BBWI: Loaded 53970 existing records from primary storage. [2025-09-26T17:29:14.276731] [INFO ] [MAIN ] BBWI: Loaded 53970 existing records. [2025-09-26T17:29:14.361950] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-26T17:29:14.496951] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:14.497298] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-26T17:29:14.497354] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-26T17:29:14.498892] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-26T17:29:14.498955] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-26T17:29:14.892368] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:14.944049] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:29:14.960034] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T17:29:15.156752] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-26T17:29:15.956772] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-26T17:29:16.532292] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T17:29:16.756783] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-26T17:29:17.556798] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-26T17:29:17.773010] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T17:29:17.855278] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T17:29:18.356757] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-26T17:29:19.156752] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-26T17:29:19.420454] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T17:29:19.673935] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:29:19.929233] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T17:29:19.956690] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-26T17:29:20.756774] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-26T17:29:21.153737] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T17:29:21.556741] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-26T17:29:22.108995] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T17:29:22.356759] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-26T17:29:22.461588] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T17:29:23.156771] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-26T17:29:23.872899] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T17:29:23.956767] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-26T17:29:24.548071] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:29:24.749343] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:29:24.756671] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-26T17:29:25.556706] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-26T17:29:25.886981] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:29:26.231594] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-26T17:29:26.356754] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-26T17:29:27.156796] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-26T17:29:27.516520] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T17:29:27.956754] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-26T17:29:28.756791] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-26T17:29:28.971613] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T17:29:29.203127] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T17:29:29.556741] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-26T17:29:30.356726] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-26T17:29:30.401472] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T17:29:30.404951] [INFO ] [REMOTE ] BBUC: Full fetch complete (17692 records). [2025-09-26T17:29:30.405043] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-26T17:29:30.808238] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-26T17:29:30.824119] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-26T17:29:30.838035] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-26T17:29:30.838190] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-26T17:29:30.840959] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T17:29:30.841325] [DEBUG] [LOCAL ] BBUC: Trimmed 17692 records to 13503 (keeping 200 days of data) [2025-09-26T17:29:30.941719] [DEBUG] [LOCAL ] BBUC: Primary data saved (13503 records). [2025-09-26T17:29:30.941881] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-26T17:29:30.941994] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBUC took 37.8s. Estimated remaining: 4h 39m 39s. Rate: 7.7 symbols/min [2025-09-26T17:29:31.126043] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:31.160305] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-26T17:29:31.183877] [DEBUG] [LOCAL ] BBY: Loaded 53868 existing records from primary storage. [2025-09-26T17:29:31.184041] [INFO ] [MAIN ] BBY: Loaded 53868 existing records. [2025-09-26T17:29:31.373861] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:31.374115] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-26T17:29:31.374163] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-26T17:29:31.376266] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-26T17:29:31.376330] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-26T17:29:31.753279] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:31.956753] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-26T17:29:32.397414] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T17:29:32.542852] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T17:29:32.550310] [INFO ] [REMOTE ] BBW: Full fetch complete (39048 records). [2025-09-26T17:29:32.550462] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-26T17:29:32.765334] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-26T17:29:32.984761] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-26T17:29:32.984856] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-26T17:29:32.985338] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-26T17:29:32.985382] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-26T17:29:32.986562] [DEBUG] [LOCAL ] BBW: Trimmed 39048 records to 27177 (keeping 200 days of data) [2025-09-26T17:29:33.184191] [DEBUG] [LOCAL ] BBW: Primary data saved (27177 records). [2025-09-26T17:29:33.184384] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-26T17:29:33.184515] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBW took 22.2s. Estimated remaining: 4h 38m 39s. Rate: 7.7 symbols/min [2025-09-26T17:29:33.365037] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:33.415517] [DEBUG] [LOCAL ] BC: Loaded 44723 existing records from primary storage. [2025-09-26T17:29:33.415730] [INFO ] [MAIN ] BC: Loaded 44723 existing records. [2025-09-26T17:29:33.560536] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-26T17:29:33.631408] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:33.631961] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-26T17:29:33.632099] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-26T17:29:33.644072] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-26T17:29:33.661736] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-26T17:29:33.711450] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T17:29:34.052890] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:34.297779] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T17:29:34.356770] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-26T17:29:34.982479] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T17:29:35.156791] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-26T17:29:35.958530] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-26T17:29:35.964599] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:29:36.756773] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-26T17:29:36.971663] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:29:37.351528] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:29:37.556743] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-26T17:29:38.293122] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:29:38.303936] [INFO ] [REMOTE ] BBVA: Full fetch complete (71572 records). [2025-09-26T17:29:38.304269] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-26T17:29:38.362613] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-26T17:29:38.726839] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-26T17:29:38.726982] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-26T17:29:38.727861] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-26T17:29:38.727937] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-26T17:29:38.732606] [DEBUG] [LOCAL ] BBVA: Trimmed 71572 records to 50167 (keeping 200 days of data) [2025-09-26T17:29:39.071838] [DEBUG] [LOCAL ] BBVA: Primary data saved (50167 records). [2025-09-26T17:29:39.085717] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-26T17:29:39.085867] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBVA took 44.3s. Estimated remaining: 4h 38m 13s. Rate: 7.7 symbols/min [2025-09-26T17:29:39.149303] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T17:29:39.158332] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-26T17:29:39.279917] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:39.280089] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-09-26T17:29:39.280145] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-09-26T17:29:39.280289] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-26T17:29:39.280332] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-26T17:29:39.280373] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-26T17:29:39.280406] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-26T17:29:39.651032] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:39.934596] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:29:39.956692] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-26T17:29:40.761060] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-26T17:29:40.768091] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:29:41.400369] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:29:41.556746] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-26T17:29:42.356721] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-26T17:29:42.496016] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T17:29:42.671663] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:29:43.156729] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-26T17:29:43.956760] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-26T17:29:44.383398] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T17:29:44.756720] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-26T17:29:45.027017] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T17:29:45.368866] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:29:45.556738] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-26T17:29:46.267829] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:29:46.356734] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-26T17:29:47.108404] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T17:29:47.156743] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-26T17:29:47.693523] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T17:29:47.956760] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-26T17:29:48.550440] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:29:48.756777] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-26T17:29:48.965313] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T17:29:49.556756] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-26T17:29:50.356763] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-26T17:29:50.553531] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T17:29:50.564614] [INFO ] [REMOTE ] BBWI: Full fetch complete (77415 records). [2025-09-26T17:29:50.564797] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-26T17:29:50.986392] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-26T17:29:50.986673] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-26T17:29:50.988088] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-26T17:29:50.988180] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-26T17:29:50.990936] [DEBUG] [LOCAL ] BBWI: Trimmed 77415 records to 54360 (keeping 200 days of data) [2025-09-26T17:29:51.137717] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:29:51.157279] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-26T17:29:51.411976] [DEBUG] [LOCAL ] BBWI: Primary data saved (54360 records). [2025-09-26T17:29:51.412158] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-26T17:29:51.412921] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBWI took 37.4s. Estimated remaining: 4h 38m 48s. Rate: 7.7 symbols/min [2025-09-26T17:29:51.595478] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:51.630390] [DEBUG] [LOCAL ] BCC: Loaded 28556 existing records from primary storage. [2025-09-26T17:29:51.630577] [INFO ] [MAIN ] BCC: Loaded 28556 existing records. [2025-09-26T17:29:51.874896] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:29:51.918969] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:51.919235] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-26T17:29:51.919287] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-26T17:29:51.920195] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-26T17:29:51.920259] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-26T17:29:51.961917] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-26T17:29:52.331060] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:52.760628] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-26T17:29:52.767292] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:29:53.556735] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-26T17:29:53.801864] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T17:29:53.895583] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:29:54.356727] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-26T17:29:54.747364] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-26T17:29:55.156776] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-26T17:29:55.956809] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-26T17:29:56.070060] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T17:29:56.081186] [INFO ] [REMOTE ] BBY: Full fetch complete (77245 records). [2025-09-26T17:29:56.081392] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-26T17:29:56.652680] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-26T17:29:56.653880] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-26T17:29:56.656073] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-26T17:29:56.656232] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-26T17:29:56.655032] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T17:29:56.666748] [DEBUG] [LOCAL ] BBY: Trimmed 77245 records to 54253 (keeping 200 days of data) [2025-09-26T17:29:56.776443] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-26T17:29:57.035480] [DEBUG] [LOCAL ] BBY: Primary data saved (54253 records). [2025-09-26T17:29:57.035681] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-26T17:29:57.035815] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBY took 26.1s. Estimated remaining: 4h 38m 19s. Rate: 7.7 symbols/min [2025-09-26T17:29:57.253834] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T17:29:57.266247] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:29:57.330606] [DEBUG] [LOCAL ] BCE: Loaded 52712 existing records from primary storage. [2025-09-26T17:29:57.330889] [INFO ] [MAIN ] BCE: Loaded 52712 existing records. [2025-09-26T17:29:57.562463] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-26T17:29:57.606909] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:29:57.607268] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-26T17:29:57.607348] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-26T17:29:57.609368] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-26T17:29:57.609439] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-26T17:29:58.026266] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:29:58.064316] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:29:58.356765] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-26T17:29:59.088882] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:29:59.156733] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-26T17:29:59.789312] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:29:59.956759] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-26T17:30:00.756719] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-26T17:30:00.805453] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T17:30:01.556764] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-26T17:30:02.091394] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-26T17:30:02.356690] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-26T17:30:02.457915] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T17:30:02.808875] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T17:30:03.156742] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-26T17:30:03.627886] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:30:03.956736] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-26T17:30:04.756731] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-26T17:30:05.055422] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T17:30:05.063806] [INFO ] [REMOTE ] BC: Full fetch complete (63840 records). [2025-09-26T17:30:05.063942] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-26T17:30:05.483114] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-26T17:30:05.483207] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-26T17:30:05.484014] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-26T17:30:05.484090] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-26T17:30:05.485594] [DEBUG] [LOCAL ] BC: Trimmed 63840 records to 45020 (keeping 200 days of data) [2025-09-26T17:30:05.582979] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-26T17:30:05.787044] [DEBUG] [LOCAL ] BC: Primary data saved (45020 records). [2025-09-26T17:30:05.787251] [INFO ] [MAIN ] BC: Full history saved. [2025-09-26T17:30:05.789514] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 32.6s. Estimated remaining: 4h 38m 21s. Rate: 7.7 symbols/min [2025-09-26T17:30:05.985034] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:05.985270] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-09-26T17:30:05.985528] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-09-26T17:30:05.985798] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-26T17:30:05.985854] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-26T17:30:05.985901] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-26T17:30:05.985936] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-26T17:30:06.133497] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-26T17:30:06.172210] [INFO ] [REMOTE ] BCAT: Full fetch complete (49992 records). [2025-09-26T17:30:06.192344] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-26T17:30:06.609358] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:06.626624] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-26T17:30:06.899871] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-26T17:30:06.900253] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-26T17:30:06.911200] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-26T17:30:06.927532] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-26T17:30:06.934367] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-26T17:30:06.962140] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T17:30:06.962486] [DEBUG] [LOCAL ] BCAT: Trimmed 49992 records to 34910 (keeping 200 days of data) [2025-09-26T17:30:07.169727] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-26T17:30:07.200446] [DEBUG] [LOCAL ] BCAT: Primary data saved (34910 records). [2025-09-26T17:30:07.200578] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-26T17:30:07.200687] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 28.1s. Estimated remaining: 4h 37m 14s. Rate: 7.7 symbols/min [2025-09-26T17:30:07.383424] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:07.383633] [DEBUG] [LOCAL ] BCO: No existing data file found in primary storage. [2025-09-26T17:30:07.383713] [WARN ] [MAIN ] BCO: No existing data found, performing full refresh instead. [2025-09-26T17:30:07.383833] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-26T17:30:07.383873] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-26T17:30:07.383916] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-09-26T17:30:07.383949] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-26T17:30:07.783178] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:07.801314] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T17:30:07.956734] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-26T17:30:08.756745] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-26T17:30:09.060887] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T17:30:09.208413] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:30:09.556734] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-26T17:30:10.152331] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T17:30:10.356738] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-26T17:30:11.156726] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-26T17:30:11.487313] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T17:30:11.664078] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:30:11.956753] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-26T17:30:12.059766] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:30:12.756762] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-26T17:30:12.812945] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T17:30:13.556725] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-26T17:30:13.737301] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T17:30:14.356754] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-26T17:30:14.487247] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T17:30:15.156776] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-26T17:30:15.297542] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T17:30:15.956765] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-26T17:30:15.991590] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:30:16.756766] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-26T17:30:17.434096] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:30:17.556763] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-26T17:30:17.656793] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T17:30:18.356757] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-26T17:30:19.064571] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:30:19.156768] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-26T17:30:19.956768] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-26T17:30:20.103374] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:30:20.756698] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-26T17:30:20.759075] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:30:20.868389] [DEBUG] [REMOTE ] BCH: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-26T17:30:20.868740] [WARN ] [REMOTE ] BCH: No data returned for month 2025-05 [2025-09-26T17:30:20.985368] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T17:30:21.556725] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-26T17:30:22.356730] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-26T17:30:22.861688] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T17:30:23.156785] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-26T17:30:23.747996] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:30:23.956703] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-26T17:30:24.283738] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T17:30:24.756751] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-26T17:30:25.282126] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T17:30:25.556741] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-26T17:30:25.787201] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T17:30:25.793497] [INFO ] [REMOTE ] BCC: Full fetch complete (40396 records). [2025-09-26T17:30:25.793663] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-26T17:30:26.191587] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-26T17:30:26.191713] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-26T17:30:26.192279] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-26T17:30:26.192345] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-26T17:30:26.193339] [DEBUG] [LOCAL ] BCC: Trimmed 40396 records to 28735 (keeping 200 days of data) [2025-09-26T17:30:26.366007] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-26T17:30:26.384405] [DEBUG] [LOCAL ] BCC: Primary data saved (28735 records). [2025-09-26T17:30:26.384530] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-26T17:30:26.386259] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 35.0s. Estimated remaining: 4h 38m 51s. Rate: 7.7 symbols/min [2025-09-26T17:30:26.567356] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:26.627392] [DEBUG] [LOCAL ] BCS: Loaded 53855 existing records from primary storage. [2025-09-26T17:30:26.627562] [INFO ] [MAIN ] BCS: Loaded 53855 existing records. [2025-09-26T17:30:26.814726] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:30:26.815389] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-26T17:30:26.815483] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-26T17:30:26.817255] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-26T17:30:26.817325] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-26T17:30:27.160859] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-26T17:30:27.219780] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:27.268549] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T17:30:27.270791] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T17:30:27.956758] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-26T17:30:28.645352] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T17:30:28.756759] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-26T17:30:29.349857] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:30:29.556772] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-26T17:30:30.356725] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-26T17:30:30.394587] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T17:30:30.613268] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T17:30:30.620542] [INFO ] [REMOTE ] BCO: Full fetch complete (36744 records). [2025-09-26T17:30:30.620797] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-26T17:30:31.086726] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-26T17:30:31.086844] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-26T17:30:31.087573] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-26T17:30:31.087668] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-26T17:30:31.088753] [DEBUG] [LOCAL ] BCO: Trimmed 36744 records to 26740 (keeping 200 days of data) [2025-09-26T17:30:31.178899] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-26T17:30:31.261109] [DEBUG] [LOCAL ] BCO: Primary data saved (26740 records). [2025-09-26T17:30:31.261272] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-26T17:30:31.261371] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCO took 24.1s. Estimated remaining: 4h 38m 16s. Rate: 7.7 symbols/min [2025-09-26T17:30:31.457221] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:31.488114] [DEBUG] [LOCAL ] BCSF: Loaded 28030 existing records from primary storage. [2025-09-26T17:30:31.488261] [INFO ] [MAIN ] BCSF: Loaded 28030 existing records. [2025-09-26T17:30:31.678506] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:30:31.678834] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-26T17:30:31.678893] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-26T17:30:31.679682] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-26T17:30:31.679764] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-26T17:30:31.959463] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-26T17:30:32.093597] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:32.133837] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T17:30:32.163422] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T17:30:32.756815] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-26T17:30:33.556891] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-26T17:30:33.841634] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T17:30:33.851519] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T17:30:34.356749] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-26T17:30:34.528049] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:30:34.534917] [INFO ] [REMOTE ] BCH: Full fetch complete (36526 records). [2025-09-26T17:30:34.535084] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-26T17:30:34.747198] [WARN ] [VALIDATOR ] BCH: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T17:30:34.747745] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:30:34.747823] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:30:34.747907] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-26T17:30:34.748015] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-26T17:30:34.748088] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-09-26T17:30:34.748178] [DEBUG] [LOCAL ] BCH: No derivative data file found to delete. [2025-09-26T17:30:34.748272] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCH took 29.0s. Estimated remaining: 4h 37m 29s. Rate: 7.7 symbols/min [2025-09-26T17:30:34.945709] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:34.946090] [DEBUG] [LOCAL ] BCX: No existing data file found in primary storage. [2025-09-26T17:30:34.946130] [WARN ] [MAIN ] BCX: No existing data found, performing full refresh instead. [2025-09-26T17:30:34.946278] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-26T17:30:34.946323] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-26T17:30:34.946367] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-09-26T17:30:34.946401] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-26T17:30:35.167372] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-26T17:30:35.340369] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:35.944972] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T17:30:35.956667] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-26T17:30:35.972538] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T17:30:36.756766] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-26T17:30:37.481895] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T17:30:37.556725] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-26T17:30:37.876422] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T17:30:38.356740] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-26T17:30:39.156734] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-26T17:30:39.520883] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T17:30:39.770535] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T17:30:39.956787] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-26T17:30:40.601375] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T17:30:40.756767] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-26T17:30:40.910728] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T17:30:41.556747] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-26T17:30:41.697833] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T17:30:42.356759] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-26T17:30:42.834267] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:30:43.156748] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-26T17:30:43.181237] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T17:30:43.956786] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-26T17:30:44.756740] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-26T17:30:44.909446] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T17:30:44.921844] [INFO ] [REMOTE ] BCE: Full fetch complete (76101 records). [2025-09-26T17:30:44.935879] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-26T17:30:44.943685] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T17:30:45.390122] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-26T17:30:45.390221] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-26T17:30:45.391026] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-26T17:30:45.391117] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-26T17:30:45.392881] [DEBUG] [LOCAL ] BCE: Trimmed 76101 records to 53072 (keeping 200 days of data) [2025-09-26T17:30:45.581790] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-26T17:30:45.754777] [DEBUG] [LOCAL ] BCE: Primary data saved (53072 records). [2025-09-26T17:30:45.754985] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-26T17:30:45.762064] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCE took 48.7s. Estimated remaining: 4h 37m 50s. Rate: 7.7 symbols/min [2025-09-26T17:30:45.822052] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:30:45.970242] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:30:45.970445] [DEBUG] [LOCAL ] BDC: No existing data file found in primary storage. [2025-09-26T17:30:45.970486] [WARN ] [MAIN ] BDC: No existing data found, performing full refresh instead. [2025-09-26T17:30:45.970700] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-26T17:30:45.970759] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-26T17:30:45.970840] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-09-26T17:30:45.970887] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-26T17:30:46.381107] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-26T17:30:46.387374] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:30:47.156734] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-26T17:30:47.466399] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:30:47.594553] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T17:30:47.956743] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-26T17:30:48.268172] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T17:30:48.756762] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-26T17:30:48.894407] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T17:30:49.556714] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-26T17:30:49.608913] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:30:50.356760] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-26T17:30:50.714164] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:30:51.156778] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-26T17:30:51.528920] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T17:30:51.956746] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-26T17:30:52.756760] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-26T17:30:52.858635] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:30:52.958342] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:30:52.967866] [INFO ] [REMOTE ] BCSF: Full fetch complete (38132 records). [2025-09-26T17:30:52.968046] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-26T17:30:53.387011] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-26T17:30:53.387131] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-26T17:30:53.387595] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-26T17:30:53.387638] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-26T17:30:53.390202] [DEBUG] [LOCAL ] BCSF: Trimmed 38132 records to 28231 (keeping 200 days of data) [2025-09-26T17:30:53.565243] [DEBUG] [LOCAL ] BCSF: Primary data saved (28231 records). [2025-09-26T17:30:53.560855] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-26T17:30:53.566320] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-26T17:30:53.566473] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 22.3s. Estimated remaining: 4h 37m 42s. Rate: 7.7 symbols/min [2025-09-26T17:30:53.976737] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:30:54.356798] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-26T17:30:55.159599] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-26T17:30:55.162969] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T17:30:55.411846] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T17:30:55.956758] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-26T17:30:56.084049] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T17:30:56.756769] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-26T17:30:57.136811] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:30:57.556719] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-26T17:30:57.771788] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T17:30:58.215663] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T17:30:58.356759] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-26T17:30:59.156744] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-26T17:30:59.202977] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:30:59.207275] [INFO ] [REMOTE ] BCX: Full fetch complete (33885 records). [2025-09-26T17:30:59.207416] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-26T17:30:59.636145] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-26T17:30:59.636286] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-26T17:30:59.636821] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-26T17:30:59.636962] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-26T17:30:59.641841] [DEBUG] [LOCAL ] BCX: Trimmed 33885 records to 21920 (keeping 200 days of data) [2025-09-26T17:30:59.788811] [DEBUG] [LOCAL ] BCX: Primary data saved (21920 records). [2025-09-26T17:30:59.788979] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-26T17:30:59.789221] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCX took 25.0s. Estimated remaining: 4h 37m 20s. Rate: 7.7 symbols/min [2025-09-26T17:30:59.956838] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-26T17:31:01.188019] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T17:31:01.205564] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-26T17:31:01.491304] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:31:01.556751] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-26T17:31:02.644292] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T17:31:02.658048] [INFO ] [REMOTE ] BCS: Full fetch complete (76901 records). [2025-09-26T17:31:02.658261] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-26T17:31:02.659512] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:31:02.659671] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:31:02.659747] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:31:02.659813] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-26T17:31:02.659898] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-26T17:31:02.659970] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-09-26T17:31:02.660965] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-09-26T17:31:02.661674] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCS took 36.3s. Estimated remaining: 4h 36m 29s. Rate: 7.7 symbols/min [2025-09-26T17:31:02.803944] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:31:02.809699] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-26T17:31:03.898101] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T17:31:03.904153] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-26T17:31:05.082863] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:31:05.089377] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-26T17:31:06.245329] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:31:06.251379] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-26T17:31:07.510769] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T17:31:07.518870] [INFO ] [REMOTE ] BDC: Full fetch complete (35763 records). [2025-09-26T17:31:07.519101] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-26T17:31:08.132403] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-26T17:31:08.132868] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-26T17:31:08.133740] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-26T17:31:08.133838] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-26T17:31:08.135374] [DEBUG] [LOCAL ] BDC: Trimmed 35763 records to 25073 (keeping 200 days of data) [2025-09-26T17:31:08.358739] [DEBUG] [LOCAL ] BDC: Primary data saved (25073 records). [2025-09-26T17:31:08.358891] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-26T17:31:08.358976] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 22.6s. Estimated remaining: 4h 36m 2s. Rate: 7.7 symbols/min [2025-09-26T17:31:09.200332] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:09.245775] [DEBUG] [LOCAL ] BDN: No existing data file found in primary storage. [2025-09-26T17:31:09.286699] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:09.245546] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:09.287381] [DEBUG] [LOCAL ] BDJ: No existing data file found in primary storage. [2025-09-26T17:31:09.286882] [WARN ] [MAIN ] BDN: No existing data found, performing full refresh instead. [2025-09-26T17:31:09.278819] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:09.289424] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-26T17:31:09.289551] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-26T17:31:09.289788] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-09-26T17:31:09.289860] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-26T17:31:09.287819] [WARN ] [MAIN ] BDJ: No existing data found, performing full refresh instead. [2025-09-26T17:31:09.313589] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-26T17:31:09.328820] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-26T17:31:09.372863] [DEBUG] [LOCAL ] BDJ: No primary data file found to delete. [2025-09-26T17:31:09.390212] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-26T17:31:09.843020] [DEBUG] [LOCAL ] BE: Loaded 54043 existing records from primary storage. [2025-09-26T17:31:09.923304] [INFO ] [MAIN ] BE: Loaded 54043 existing records. [2025-09-26T17:31:09.980732] [DEBUG] [LOCAL ] BDX: Loaded 52828 existing records from primary storage. [2025-09-26T17:31:10.053114] [INFO ] [MAIN ] BDX: Loaded 52828 existing records. [2025-09-26T17:31:10.427108] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:10.522730] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-26T17:31:10.626413] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:10.669751] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-26T17:31:10.733586] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:31:10.785233] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-26T17:31:10.810200] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-26T17:31:10.817030] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-26T17:31:10.817321] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-26T17:31:10.817179] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:31:10.903303] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-26T17:31:10.915904] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-26T17:31:10.947724] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-26T17:31:10.968979] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-26T17:31:11.574011] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:11.592389] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-26T17:31:11.735277] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:11.735622] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-26T17:31:11.765262] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T17:31:11.772765] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-26T17:31:11.992188] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:31:12.002442] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-26T17:31:12.710544] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:31:12.719490] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-26T17:31:13.385555] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T17:31:13.397103] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-26T17:31:13.504591] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T17:31:13.511564] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-26T17:31:13.662355] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T17:31:13.674331] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-26T17:31:13.760161] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T17:31:13.771479] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-26T17:31:14.956217] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T17:31:14.967028] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-26T17:31:15.200015] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T17:31:15.213577] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-26T17:31:15.266485] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T17:31:15.537212] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-26T17:31:15.961907] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-26T17:31:15.975130] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T17:31:16.576853] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T17:31:16.756763] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-26T17:31:17.304935] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:31:17.556746] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-26T17:31:18.356715] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-26T17:31:18.543882] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T17:31:19.156760] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-26T17:31:19.244633] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T17:31:19.956770] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-26T17:31:20.215401] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T17:31:20.658896] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:31:20.756766] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-26T17:31:21.556693] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-26T17:31:21.594802] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T17:31:22.356780] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-26T17:31:22.749001] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T17:31:22.799851] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T17:31:23.156801] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-26T17:31:23.956740] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-26T17:31:24.569902] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-26T17:31:24.756766] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-26T17:31:24.996835] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T17:31:25.221282] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T17:31:25.556740] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-26T17:31:26.047801] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T17:31:26.356735] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-26T17:31:26.632252] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T17:31:27.156788] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-26T17:31:27.735462] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T17:31:27.956775] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-26T17:31:28.553455] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T17:31:28.756737] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-26T17:31:29.299607] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T17:31:29.556729] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-26T17:31:30.356744] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-26T17:31:30.474252] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T17:31:30.923201] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T17:31:30.933212] [INFO ] [REMOTE ] BDN: Full fetch complete (69230 records). [2025-09-26T17:31:30.933409] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-26T17:31:31.163799] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-26T17:31:31.372885] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-26T17:31:31.372989] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-26T17:31:31.373736] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-26T17:31:31.373806] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-26T17:31:31.375351] [DEBUG] [LOCAL ] BDN: Trimmed 69230 records to 48230 (keeping 200 days of data) [2025-09-26T17:31:31.673838] [DEBUG] [LOCAL ] BDN: Primary data saved (48230 records). [2025-09-26T17:31:31.674034] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-26T17:31:31.674149] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDN took 23.3s. Estimated remaining: 4h 38m 12s. Rate: 7.7 symbols/min [2025-09-26T17:31:31.881139] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:31.881623] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-26T17:31:31.881724] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-26T17:31:31.881960] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-26T17:31:31.882185] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-26T17:31:31.882273] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-26T17:31:31.882408] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-26T17:31:31.961237] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-26T17:31:32.284846] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T17:31:32.375414] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:32.379112] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T17:31:32.756788] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-26T17:31:33.556731] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-26T17:31:33.891335] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-26T17:31:34.356755] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-26T17:31:34.756588] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T17:31:34.773104] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-26T17:31:34.790222] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T17:31:34.796260] [INFO ] [REMOTE ] BDJ: Full fetch complete (42790 records). [2025-09-26T17:31:34.796386] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-26T17:31:35.165539] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-26T17:31:35.225225] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-26T17:31:35.225354] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-26T17:31:35.226247] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-26T17:31:35.226317] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-26T17:31:35.227593] [DEBUG] [LOCAL ] BDJ: Trimmed 42790 records to 29325 (keeping 200 days of data) [2025-09-26T17:31:35.426892] [DEBUG] [LOCAL ] BDJ: Primary data saved (29325 records). [2025-09-26T17:31:35.427059] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-26T17:31:35.427193] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDJ took 27.1s. Estimated remaining: 4h 37m 28s. Rate: 7.7 symbols/min [2025-09-26T17:31:35.620991] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:35.679936] [DEBUG] [LOCAL ] BEKE: Loaded 53637 existing records from primary storage. [2025-09-26T17:31:35.680091] [INFO ] [MAIN ] BEKE: Loaded 53637 existing records. [2025-09-26T17:31:35.875183] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:31:35.875503] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-26T17:31:35.875569] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-26T17:31:35.877871] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-26T17:31:35.877946] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-26T17:31:35.961845] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-26T17:31:36.260230] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:36.756761] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-26T17:31:37.025739] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-26T17:31:37.440962] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-26T17:31:37.532120] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T17:31:37.542564] [INFO ] [REMOTE ] BDX: Full fetch complete (75837 records). [2025-09-26T17:31:37.542788] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-26T17:31:37.565157] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-26T17:31:37.969466] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-26T17:31:37.969613] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-26T17:31:37.970589] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-26T17:31:37.970684] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-26T17:31:37.973365] [DEBUG] [LOCAL ] BDX: Trimmed 75837 records to 53191 (keeping 200 days of data) [2025-09-26T17:31:38.343704] [DEBUG] [LOCAL ] BDX: Primary data saved (53191 records). [2025-09-26T17:31:38.343859] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-26T17:31:38.344671] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDX took 30.0s. Estimated remaining: 4h 36m 37s. Rate: 7.7 symbols/min [2025-09-26T17:31:38.361674] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-26T17:31:38.537380] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:38.601089] [DEBUG] [LOCAL ] BEN: Loaded 53445 existing records from primary storage. [2025-09-26T17:31:38.601281] [INFO ] [MAIN ] BEN: Loaded 53445 existing records. [2025-09-26T17:31:38.735723] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-26T17:31:38.832950] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:31:38.833285] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-26T17:31:38.833343] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-26T17:31:38.835177] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-26T17:31:38.835248] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-26T17:31:39.156839] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-26T17:31:39.252181] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:39.486702] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T17:31:39.502574] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T17:31:39.956783] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-26T17:31:40.756746] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-26T17:31:41.556745] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-26T17:31:42.000867] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-26T17:31:42.003286] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T17:31:42.356775] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-26T17:31:42.538555] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T17:31:43.156755] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-26T17:31:43.559304] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T17:31:43.956744] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-26T17:31:44.289279] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-26T17:31:44.756735] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-26T17:31:45.091063] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-26T17:31:45.102400] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-09-26T17:31:45.102582] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-26T17:31:45.553231] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-26T17:31:45.553351] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-26T17:31:45.554353] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-26T17:31:45.554442] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-26T17:31:45.556549] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54433 (keeping 200 days of data) [2025-09-26T17:31:45.556734] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-26T17:31:45.900362] [DEBUG] [LOCAL ] BE: Primary data saved (54433 records). [2025-09-26T17:31:45.900515] [INFO ] [MAIN ] BE: Full history saved. [2025-09-26T17:31:45.900604] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BE took 37.5s. Estimated remaining: 4h 36m 27s. Rate: 7.7 symbols/min [2025-09-26T17:31:46.016084] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T17:31:46.147239] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:46.147513] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-09-26T17:31:46.147565] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-09-26T17:31:46.147714] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-26T17:31:46.147766] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-26T17:31:46.147809] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-09-26T17:31:46.147843] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-26T17:31:46.361891] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-26T17:31:46.559725] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:46.801854] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T17:31:47.156734] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-26T17:31:47.956783] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-26T17:31:48.297687] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-26T17:31:48.345147] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-26T17:31:48.585771] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:31:48.756737] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-26T17:31:49.556733] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-26T17:31:50.356734] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-26T17:31:50.804211] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T17:31:51.162251] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-26T17:31:51.167386] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:31:51.517141] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-26T17:31:51.517988] [INFO ] [REMOTE ] BEDU: Full fetch complete (1429 records). [2025-09-26T17:31:51.518060] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-26T17:31:51.731574] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-26T17:31:51.732007] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:31:51.732162] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:31:51.732285] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-26T17:31:51.732404] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-26T17:31:51.732512] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-26T17:31:51.732721] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-26T17:31:51.732830] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 20.1s. Estimated remaining: 4h 36m 3s. Rate: 7.7 symbols/min [2025-09-26T17:31:51.959579] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-26T17:31:51.945347] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:31:51.961292] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-09-26T17:31:51.961728] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-09-26T17:31:51.964491] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T17:31:51.965035] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-26T17:31:51.976215] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-26T17:31:51.976837] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-09-26T17:31:51.977259] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-26T17:31:52.358679] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:31:52.756792] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-26T17:31:53.556757] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-26T17:31:53.623098] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T17:31:54.356770] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-26T17:31:54.431837] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T17:31:55.156783] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-26T17:31:55.371880] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T17:31:55.858399] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T17:31:55.956720] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-26T17:31:56.686745] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T17:31:56.756734] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-26T17:31:57.556741] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-26T17:31:57.650103] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T17:31:58.356738] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-26T17:31:58.701470] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T17:31:58.817995] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T17:31:59.156756] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-26T17:31:59.629624] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:31:59.956772] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-26T17:32:00.309070] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T17:32:00.756774] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-26T17:32:01.556739] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-26T17:32:01.619878] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T17:32:02.356698] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-26T17:32:02.693050] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T17:32:03.156826] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-26T17:32:03.323841] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T17:32:03.459488] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:32:03.956766] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-26T17:32:04.727109] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:32:04.756692] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-26T17:32:05.561996] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-26T17:32:05.582105] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:32:05.825690] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:32:06.356746] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-26T17:32:07.157625] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-26T17:32:07.164761] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:32:07.957106] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-26T17:32:07.960419] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T17:32:08.420892] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:32:08.756745] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-26T17:32:09.557670] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:32:09.557802] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-26T17:32:09.815742] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T17:32:10.356739] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-26T17:32:11.019006] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:32:11.156797] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-26T17:32:11.633901] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:32:11.956792] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-26T17:32:12.691507] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T17:32:12.756790] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-26T17:32:13.181672] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T17:32:13.556742] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-26T17:32:14.356721] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-26T17:32:14.388112] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:32:14.399520] [INFO ] [REMOTE ] BEP: Full fetch complete (58019 records). [2025-09-26T17:32:14.399759] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-26T17:32:14.401583] [FATAL] [VALIDATOR ] BEP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:32:14.401882] [FATAL] [MAIN ] BEP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:32:14.401958] [WARN ] [MAIN ] BEP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:32:14.402054] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-26T17:32:14.402201] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-09-26T17:32:14.402265] [INFO ] [LOCAL ] BEP: Starting deletion of derivative data. [2025-09-26T17:32:14.402326] [DEBUG] [LOCAL ] BEP: No derivative data file found to delete. [2025-09-26T17:32:14.402451] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEP took 28.5s. Estimated remaining: 4h 38m 3s. Rate: 7.6 symbols/min [2025-09-26T17:32:14.607131] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:14.616236] [DEBUG] [LOCAL ] BEPH: Loaded 5160 existing records from primary storage. [2025-09-26T17:32:14.616403] [INFO ] [MAIN ] BEPH: Loaded 5160 existing records. [2025-09-26T17:32:14.829959] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:14.830245] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-26T17:32:14.830296] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-26T17:32:14.830707] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-26T17:32:14.830770] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-26T17:32:15.159979] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-26T17:32:15.289266] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:15.327719] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T17:32:15.339067] [INFO ] [REMOTE ] BEN: Full fetch complete (76887 records). [2025-09-26T17:32:15.339263] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-26T17:32:15.793280] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-26T17:32:15.793408] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-26T17:32:15.794507] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-26T17:32:15.794619] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-26T17:32:15.796840] [DEBUG] [LOCAL ] BEN: Trimmed 76887 records to 53833 (keeping 200 days of data) [2025-09-26T17:32:15.931399] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T17:32:15.956900] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-26T17:32:16.194410] [DEBUG] [LOCAL ] BEN: Primary data saved (53833 records). [2025-09-26T17:32:16.194582] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-26T17:32:16.195392] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEN took 37.9s. Estimated remaining: 4h 37m 3s. Rate: 7.7 symbols/min [2025-09-26T17:32:16.409921] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:16.417930] [DEBUG] [LOCAL ] BEPI: Loaded 3452 existing records from primary storage. [2025-09-26T17:32:16.418069] [INFO ] [MAIN ] BEPI: Loaded 3452 existing records. [2025-09-26T17:32:16.630135] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:16.630506] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-26T17:32:16.630564] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-26T17:32:16.630964] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-26T17:32:16.631027] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-26T17:32:16.764860] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-26T17:32:16.974442] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:32:17.043790] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:17.087689] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T17:32:17.098785] [INFO ] [REMOTE ] BEKE: Full fetch complete (76807 records). [2025-09-26T17:32:17.099013] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-26T17:32:17.100038] [FATAL] [VALIDATOR ] BEKE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:32:17.100137] [FATAL] [MAIN ] BEKE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:32:17.100184] [WARN ] [MAIN ] BEKE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:32:17.100262] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-26T17:32:17.100334] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-09-26T17:32:17.100405] [INFO ] [LOCAL ] BEKE: Starting deletion of derivative data. [2025-09-26T17:32:17.101295] [DEBUG] [LOCAL ] BEKE: Deleted derivative data file. [2025-09-26T17:32:17.101418] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEKE took 41.7s. Estimated remaining: 4h 35m 56s. Rate: 7.7 symbols/min [2025-09-26T17:32:17.288942] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:17.294251] [DEBUG] [LOCAL ] BEPJ: Loaded 3259 existing records from primary storage. [2025-09-26T17:32:17.294416] [INFO ] [MAIN ] BEPJ: Loaded 3259 existing records. [2025-09-26T17:32:17.486597] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:17.487026] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-26T17:32:17.487105] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-26T17:32:17.487530] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-26T17:32:17.487590] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-26T17:32:17.565583] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-26T17:32:17.890856] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:18.039698] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:32:18.070883] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T17:32:18.356753] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-26T17:32:19.110063] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T17:32:19.156775] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-26T17:32:19.956781] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-26T17:32:20.393702] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T17:32:20.654486] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T17:32:20.663934] [INFO ] [REMOTE ] BEPC: Full fetch complete (68471 records). [2025-09-26T17:32:20.664110] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-26T17:32:20.762060] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-26T17:32:21.074418] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-26T17:32:21.074525] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-26T17:32:21.075280] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-26T17:32:21.075353] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-26T17:32:21.076859] [DEBUG] [LOCAL ] BEPC: Trimmed 68471 records to 47209 (keeping 200 days of data) [2025-09-26T17:32:21.299796] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-26T17:32:21.376562] [DEBUG] [LOCAL ] BEPC: Primary data saved (47209 records). [2025-09-26T17:32:21.376773] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-26T17:32:21.376864] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPC took 29.6s. Estimated remaining: 4h 35m 18s. Rate: 7.7 symbols/min [2025-09-26T17:32:21.555504] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:21.555720] [DEBUG] [LOCAL ] BFAM: No existing data file found in primary storage. [2025-09-26T17:32:21.555772] [WARN ] [MAIN ] BFAM: No existing data found, performing full refresh instead. [2025-09-26T17:32:21.555923] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-26T17:32:21.555968] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-26T17:32:21.556010] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-09-26T17:32:21.556043] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-26T17:32:21.561977] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-26T17:32:21.968501] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:21.989930] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T17:32:22.356739] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-26T17:32:23.156783] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-26T17:32:23.724808] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T17:32:23.750616] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T17:32:23.956815] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-26T17:32:24.598514] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:32:24.756765] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-26T17:32:25.236667] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T17:32:25.556721] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-26T17:32:25.845823] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-26T17:32:26.356770] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-26T17:32:27.054548] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T17:32:27.156771] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-26T17:32:27.956739] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-26T17:32:28.557341] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T17:32:28.756735] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-26T17:32:28.820699] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T17:32:29.396491] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T17:32:29.556730] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-26T17:32:30.120288] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T17:32:30.356770] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-26T17:32:31.156751] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-26T17:32:31.726113] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-26T17:32:31.748394] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:32:31.956783] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-26T17:32:32.662193] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T17:32:32.756690] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-26T17:32:33.287896] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T17:32:33.556746] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-26T17:32:34.041793] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T17:32:34.042915] [INFO ] [REMOTE ] BEPI: Full fetch complete (4992 records). [2025-09-26T17:32:34.042986] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-26T17:32:34.361827] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-26T17:32:34.433280] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-26T17:32:34.433362] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-26T17:32:34.433531] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-26T17:32:34.433578] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-26T17:32:34.434037] [DEBUG] [LOCAL ] BEPI: Trimmed 4992 records to 3487 (keeping 200 days of data) [2025-09-26T17:32:34.457316] [DEBUG] [LOCAL ] BEPI: Primary data saved (3487 records). [2025-09-26T17:32:34.457450] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-26T17:32:34.457539] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPI took 18.3s. Estimated remaining: 4h 35m 56s. Rate: 7.7 symbols/min [2025-09-26T17:32:34.648544] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:34.694452] [DEBUG] [LOCAL ] BFH: Loaded 42012 existing records from primary storage. [2025-09-26T17:32:34.694625] [INFO ] [MAIN ] BFH: Loaded 42012 existing records. [2025-09-26T17:32:34.885056] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:34.885312] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-26T17:32:34.885361] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-26T17:32:34.886623] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-26T17:32:34.886744] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-26T17:32:35.148385] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T17:32:35.158635] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-26T17:32:35.306293] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:35.759031] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:32:35.956733] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-26T17:32:36.546982] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T17:32:36.756752] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-26T17:32:37.556743] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-26T17:32:37.889005] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T17:32:37.952754] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-26T17:32:38.356771] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-26T17:32:38.698629] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T17:32:39.156735] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-26T17:32:39.599893] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-26T17:32:39.956732] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-26T17:32:40.492810] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-26T17:32:40.756750] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-26T17:32:41.358800] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T17:32:41.556730] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-26T17:32:42.356752] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-26T17:32:42.857923] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:32:43.156723] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-26T17:32:43.728127] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T17:32:43.956764] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-26T17:32:44.347152] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T17:32:44.347374] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-26T17:32:44.756795] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-26T17:32:45.157144] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-26T17:32:45.556760] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-26T17:32:46.356749] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-26T17:32:47.000383] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T17:32:47.009335] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4487 records). [2025-09-26T17:32:47.021598] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-26T17:32:47.023160] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:32:47.161815] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-26T17:32:47.427628] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-26T17:32:47.427750] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-26T17:32:47.427906] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-26T17:32:47.427973] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-26T17:32:47.428578] [DEBUG] [LOCAL ] BEPJ: Trimmed 4487 records to 3268 (keeping 200 days of data) [2025-09-26T17:32:47.450219] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3268 records). [2025-09-26T17:32:47.450374] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-26T17:32:47.450513] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPJ took 30.3s. Estimated remaining: 4h 36m 32s. Rate: 7.7 symbols/min [2025-09-26T17:32:47.654773] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:47.670559] [DEBUG] [LOCAL ] BFK: Loaded 14083 existing records from primary storage. [2025-09-26T17:32:47.670741] [INFO ] [MAIN ] BFK: Loaded 14083 existing records. [2025-09-26T17:32:47.889889] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:47.890228] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-26T17:32:47.890286] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-26T17:32:47.890932] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-26T17:32:47.891000] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-26T17:32:47.962340] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-26T17:32:48.297926] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:48.756744] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-26T17:32:48.827009] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T17:32:48.827919] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T17:32:48.837058] [INFO ] [REMOTE ] BEPH: Full fetch complete (7547 records). [2025-09-26T17:32:48.837578] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-26T17:32:49.230663] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-26T17:32:49.230757] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-26T17:32:49.230980] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-26T17:32:49.231022] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-26T17:32:49.231434] [DEBUG] [LOCAL ] BEPH: Trimmed 7547 records to 5208 (keeping 200 days of data) [2025-09-26T17:32:49.262537] [DEBUG] [LOCAL ] BEPH: Primary data saved (5208 records). [2025-09-26T17:32:49.262628] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-26T17:32:49.262746] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPH took 34.9s. Estimated remaining: 4h 35m 33s. Rate: 7.7 symbols/min [2025-09-26T17:32:49.437815] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:32:49.493178] [DEBUG] [LOCAL ] BFLY: Loaded 52211 existing records from primary storage. [2025-09-26T17:32:49.493351] [INFO ] [MAIN ] BFLY: Loaded 52211 existing records. [2025-09-26T17:32:49.562448] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-26T17:32:49.706944] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T17:32:49.711431] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:32:49.715730] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-26T17:32:49.715796] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-26T17:32:49.717135] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-26T17:32:49.717212] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-26T17:32:50.124344] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:32:50.356729] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-26T17:32:50.806749] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T17:32:51.156742] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-26T17:32:51.900187] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T17:32:51.956731] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-26T17:32:52.416158] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T17:32:52.756767] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-26T17:32:53.280594] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:32:53.471318] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:32:53.556781] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-26T17:32:54.356758] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-26T17:32:54.724570] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:32:55.156736] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-26T17:32:55.790851] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:32:55.956717] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-26T17:32:56.050135] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T17:32:56.756728] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-26T17:32:57.384606] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:32:57.407223] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T17:32:57.556724] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-26T17:32:58.269197] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T17:32:58.356728] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-26T17:32:59.156697] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-26T17:32:59.220780] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:32:59.956737] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-26T17:33:00.756733] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-26T17:33:00.867234] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T17:33:00.920550] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T17:33:01.556747] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-26T17:33:02.356710] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-26T17:33:02.620203] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T17:33:02.884184] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T17:33:03.151941] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T17:33:03.160951] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-26T17:33:03.956737] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-26T17:33:04.761890] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-26T17:33:04.785689] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:33:05.231019] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:33:05.238330] [INFO ] [REMOTE ] BFAM: Full fetch complete (46960 records). [2025-09-26T17:33:05.238461] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-26T17:33:05.558156] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-26T17:33:05.583999] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T17:33:05.671498] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-26T17:33:05.671586] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-26T17:33:05.672133] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-26T17:33:05.672200] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-26T17:33:05.673415] [DEBUG] [LOCAL ] BFAM: Trimmed 46960 records to 33519 (keeping 200 days of data) [2025-09-26T17:33:05.883262] [DEBUG] [LOCAL ] BFAM: Primary data saved (33519 records). [2025-09-26T17:33:05.883413] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-26T17:33:05.883495] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFAM took 44.5s. Estimated remaining: 4h 36m 39s. Rate: 7.7 symbols/min [2025-09-26T17:33:06.056411] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:06.066386] [DEBUG] [LOCAL ] BFS: Loaded 9144 existing records from primary storage. [2025-09-26T17:33:06.066500] [INFO ] [MAIN ] BFS: Loaded 9144 existing records. [2025-09-26T17:33:06.270842] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:06.271095] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-26T17:33:06.271145] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-26T17:33:06.271606] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-26T17:33:06.271716] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-26T17:33:06.361847] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-26T17:33:06.665997] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:07.156700] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-26T17:33:07.417120] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T17:33:07.453040] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T17:33:07.458572] [INFO ] [REMOTE ] BFK: Full fetch complete (19343 records). [2025-09-26T17:33:07.458815] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-26T17:33:07.883889] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-26T17:33:07.883975] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-26T17:33:07.884309] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-26T17:33:07.884352] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-26T17:33:07.885036] [DEBUG] [LOCAL ] BFK: Trimmed 19343 records to 14145 (keeping 200 days of data) [2025-09-26T17:33:07.960784] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-26T17:33:07.980312] [DEBUG] [LOCAL ] BFK: Primary data saved (14145 records). [2025-09-26T17:33:07.980846] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-26T17:33:07.980953] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFK took 20.5s. Estimated remaining: 4h 35m 44s. Rate: 7.7 symbols/min [2025-09-26T17:33:08.166307] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:08.180304] [DEBUG] [LOCAL ] BFZ: Loaded 12147 existing records from primary storage. [2025-09-26T17:33:08.180437] [INFO ] [MAIN ] BFZ: Loaded 12147 existing records. [2025-09-26T17:33:08.382459] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:08.383256] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-26T17:33:08.383383] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-26T17:33:08.384028] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-26T17:33:08.384102] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-26T17:33:08.701899] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T17:33:08.777595] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:08.771571] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-26T17:33:08.804898] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:33:09.556727] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-26T17:33:09.654750] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T17:33:10.356743] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-26T17:33:10.692022] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T17:33:11.156772] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-26T17:33:11.854084] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T17:33:11.956777] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-26T17:33:12.157167] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T17:33:12.534091] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T17:33:12.756759] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-26T17:33:13.556715] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-26T17:33:13.603906] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:33:14.356715] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-26T17:33:14.377619] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T17:33:15.156768] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-26T17:33:15.919573] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T17:33:15.956803] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-26T17:33:16.474323] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T17:33:16.761868] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-26T17:33:16.784741] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:33:17.556739] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-26T17:33:17.910179] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T17:33:18.103198] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T17:33:18.356745] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-26T17:33:19.156753] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-26T17:33:19.956764] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-26T17:33:20.267922] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-26T17:33:20.530682] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T17:33:20.575859] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T17:33:20.583941] [INFO ] [REMOTE ] BFH: Full fetch complete (59688 records). [2025-09-26T17:33:20.584069] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-26T17:33:20.770749] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-26T17:33:21.036058] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-26T17:33:21.036218] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-26T17:33:21.037850] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-26T17:33:21.037981] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-26T17:33:21.045595] [DEBUG] [LOCAL ] BFH: Trimmed 59688 records to 42308 (keeping 200 days of data) [2025-09-26T17:33:21.333132] [DEBUG] [LOCAL ] BFH: Primary data saved (42308 records). [2025-09-26T17:33:21.333306] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-26T17:33:21.334605] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFH took 46.9s. Estimated remaining: 4h 36m 22s. Rate: 7.7 symbols/min [2025-09-26T17:33:21.542799] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:21.556738] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-26T17:33:21.604854] [DEBUG] [LOCAL ] BG: Loaded 50757 existing records from primary storage. [2025-09-26T17:33:21.604998] [INFO ] [MAIN ] BG: Loaded 50757 existing records. [2025-09-26T17:33:21.778197] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T17:33:21.838698] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:21.838983] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-26T17:33:21.839046] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-26T17:33:21.840703] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-26T17:33:21.840785] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-26T17:33:22.227169] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:22.356738] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-26T17:33:23.158045] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-26T17:33:23.161536] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T17:33:23.808362] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T17:33:23.822866] [INFO ] [REMOTE ] BFLY: Full fetch complete (75268 records). [2025-09-26T17:33:23.823034] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-26T17:33:23.961259] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-26T17:33:23.955928] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T17:33:24.269966] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-26T17:33:24.270320] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-26T17:33:24.271227] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-26T17:33:24.271311] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-26T17:33:24.276262] [DEBUG] [LOCAL ] BFLY: Trimmed 75268 records to 52590 (keeping 200 days of data) [2025-09-26T17:33:24.589889] [DEBUG] [LOCAL ] BFLY: Primary data saved (52590 records). [2025-09-26T17:33:24.590037] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-26T17:33:24.590140] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFLY took 35.3s. Estimated remaining: 4h 35m 36s. Rate: 7.7 symbols/min [2025-09-26T17:33:24.762961] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-26T17:33:24.786440] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:24.807791] [DEBUG] [LOCAL ] BGB: Loaded 17478 existing records from primary storage. [2025-09-26T17:33:24.808002] [INFO ] [MAIN ] BGB: Loaded 17478 existing records. [2025-09-26T17:33:25.018114] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:25.026619] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:33:25.026830] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-26T17:33:25.029926] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-26T17:33:25.030156] [INFO ] [REMOTE ] BFS: Full fetch complete (12645 records). [2025-09-26T17:33:25.030256] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-26T17:33:25.063350] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-26T17:33:25.089516] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-26T17:33:25.565771] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-26T17:33:25.873223] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-26T17:33:25.873427] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-26T17:33:25.873773] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-26T17:33:25.874668] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-26T17:33:25.898423] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:25.898961] [DEBUG] [LOCAL ] BFS: Trimmed 12645 records to 9240 (keeping 200 days of data) [2025-09-26T17:33:25.962777] [DEBUG] [LOCAL ] BFS: Primary data saved (9240 records). [2025-09-26T17:33:25.962906] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-26T17:33:25.962994] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFS took 20.1s. Estimated remaining: 4h 34m 35s. Rate: 7.7 symbols/min [2025-09-26T17:33:26.140358] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:26.160933] [DEBUG] [LOCAL ] BGH: Loaded 16544 existing records from primary storage. [2025-09-26T17:33:26.161110] [INFO ] [MAIN ] BGH: Loaded 16544 existing records. [2025-09-26T17:33:26.359065] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-26T17:33:26.366231] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:26.366720] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-26T17:33:26.366792] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-26T17:33:26.367689] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-26T17:33:26.367819] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-26T17:33:26.481957] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T17:33:26.814819] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:26.844570] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T17:33:27.156735] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-26T17:33:27.521824] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:33:27.633019] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T17:33:27.956728] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-26T17:33:28.756763] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-26T17:33:29.556774] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-26T17:33:29.813918] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T17:33:29.838109] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T17:33:30.356748] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-26T17:33:30.708578] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T17:33:31.101088] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T17:33:31.156740] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-26T17:33:31.956730] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-26T17:33:32.002005] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:33:32.756754] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-26T17:33:33.556720] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-26T17:33:33.574127] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T17:33:33.653905] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T17:33:34.356733] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-26T17:33:34.478469] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T17:33:35.156738] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-26T17:33:35.956707] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-26T17:33:36.153514] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T17:33:36.203859] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T17:33:36.551966] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T17:33:36.756756] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-26T17:33:37.458120] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:33:37.556721] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-26T17:33:38.356746] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-26T17:33:38.752783] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T17:33:39.156744] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-26T17:33:39.237319] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:33:39.956757] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-26T17:33:40.756751] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-26T17:33:40.989189] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T17:33:41.286606] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:33:41.291033] [INFO ] [REMOTE ] BFZ: Full fetch complete (18061 records). [2025-09-26T17:33:41.291133] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-26T17:33:41.561863] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-26T17:33:41.683506] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-26T17:33:41.683594] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-26T17:33:41.683952] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-26T17:33:41.684017] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-26T17:33:41.685366] [DEBUG] [LOCAL ] BFZ: Trimmed 18061 records to 12223 (keeping 200 days of data) [2025-09-26T17:33:41.770190] [DEBUG] [LOCAL ] BFZ: Primary data saved (12223 records). [2025-09-26T17:33:41.770876] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-26T17:33:41.771008] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 33.8s. Estimated remaining: 4h 35m 33s. Rate: 7.7 symbols/min [2025-09-26T17:33:41.875490] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T17:33:41.985798] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:42.003135] [DEBUG] [LOCAL ] BGR: Loaded 13568 existing records from primary storage. [2025-09-26T17:33:42.003305] [INFO ] [MAIN ] BGR: Loaded 13568 existing records. [2025-09-26T17:33:42.197760] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:42.198050] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-26T17:33:42.198102] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-26T17:33:42.198688] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-26T17:33:42.198752] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-26T17:33:42.361687] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-26T17:33:42.587714] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:43.156703] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-26T17:33:43.188491] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T17:33:43.629634] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T17:33:43.955332] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T17:33:43.959592] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-26T17:33:44.756773] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-26T17:33:45.556749] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-26T17:33:45.659249] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:33:45.691289] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:33:46.356697] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-26T17:33:46.444117] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T17:33:47.156745] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-26T17:33:47.194355] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:33:47.956738] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-26T17:33:48.059434] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T17:33:48.627582] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T17:33:48.756728] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-26T17:33:49.556733] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-26T17:33:49.842544] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T17:33:50.265632] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T17:33:50.356738] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-26T17:33:51.156718] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-26T17:33:51.346978] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T17:33:51.956732] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-26T17:33:52.756738] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-26T17:33:53.293335] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T17:33:53.422596] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T17:33:53.426342] [INFO ] [REMOTE ] BGH: Full fetch complete (21927 records). [2025-09-26T17:33:53.426426] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-26T17:33:53.561438] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-26T17:33:53.676902] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:33:53.863622] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-26T17:33:53.863740] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-26T17:33:53.864135] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-26T17:33:53.864199] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-26T17:33:53.865217] [DEBUG] [LOCAL ] BGH: Trimmed 21927 records to 16728 (keeping 200 days of data) [2025-09-26T17:33:53.973534] [DEBUG] [LOCAL ] BGH: Primary data saved (16728 records). [2025-09-26T17:33:53.973718] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-26T17:33:53.973847] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGH took 28.0s. Estimated remaining: 4h 36m 1s. Rate: 7.7 symbols/min [2025-09-26T17:33:54.159199] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:54.224159] [DEBUG] [LOCAL ] BGS: Loaded 50823 existing records from primary storage. [2025-09-26T17:33:54.224377] [INFO ] [MAIN ] BGS: Loaded 50823 existing records. [2025-09-26T17:33:54.361884] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-26T17:33:54.432207] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:33:54.432440] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-26T17:33:54.432489] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-26T17:33:54.433911] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-26T17:33:54.433973] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-26T17:33:54.815206] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:55.156725] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-26T17:33:55.448326] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T17:33:55.481716] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T17:33:55.485159] [INFO ] [REMOTE ] BGB: Full fetch complete (26924 records). [2025-09-26T17:33:55.485286] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-26T17:33:55.849312] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T17:33:55.926221] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-26T17:33:55.926313] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-26T17:33:55.926729] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-26T17:33:55.926799] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-26T17:33:55.927700] [DEBUG] [LOCAL ] BGB: Trimmed 26924 records to 17621 (keeping 200 days of data) [2025-09-26T17:33:55.978076] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-26T17:33:56.044331] [DEBUG] [LOCAL ] BGB: Primary data saved (17621 records). [2025-09-26T17:33:56.044467] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-26T17:33:56.044557] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BGB took 31.5s. Estimated remaining: 4h 35m 6s. Rate: 7.7 symbols/min [2025-09-26T17:33:56.229296] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:33:56.229564] [DEBUG] [LOCAL ] BGSF: No existing data file found in primary storage. [2025-09-26T17:33:56.229614] [WARN ] [MAIN ] BGSF: No existing data found, performing full refresh instead. [2025-09-26T17:33:56.229853] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-26T17:33:56.229906] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-26T17:33:56.229954] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-09-26T17:33:56.230029] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-26T17:33:56.610166] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:33:56.756707] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-26T17:33:57.430268] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T17:33:57.556731] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-26T17:33:57.781380] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:33:58.356770] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-26T17:33:58.612897] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T17:33:58.701485] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-26T17:33:59.156735] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-26T17:33:59.956728] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-26T17:34:00.471338] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T17:34:00.756700] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-26T17:34:01.090483] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T17:34:01.100770] [INFO ] [REMOTE ] BG: Full fetch complete (72765 records). [2025-09-26T17:34:01.100920] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-26T17:34:01.548081] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:34:01.565498] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-26T17:34:01.595838] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-26T17:34:01.597471] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-26T17:34:01.598543] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-26T17:34:01.598750] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-26T17:34:01.600497] [DEBUG] [LOCAL ] BG: Trimmed 72765 records to 51118 (keeping 200 days of data) [2025-09-26T17:34:01.933519] [DEBUG] [LOCAL ] BG: Primary data saved (51118 records). [2025-09-26T17:34:01.933706] [INFO ] [MAIN ] BG: Full history saved. [2025-09-26T17:34:01.933816] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BG took 40.6s. Estimated remaining: 4h 34m 43s. Rate: 7.7 symbols/min [2025-09-26T17:34:02.130194] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:02.130502] [DEBUG] [LOCAL ] BGT: No existing data file found in primary storage. [2025-09-26T17:34:02.130556] [WARN ] [MAIN ] BGT: No existing data found, performing full refresh instead. [2025-09-26T17:34:02.130825] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-26T17:34:02.130880] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-26T17:34:02.130925] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-09-26T17:34:02.130958] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-26T17:34:02.366003] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-26T17:34:02.543721] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:03.156750] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-26T17:34:03.250488] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T17:34:03.293286] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:34:03.537500] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-26T17:34:03.956749] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-26T17:34:04.427471] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T17:34:04.756759] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-26T17:34:05.168407] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T17:34:05.556725] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-26T17:34:06.356748] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-26T17:34:07.156760] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-26T17:34:07.185022] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T17:34:07.310156] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T17:34:07.953788] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T17:34:07.957247] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-26T17:34:08.756747] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-26T17:34:09.253789] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:34:09.556725] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-26T17:34:09.699966] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:34:10.356754] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-26T17:34:10.802883] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-26T17:34:11.156758] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-26T17:34:11.229031] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T17:34:11.927110] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T17:34:11.956716] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-26T17:34:12.756718] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-26T17:34:13.014228] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T17:34:13.556687] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-26T17:34:13.840839] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T17:34:13.843973] [INFO ] [REMOTE ] BGR: Full fetch complete (20230 records). [2025-09-26T17:34:13.844064] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-26T17:34:14.235284] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-26T17:34:14.235378] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-26T17:34:14.235757] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-26T17:34:14.235825] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-26T17:34:14.236557] [DEBUG] [LOCAL ] BGR: Trimmed 20230 records to 13658 (keeping 200 days of data) [2025-09-26T17:34:14.327542] [DEBUG] [LOCAL ] BGR: Primary data saved (13658 records). [2025-09-26T17:34:14.327746] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-26T17:34:14.327858] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGR took 32.6s. Estimated remaining: 4h 35m 12s. Rate: 7.7 symbols/min [2025-09-26T17:34:14.361822] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-26T17:34:14.546520] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:14.559486] [DEBUG] [LOCAL ] BGX: Loaded 10782 existing records from primary storage. [2025-09-26T17:34:14.559670] [INFO ] [MAIN ] BGX: Loaded 10782 existing records. [2025-09-26T17:34:14.753311] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:14.753965] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-26T17:34:14.754083] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-26T17:34:14.754711] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-26T17:34:14.754773] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-26T17:34:15.023562] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T17:34:15.059333] [INFO ] [REMOTE ] BGSF: Full fetch complete (8330 records). [2025-09-26T17:34:15.071079] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-26T17:34:15.180702] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-26T17:34:15.278948] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:15.569740] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-26T17:34:15.569836] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-26T17:34:15.570063] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-26T17:34:15.570106] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-26T17:34:15.570725] [DEBUG] [LOCAL ] BGSF: Trimmed 8330 records to 7050 (keeping 200 days of data) [2025-09-26T17:34:15.612361] [DEBUG] [LOCAL ] BGSF: Primary data saved (7050 records). [2025-09-26T17:34:15.612506] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-26T17:34:15.612589] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGSF took 19.6s. Estimated remaining: 4h 34m 12s. Rate: 7.7 symbols/min [2025-09-26T17:34:15.802253] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:15.825155] [DEBUG] [LOCAL ] BGY: Loaded 22657 existing records from primary storage. [2025-09-26T17:34:15.825291] [INFO ] [MAIN ] BGY: Loaded 22657 existing records. [2025-09-26T17:34:15.964305] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-26T17:34:16.028804] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:16.029208] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-26T17:34:16.029285] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-26T17:34:16.040156] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-26T17:34:16.040496] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-26T17:34:16.153101] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:34:16.393258] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T17:34:16.466625] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:16.756724] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-26T17:34:16.923972] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T17:34:17.427518] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T17:34:17.556751] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-26T17:34:18.199799] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-26T17:34:18.356728] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-26T17:34:19.151129] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T17:34:19.156673] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-26T17:34:19.956740] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-26T17:34:20.028637] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T17:34:20.756706] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-26T17:34:20.989365] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T17:34:21.556729] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-26T17:34:22.356716] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-26T17:34:22.527790] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T17:34:22.677329] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T17:34:23.156727] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-26T17:34:23.373508] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:34:23.823688] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T17:34:23.956762] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-26T17:34:24.756748] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-26T17:34:25.556702] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-26T17:34:25.640365] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T17:34:25.781027] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T17:34:26.356753] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-26T17:34:26.424294] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T17:34:27.156732] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-26T17:34:27.956703] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-26T17:34:28.233307] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T17:34:28.260147] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T17:34:28.756696] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-26T17:34:28.842696] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T17:34:29.556739] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-26T17:34:30.356735] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-26T17:34:30.510249] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-26T17:34:30.631695] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T17:34:31.156742] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-26T17:34:31.279776] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:34:31.956739] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-26T17:34:32.176331] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T17:34:32.756739] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-26T17:34:33.316107] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T17:34:33.556739] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-26T17:34:33.611367] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:34:33.622008] [INFO ] [REMOTE ] BGS: Full fetch complete (72492 records). [2025-09-26T17:34:33.622178] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-26T17:34:34.036829] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-26T17:34:34.036917] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-26T17:34:34.037723] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-26T17:34:34.037812] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-26T17:34:34.039368] [DEBUG] [LOCAL ] BGS: Trimmed 72492 records to 51183 (keeping 200 days of data) [2025-09-26T17:34:34.356135] [DEBUG] [LOCAL ] BGS: Primary data saved (51183 records). [2025-09-26T17:34:34.356375] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-26T17:34:34.359141] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGS took 40.4s. Estimated remaining: 4h 35m 31s. Rate: 7.6 symbols/min [2025-09-26T17:34:34.359215] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-26T17:34:34.581138] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:34.605546] [DEBUG] [LOCAL ] BH: Loaded 15800 existing records from primary storage. [2025-09-26T17:34:34.605710] [INFO ] [MAIN ] BH: Loaded 15800 existing records. [2025-09-26T17:34:34.796737] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:34.797236] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-26T17:34:34.797295] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-26T17:34:34.797926] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-26T17:34:34.797988] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-26T17:34:35.042276] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T17:34:35.137931] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T17:34:35.156944] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-26T17:34:35.220076] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:35.956769] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-26T17:34:36.288946] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T17:34:36.591009] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T17:34:36.756742] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-26T17:34:37.408499] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T17:34:37.411617] [INFO ] [REMOTE ] BGX: Full fetch complete (15855 records). [2025-09-26T17:34:37.411723] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-26T17:34:37.561886] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-26T17:34:37.817239] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-26T17:34:37.817323] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-26T17:34:37.817610] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-26T17:34:37.817676] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-26T17:34:37.818291] [DEBUG] [LOCAL ] BGX: Trimmed 15855 records to 10900 (keeping 200 days of data) [2025-09-26T17:34:37.884932] [DEBUG] [LOCAL ] BGX: Primary data saved (10900 records). [2025-09-26T17:34:37.885065] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-26T17:34:37.885167] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGX took 23.6s. Estimated remaining: 4h 34m 49s. Rate: 7.7 symbols/min [2025-09-26T17:34:38.077417] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:38.132907] [DEBUG] [LOCAL ] BHC: Loaded 47170 existing records from primary storage. [2025-09-26T17:34:38.133081] [INFO ] [MAIN ] BHC: Loaded 47170 existing records. [2025-09-26T17:34:38.330734] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:38.331053] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-26T17:34:38.331121] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-26T17:34:38.332320] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-26T17:34:38.332380] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-26T17:34:38.364819] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-26T17:34:38.720393] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:34:38.725922] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:39.156741] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-26T17:34:39.267995] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T17:34:39.956727] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-26T17:34:40.695000] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T17:34:40.756746] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-26T17:34:41.015922] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T17:34:41.519272] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:34:41.556727] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-26T17:34:42.356717] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-26T17:34:42.677471] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T17:34:42.681235] [INFO ] [REMOTE ] BGT: Full fetch complete (24333 records). [2025-09-26T17:34:42.681332] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-26T17:34:43.071905] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-26T17:34:43.071998] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-26T17:34:43.072358] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-26T17:34:43.072414] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-26T17:34:43.073210] [DEBUG] [LOCAL ] BGT: Trimmed 24333 records to 16793 (keeping 200 days of data) [2025-09-26T17:34:43.160003] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-26T17:34:43.190136] [DEBUG] [LOCAL ] BGT: Primary data saved (16793 records). [2025-09-26T17:34:43.190576] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-26T17:34:43.190868] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGT took 41.3s. Estimated remaining: 4h 34m 21s. Rate: 7.7 symbols/min [2025-09-26T17:34:43.380393] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:43.407457] [DEBUG] [LOCAL ] BHE: Loaded 25227 existing records from primary storage. [2025-09-26T17:34:43.407636] [INFO ] [MAIN ] BHE: Loaded 25227 existing records. [2025-09-26T17:34:43.603000] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:43.603257] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-26T17:34:43.603311] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-26T17:34:43.604133] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-26T17:34:43.604196] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-26T17:34:43.959474] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-26T17:34:44.015990] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:44.044993] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T17:34:44.067568] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T17:34:44.623847] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T17:34:44.756738] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-26T17:34:45.556730] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-26T17:34:46.067867] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:34:46.356734] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-26T17:34:46.803566] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:34:46.807395] [INFO ] [REMOTE ] BGY: Full fetch complete (33325 records). [2025-09-26T17:34:46.807490] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-26T17:34:47.161877] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-26T17:34:47.240350] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-26T17:34:47.240441] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-26T17:34:47.240887] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-26T17:34:47.240955] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-26T17:34:47.241773] [DEBUG] [LOCAL ] BGY: Trimmed 33325 records to 22790 (keeping 200 days of data) [2025-09-26T17:34:47.378396] [DEBUG] [LOCAL ] BGY: Primary data saved (22790 records). [2025-09-26T17:34:47.378536] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-26T17:34:47.378624] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 31.8s. Estimated remaining: 4h 33m 45s. Rate: 7.7 symbols/min [2025-09-26T17:34:47.580380] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:34:47.605791] [DEBUG] [LOCAL ] BHK: Loaded 22729 existing records from primary storage. [2025-09-26T17:34:47.606031] [INFO ] [MAIN ] BHK: Loaded 22729 existing records. [2025-09-26T17:34:47.817138] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:34:47.817572] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-26T17:34:47.817782] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-26T17:34:47.818708] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-26T17:34:47.818770] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-26T17:34:47.958793] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-26T17:34:48.181601] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T17:34:48.264169] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:34:48.490394] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:34:48.598960] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:34:48.756748] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-26T17:34:49.556760] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-26T17:34:49.809890] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:34:50.356717] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-26T17:34:50.382365] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T17:34:51.156712] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-26T17:34:51.561117] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T17:34:51.590735] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-26T17:34:51.956716] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-26T17:34:52.673285] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T17:34:52.756720] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-26T17:34:53.401607] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T17:34:53.556712] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-26T17:34:54.356728] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-26T17:34:54.616223] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:34:55.156764] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-26T17:34:55.759511] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T17:34:55.792733] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:34:55.956787] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-26T17:34:56.756728] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-26T17:34:57.326593] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T17:34:57.556742] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-26T17:34:57.911281] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T17:34:58.356770] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-26T17:34:59.080986] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:34:59.156801] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-26T17:34:59.631933] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T17:34:59.956719] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-26T17:35:00.181010] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T17:35:00.756758] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-26T17:35:01.325924] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T17:35:01.495805] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:35:01.556734] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-26T17:35:02.356703] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-26T17:35:02.882098] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T17:35:03.156720] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-26T17:35:03.404973] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T17:35:03.956743] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-26T17:35:04.038211] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:35:04.756777] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-26T17:35:05.476511] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T17:35:05.553563] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T17:35:05.559204] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-26T17:35:06.356728] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-26T17:35:06.887678] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:35:06.893531] [INFO ] [REMOTE ] BHK: Full fetch complete (29740 records). [2025-09-26T17:35:06.893779] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-26T17:35:07.161468] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-26T17:35:07.329133] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:35:07.341043] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-26T17:35:07.341799] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-26T17:35:07.342470] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-26T17:35:07.342562] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-26T17:35:07.341939] [INFO ] [REMOTE ] BH: Full fetch complete (19322 records). [2025-09-26T17:35:07.342768] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-26T17:35:07.343603] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:35:07.344108] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:35:07.344450] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:35:07.344539] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-26T17:35:07.344696] [DEBUG] [LOCAL ] BHK: Trimmed 29740 records to 22922 (keeping 200 days of data) [2025-09-26T17:35:07.344921] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-26T17:35:07.345317] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-09-26T17:35:07.346371] [DEBUG] [LOCAL ] BH: Deleted derivative data file. [2025-09-26T17:35:07.346496] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 33.0s. Estimated remaining: 4h 35m 12s. Rate: 7.6 symbols/min [2025-09-26T17:35:07.652295] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:07.705444] [DEBUG] [LOCAL ] BHK: Primary data saved (22922 records). [2025-09-26T17:35:07.705590] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-26T17:35:07.705706] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHK took 20.3s. Estimated remaining: 4h 34m 6s. Rate: 7.7 symbols/min [2025-09-26T17:35:07.933297] [DEBUG] [LOCAL ] BHP: Loaded 53763 existing records from primary storage. [2025-09-26T17:35:07.935416] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:07.935625] [INFO ] [MAIN ] BHP: Loaded 53763 existing records. [2025-09-26T17:35:07.961964] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-26T17:35:08.145503] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:08.153340] [DEBUG] [LOCAL ] BHR: Loaded 21634 existing records from primary storage. [2025-09-26T17:35:08.153595] [INFO ] [MAIN ] BHR: Loaded 21634 existing records. [2025-09-26T17:35:08.153495] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-26T17:35:08.158852] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-26T17:35:08.241551] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-26T17:35:08.270127] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-26T17:35:08.496902] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:08.517123] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-26T17:35:08.522455] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-26T17:35:08.566142] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-26T17:35:08.636057] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-26T17:35:08.871402] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:08.898253] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-26T17:35:09.182900] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T17:35:09.258960] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:09.273544] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T17:35:09.556726] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-26T17:35:10.356728] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-26T17:35:10.762276] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T17:35:10.937405] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:35:11.156758] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-26T17:35:11.629384] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T17:35:11.946608] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T17:35:11.956687] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-26T17:35:12.756740] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-26T17:35:12.996200] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:35:13.556730] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-26T17:35:14.356729] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-26T17:35:14.607874] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T17:35:14.629411] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:35:15.156740] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-26T17:35:15.840424] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T17:35:15.956754] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-26T17:35:16.756780] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-26T17:35:17.136124] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-26T17:35:17.343192] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T17:35:17.556725] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-26T17:35:18.356712] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-26T17:35:18.569977] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:35:18.581164] [INFO ] [REMOTE ] BHC: Full fetch complete (66893 records). [2025-09-26T17:35:18.581368] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-26T17:35:18.767327] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T17:35:18.884093] [INFO ] [REMOTE ] BHE: Full fetch complete (36380 records). [2025-09-26T17:35:18.932130] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-26T17:35:18.947340] [FATAL] [VALIDATOR ] BHE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:35:18.977203] [FATAL] [MAIN ] BHE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:35:18.991225] [WARN ] [MAIN ] BHE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:35:19.022691] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-26T17:35:19.040256] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-26T17:35:19.040524] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-09-26T17:35:19.040780] [INFO ] [LOCAL ] BHE: Starting deletion of derivative data. [2025-09-26T17:35:19.040858] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-26T17:35:19.041746] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-26T17:35:19.041799] [DEBUG] [LOCAL ] BHE: Deleted derivative data file. [2025-09-26T17:35:19.042004] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-26T17:35:19.042181] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHE took 35.9s. Estimated remaining: 4h 34m 25s. Rate: 7.7 symbols/min [2025-09-26T17:35:19.156799] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-26T17:35:19.145877] [DEBUG] [LOCAL ] BHC: Trimmed 66893 records to 47495 (keeping 200 days of data) [2025-09-26T17:35:19.336833] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:19.363982] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-26T17:35:19.364062] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-26T17:35:19.364449] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-26T17:35:19.364546] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-26T17:35:19.364612] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-26T17:35:19.364693] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-26T17:35:19.822038] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T17:35:19.969552] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-26T17:35:19.975891] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:19.969736] [DEBUG] [LOCAL ] BHC: Primary data saved (47495 records). [2025-09-26T17:35:19.977666] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-26T17:35:19.977818] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHC took 42.1s. Estimated remaining: 4h 33m 24s. Rate: 7.7 symbols/min [2025-09-26T17:35:20.162379] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:20.210586] [DEBUG] [LOCAL ] BHVN: Loaded 50018 existing records from primary storage. [2025-09-26T17:35:20.210768] [INFO ] [MAIN ] BHVN: Loaded 50018 existing records. [2025-09-26T17:35:20.400874] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:20.401189] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-26T17:35:20.401249] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-26T17:35:20.402683] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-26T17:35:20.402758] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-26T17:35:20.761917] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-26T17:35:20.801734] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:21.418117] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T17:35:21.421749] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-26T17:35:21.462924] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T17:35:21.556719] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-26T17:35:22.356736] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-26T17:35:22.881754] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T17:35:23.156761] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-26T17:35:23.956732] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-26T17:35:24.207472] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T17:35:24.241273] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-26T17:35:24.756747] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-26T17:35:24.811407] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T17:35:25.056230] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-26T17:35:25.556748] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-26T17:35:26.356773] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-26T17:35:26.710799] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T17:35:27.156753] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-26T17:35:27.311283] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T17:35:27.532078] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T17:35:27.956774] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-26T17:35:28.756768] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-26T17:35:29.339088] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T17:35:29.556728] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-26T17:35:30.356826] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-26T17:35:30.646300] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-26T17:35:30.649554] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T17:35:30.820384] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T17:35:31.156775] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-26T17:35:31.956763] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-26T17:35:32.756775] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-26T17:35:32.940417] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T17:35:33.116193] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T17:35:33.556764] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-26T17:35:34.012954] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T17:35:34.280669] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:35:34.356713] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-26T17:35:34.708397] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-26T17:35:35.156793] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-26T17:35:35.956747] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-26T17:35:36.756760] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-26T17:35:37.301096] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T17:35:37.341683] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-26T17:35:37.556723] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-26T17:35:37.678677] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T17:35:38.356730] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-26T17:35:38.663080] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-26T17:35:38.857295] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T17:35:39.156744] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-26T17:35:39.956764] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-26T17:35:40.756750] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-26T17:35:40.941223] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T17:35:41.556764] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-26T17:35:41.643760] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T17:35:41.681501] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T17:35:42.356764] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-26T17:35:42.926821] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T17:35:43.156729] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-26T17:35:43.741153] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T17:35:43.767707] [INFO ] [REMOTE ] BHVN: Full fetch complete (69623 records). [2025-09-26T17:35:43.768833] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T17:35:43.768947] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-26T17:35:43.775099] [INFO ] [REMOTE ] BHR: Full fetch complete (30571 records). [2025-09-26T17:35:43.775223] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-26T17:35:43.961800] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-26T17:35:44.690686] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-26T17:35:44.690540] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-26T17:35:44.690838] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-26T17:35:44.690883] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-26T17:35:44.691232] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-26T17:35:44.692018] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-26T17:35:44.692104] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-26T17:35:44.692354] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-26T17:35:44.693354] [DEBUG] [LOCAL ] BHR: Trimmed 30571 records to 21771 (keeping 200 days of data) [2025-09-26T17:35:44.742698] [DEBUG] [LOCAL ] BHVN: Trimmed 69623 records to 50401 (keeping 200 days of data) [2025-09-26T17:35:44.778800] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-26T17:35:44.925252] [DEBUG] [LOCAL ] BHR: Primary data saved (21771 records). [2025-09-26T17:35:44.925625] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-26T17:35:44.926045] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHR took 37.2s. Estimated remaining: 4h 35m 29s. Rate: 7.6 symbols/min [2025-09-26T17:35:45.154503] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:45.339823] [DEBUG] [LOCAL ] BILL: Loaded 52715 existing records from primary storage. [2025-09-26T17:35:45.358790] [INFO ] [MAIN ] BILL: Loaded 52715 existing records. [2025-09-26T17:35:45.509088] [DEBUG] [LOCAL ] BHVN: Primary data saved (50401 records). [2025-09-26T17:35:45.539338] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-26T17:35:45.566397] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHVN took 25.6s. Estimated remaining: 4h 34m 25s. Rate: 7.6 symbols/min [2025-09-26T17:35:45.572860] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:45.588179] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-26T17:35:45.621934] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-26T17:35:45.628274] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:35:45.642943] [INFO ] [REMOTE ] BHV: Full fetch complete (1368 records). [2025-09-26T17:35:45.657200] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-26T17:35:45.664342] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-26T17:35:45.669625] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-26T17:35:45.987030] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:46.204003] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-26T17:35:46.216873] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:35:46.237178] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:35:46.253728] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-26T17:35:46.292278] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-26T17:35:46.293147] [DEBUG] [LOCAL ] BIO: Loaded 25432 existing records from primary storage. [2025-09-26T17:35:46.293350] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-26T17:35:46.293747] [INFO ] [MAIN ] BIO: Loaded 25432 existing records. [2025-09-26T17:35:46.310128] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-26T17:35:46.337190] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHV took 27.3s. Estimated remaining: 4h 33m 23s. Rate: 7.7 symbols/min [2025-09-26T17:35:46.448959] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:46.492960] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-26T17:35:46.758098] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:46.766472] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-09-26T17:35:46.795159] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-26T17:35:46.848403] [INFO ] [REMOTE ] BHP: Full fetch complete (77245 records). [2025-09-26T17:35:46.818102] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-26T17:35:46.852370] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-26T17:35:46.852249] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:46.859191] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-26T17:35:46.903334] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-26T17:35:47.320156] [DEBUG] [LOCAL ] BIP: Loaded 39863 existing records from primary storage. [2025-09-26T17:35:47.406376] [INFO ] [MAIN ] BIP: Loaded 39863 existing records. [2025-09-26T17:35:47.861074] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-26T17:35:47.952661] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-26T17:35:48.012560] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:48.023767] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:48.024711] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-26T17:35:48.020250] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-26T17:35:48.026892] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-26T17:35:48.027024] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-26T17:35:48.027312] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-26T17:35:48.028921] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-26T17:35:48.029114] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-26T17:35:48.112973] [DEBUG] [LOCAL ] BHP: Trimmed 77245 records to 54153 (keeping 200 days of data) [2025-09-26T17:35:48.669265] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:48.670142] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-26T17:35:48.786353] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-26T17:35:48.816107] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-26T17:35:48.844570] [DEBUG] [LOCAL ] BHP: Primary data saved (54153 records). [2025-09-26T17:35:48.844765] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-26T17:35:48.846504] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BHP took 41.5s. Estimated remaining: 4h 32m 35s. Rate: 7.7 symbols/min [2025-09-26T17:35:49.038108] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:35:49.053077] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:35:49.057518] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-26T17:35:49.113817] [DEBUG] [LOCAL ] BIPC: Loaded 42014 existing records from primary storage. [2025-09-26T17:35:49.113990] [INFO ] [MAIN ] BIPC: Loaded 42014 existing records. [2025-09-26T17:35:49.323131] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:35:49.323405] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-26T17:35:49.323455] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-26T17:35:49.324616] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-26T17:35:49.324707] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-26T17:35:49.747708] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:35:49.748492] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-26T17:35:49.824257] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T17:35:49.915848] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:35:50.118552] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T17:35:50.356717] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-26T17:35:50.911057] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:35:51.156785] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-26T17:35:51.389556] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T17:35:51.929879] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T17:35:51.956728] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-26T17:35:52.756765] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-26T17:35:53.164883] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T17:35:53.556732] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-26T17:35:53.805557] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:35:54.356839] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-26T17:35:54.658921] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T17:35:55.156785] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-26T17:35:55.956769] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-26T17:35:56.253034] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T17:35:56.601239] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T17:35:56.756741] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-26T17:35:57.145070] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T17:35:57.556739] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-26T17:35:58.054724] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T17:35:58.356734] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-26T17:35:59.156741] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-26T17:35:59.234445] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T17:35:59.405055] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T17:35:59.956771] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-26T17:36:00.756761] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-26T17:36:01.113911] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T17:36:01.336760] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:36:01.556737] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-26T17:36:02.096806] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T17:36:02.356773] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-26T17:36:02.422031] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T17:36:03.156776] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-26T17:36:03.920353] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T17:36:03.956763] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-26T17:36:04.756760] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-26T17:36:05.057215] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:36:05.062964] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T17:36:05.556734] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-26T17:36:05.843088] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:36:06.356776] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-26T17:36:07.156738] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-26T17:36:07.411481] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:36:07.527185] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T17:36:07.956771] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-26T17:36:08.562681] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T17:36:08.756772] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-26T17:36:09.386798] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T17:36:09.556730] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-26T17:36:09.768210] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T17:36:10.356748] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-26T17:36:10.476924] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:36:11.156777] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-26T17:36:11.958945] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-26T17:36:11.965037] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:36:12.756760] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-26T17:36:13.015612] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T17:36:13.211577] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:36:13.216180] [INFO ] [REMOTE ] BIO: Full fetch complete (34146 records). [2025-09-26T17:36:13.216356] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-26T17:36:13.561855] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-26T17:36:13.627908] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-26T17:36:13.628025] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-26T17:36:13.628515] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-26T17:36:13.628560] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-26T17:36:13.629571] [DEBUG] [LOCAL ] BIO: Trimmed 34146 records to 25533 (keeping 200 days of data) [2025-09-26T17:36:13.814779] [DEBUG] [LOCAL ] BIO: Primary data saved (25533 records). [2025-09-26T17:36:13.814985] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-26T17:36:13.815156] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BIO took 28.2s. Estimated remaining: 4h 34m 37s. Rate: 7.6 symbols/min [2025-09-26T17:36:14.029004] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:14.034024] [DEBUG] [LOCAL ] BIPH: Loaded 2608 existing records from primary storage. [2025-09-26T17:36:14.034126] [INFO ] [MAIN ] BIPH: Loaded 2608 existing records. [2025-09-26T17:36:14.246072] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:14.246579] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-26T17:36:14.246680] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-26T17:36:14.246963] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-26T17:36:14.247027] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-26T17:36:14.362393] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-26T17:36:14.654380] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T17:36:14.745359] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:15.088306] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T17:36:15.156767] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-26T17:36:15.644186] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-26T17:36:15.946167] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:36:15.957243] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-26T17:36:16.756776] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-26T17:36:17.556718] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-26T17:36:17.590427] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:36:17.601025] [INFO ] [REMOTE ] BIP: Full fetch complete (56617 records). [2025-09-26T17:36:17.601210] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-26T17:36:18.024461] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-26T17:36:18.024699] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-26T17:36:18.025481] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-26T17:36:18.025630] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-26T17:36:18.033366] [DEBUG] [LOCAL ] BIP: Trimmed 56617 records to 40240 (keeping 200 days of data) [2025-09-26T17:36:18.120147] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T17:36:18.163775] [INFO ] [REMOTE ] BIPC: Full fetch complete (59708 records). [2025-09-26T17:36:18.166908] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-26T17:36:18.360960] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-26T17:36:18.629717] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-26T17:36:18.629840] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-26T17:36:18.630733] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-26T17:36:18.631905] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-26T17:36:18.636134] [DEBUG] [LOCAL ] BIPC: Trimmed 59708 records to 42317 (keeping 200 days of data) [2025-09-26T17:36:19.016688] [DEBUG] [LOCAL ] BIP: Primary data saved (40240 records). [2025-09-26T17:36:19.017600] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-26T17:36:19.017772] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BIP took 32.6s. Estimated remaining: 4h 34m 9s. Rate: 7.6 symbols/min [2025-09-26T17:36:19.058957] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T17:36:19.068206] [DEBUG] [LOCAL ] BIPC: Primary data saved (42317 records). [2025-09-26T17:36:19.068381] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-26T17:36:19.069857] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIPC took 30.2s. Estimated remaining: 4h 33m 3s. Rate: 7.7 symbols/min [2025-09-26T17:36:19.156778] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-26T17:36:19.516169] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T17:36:19.528176] [INFO ] [REMOTE ] BILL: Full fetch complete (75595 records). [2025-09-26T17:36:19.528386] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-26T17:36:19.629243] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T17:36:19.970033] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-26T17:36:19.974599] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-26T17:36:19.974683] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-26T17:36:19.975460] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-26T17:36:19.975675] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-26T17:36:19.978888] [DEBUG] [LOCAL ] BILL: Trimmed 75595 records to 53105 (keeping 200 days of data) [2025-09-26T17:36:20.313558] [DEBUG] [LOCAL ] BILL: Primary data saved (53105 records). [2025-09-26T17:36:20.313802] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-26T17:36:20.313927] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BILL took 35.4s. Estimated remaining: 4h 32m 5s. Rate: 7.7 symbols/min [2025-09-26T17:36:20.512883] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-26T17:36:20.756746] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-26T17:36:21.225413] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T17:36:21.556727] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-26T17:36:21.991520] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-26T17:36:22.356794] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-26T17:36:22.808960] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T17:36:23.156756] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-26T17:36:23.451015] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-26T17:36:23.956767] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-26T17:36:24.325025] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-26T17:36:24.756754] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-26T17:36:25.357862] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T17:36:25.358943] [INFO ] [REMOTE ] BIPH: Full fetch complete (4318 records). [2025-09-26T17:36:25.359013] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-26T17:36:25.754902] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-26T17:36:25.754987] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-26T17:36:25.755128] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-26T17:36:25.755167] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-26T17:36:25.755668] [DEBUG] [LOCAL ] BIPH: Trimmed 4318 records to 2632 (keeping 200 days of data) [2025-09-26T17:36:25.774590] [DEBUG] [LOCAL ] BIPH: Primary data saved (2632 records). [2025-09-26T17:36:25.774754] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-26T17:36:25.774854] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPH took 12.0s. Estimated remaining: 4h 31m 40s. Rate: 7.7 symbols/min [2025-09-26T17:36:26.494254] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:26.511223] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:26.556955] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:26.561123] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:26.571950] [DEBUG] [LOCAL ] BIPI: Loaded 3269 existing records from primary storage. [2025-09-26T17:36:26.572261] [INFO ] [MAIN ] BIPI: Loaded 3269 existing records. [2025-09-26T17:36:26.652948] [DEBUG] [LOCAL ] BIPJ: Loaded 3002 existing records from primary storage. [2025-09-26T17:36:26.685314] [INFO ] [MAIN ] BIPJ: Loaded 3002 existing records. [2025-09-26T17:36:26.766479] [DEBUG] [LOCAL ] BIT: Loaded 22535 existing records from primary storage. [2025-09-26T17:36:26.853594] [INFO ] [MAIN ] BIT: Loaded 22535 existing records. [2025-09-26T17:36:26.948724] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:26.983328] [DEBUG] [LOCAL ] BIRK: Loaded 51295 existing records from primary storage. [2025-09-26T17:36:27.004783] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-26T17:36:27.004602] [INFO ] [MAIN ] BIRK: Loaded 51295 existing records. [2025-09-26T17:36:27.004938] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-26T17:36:27.144121] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-26T17:36:27.246230] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-26T17:36:27.246035] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:27.307052] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-26T17:36:27.389361] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-26T17:36:27.497601] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-26T17:36:27.533097] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:27.533243] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-26T17:36:27.654902] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-26T17:36:27.649196] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:27.677823] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-26T17:36:27.740061] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-26T17:36:27.793568] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-26T17:36:27.804157] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-26T17:36:27.872066] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-26T17:36:28.030937] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-26T17:36:28.119544] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-26T17:36:28.236990] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:28.381056] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-26T17:36:28.771845] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:28.823985] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-26T17:36:29.095634] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:29.107237] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-26T17:36:29.174322] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:29.175065] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-26T17:36:29.410749] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:36:29.413573] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-26T17:36:29.420239] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T17:36:29.556710] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-26T17:36:29.744367] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-26T17:36:29.941281] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-26T17:36:30.107257] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T17:36:30.356735] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-26T17:36:30.608384] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T17:36:30.692885] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-26T17:36:31.156753] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-26T17:36:31.584628] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-26T17:36:31.956732] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-26T17:36:32.381197] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-26T17:36:32.756774] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-26T17:36:33.205850] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T17:36:33.556739] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-26T17:36:34.124880] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T17:36:34.356763] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-26T17:36:34.942864] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:36:35.156780] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-26T17:36:35.581634] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T17:36:35.956757] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-26T17:36:36.756762] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-26T17:36:36.777040] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T17:36:37.324552] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T17:36:37.556764] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-26T17:36:38.356766] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-26T17:36:38.464383] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T17:36:39.156744] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-26T17:36:39.956710] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-26T17:36:40.036166] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T17:36:40.143986] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T17:36:40.756732] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-26T17:36:40.943239] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T17:36:40.944678] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4351 records). [2025-09-26T17:36:40.944776] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-26T17:36:41.341841] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-26T17:36:41.341929] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-26T17:36:41.342131] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-26T17:36:41.342171] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-26T17:36:41.342542] [DEBUG] [LOCAL ] BIPJ: Trimmed 4351 records to 3026 (keeping 200 days of data) [2025-09-26T17:36:41.361940] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3026 records). [2025-09-26T17:36:41.362033] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-26T17:36:41.362113] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 15.6s. Estimated remaining: 4h 32m 30s. Rate: 7.7 symbols/min [2025-09-26T17:36:41.548442] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:41.556755] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-26T17:36:41.607248] [DEBUG] [LOCAL ] BJ: Loaded 51779 existing records from primary storage. [2025-09-26T17:36:41.607406] [INFO ] [MAIN ] BJ: Loaded 51779 existing records. [2025-09-26T17:36:41.804719] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:41.805024] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-26T17:36:41.805082] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-26T17:36:41.806603] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-26T17:36:41.806707] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-26T17:36:42.198585] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:42.218915] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:36:42.356789] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-26T17:36:42.365393] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T17:36:43.156761] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-26T17:36:43.333473] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T17:36:43.956801] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-26T17:36:44.595906] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T17:36:44.756701] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-26T17:36:44.877372] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T17:36:45.471432] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T17:36:45.556741] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-26T17:36:46.356705] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-26T17:36:46.753496] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:36:46.811424] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T17:36:47.156751] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-26T17:36:47.956767] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-26T17:36:48.405387] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T17:36:48.758284] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-26T17:36:48.764338] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:36:49.556724] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-26T17:36:49.824965] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T17:36:50.356740] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-26T17:36:51.037227] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T17:36:51.156749] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-26T17:36:51.637350] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T17:36:51.956739] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-26T17:36:52.639257] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T17:36:52.756734] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-26T17:36:53.120860] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T17:36:53.128288] [INFO ] [REMOTE ] BIT: Full fetch complete (31358 records). [2025-09-26T17:36:53.128419] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-26T17:36:53.551900] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-26T17:36:53.552006] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-26T17:36:53.552510] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-26T17:36:53.552576] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-26T17:36:53.553566] [DEBUG] [LOCAL ] BIT: Trimmed 31358 records to 22765 (keeping 200 days of data) [2025-09-26T17:36:53.607192] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-26T17:36:53.700639] [DEBUG] [LOCAL ] BIT: Primary data saved (22765 records). [2025-09-26T17:36:53.700819] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-26T17:36:53.700929] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIT took 27.9s. Estimated remaining: 4h 32m 56s. Rate: 7.7 symbols/min [2025-09-26T17:36:53.894190] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:53.947008] [DEBUG] [LOCAL ] BK: Loaded 53936 existing records from primary storage. [2025-09-26T17:36:53.947195] [INFO ] [MAIN ] BK: Loaded 53936 existing records. [2025-09-26T17:36:54.066162] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T17:36:54.153259] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:54.153724] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-26T17:36:54.153783] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-26T17:36:54.155257] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-26T17:36:54.155321] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-26T17:36:54.358083] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-26T17:36:54.360040] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T17:36:54.604966] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:54.989090] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T17:36:55.156761] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-26T17:36:55.956728] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-26T17:36:56.367214] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-26T17:36:56.368606] [INFO ] [REMOTE ] BIPI: Full fetch complete (5229 records). [2025-09-26T17:36:56.368732] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-26T17:36:56.768822] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-26T17:36:56.778019] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-26T17:36:56.778324] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-26T17:36:56.778522] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-26T17:36:56.778719] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-26T17:36:56.779416] [DEBUG] [LOCAL ] BIPI: Trimmed 5229 records to 3282 (keeping 200 days of data) [2025-09-26T17:36:56.839082] [DEBUG] [LOCAL ] BIPI: Primary data saved (3282 records). [2025-09-26T17:36:56.839522] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-26T17:36:56.839857] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIPI took 31.1s. Estimated remaining: 4h 32m 13s. Rate: 7.7 symbols/min [2025-09-26T17:36:56.841591] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T17:36:57.049206] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:36:57.116812] [DEBUG] [LOCAL ] BKD: Loaded 50514 existing records from primary storage. [2025-09-26T17:36:57.116966] [INFO ] [MAIN ] BKD: Loaded 50514 existing records. [2025-09-26T17:36:57.311747] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:36:57.312044] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-26T17:36:57.312094] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-26T17:36:57.313578] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-26T17:36:57.313673] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-26T17:36:57.569578] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-26T17:36:57.698237] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:36:58.356766] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-26T17:36:58.572539] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T17:36:59.156727] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-26T17:36:59.475719] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T17:36:59.637076] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T17:36:59.956755] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-26T17:37:00.691790] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:37:00.756744] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-26T17:37:01.439741] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T17:37:01.556734] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-26T17:37:02.356754] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-26T17:37:02.686162] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T17:37:03.156744] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-26T17:37:03.359961] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T17:37:03.956762] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-26T17:37:04.247928] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T17:37:04.415867] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T17:37:04.756772] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-26T17:37:05.556711] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-26T17:37:05.868511] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T17:37:06.356761] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-26T17:37:06.607781] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:37:06.805778] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T17:37:07.156738] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-26T17:37:07.956700] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-26T17:37:08.058291] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T17:37:08.421761] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:37:08.756744] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-26T17:37:09.185316] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T17:37:09.556738] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-26T17:37:10.356746] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-26T17:37:10.468872] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T17:37:10.947048] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T17:37:11.156730] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-26T17:37:11.910950] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:37:11.921452] [INFO ] [REMOTE ] BIRK: Full fetch complete (72918 records). [2025-09-26T17:37:11.921631] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-26T17:37:11.961914] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-26T17:37:12.348281] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-26T17:37:12.348383] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-26T17:37:12.349203] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-26T17:37:12.349283] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-26T17:37:12.350879] [DEBUG] [LOCAL ] BIRK: Trimmed 72918 records to 51674 (keeping 200 days of data) [2025-09-26T17:37:12.655328] [DEBUG] [LOCAL ] BIRK: Primary data saved (51674 records). [2025-09-26T17:37:12.655461] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-26T17:37:12.655543] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 46.9s. Estimated remaining: 4h 33m 4s. Rate: 7.6 symbols/min [2025-09-26T17:37:12.761803] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-26T17:37:12.856344] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:12.887371] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T17:37:12.929593] [DEBUG] [LOCAL ] BKE: Loaded 34985 existing records from primary storage. [2025-09-26T17:37:12.929785] [INFO ] [MAIN ] BKE: Loaded 34985 existing records. [2025-09-26T17:37:13.118379] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:13.118758] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-26T17:37:13.118830] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-26T17:37:13.120013] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-26T17:37:13.120077] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-26T17:37:13.497623] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:13.556723] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-26T17:37:13.742157] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T17:37:14.356780] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-26T17:37:14.499478] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T17:37:14.605787] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T17:37:15.156746] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-26T17:37:15.935862] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:37:15.956680] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-26T17:37:16.510532] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T17:37:16.756750] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-26T17:37:17.411839] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T17:37:17.556739] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-26T17:37:18.068065] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-26T17:37:18.356751] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-26T17:37:19.165142] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-26T17:37:19.185473] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:37:19.196528] [INFO ] [REMOTE ] BJ: Full fetch complete (73808 records). [2025-09-26T17:37:19.196701] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-26T17:37:19.631390] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-26T17:37:19.631546] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-26T17:37:19.632450] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-26T17:37:19.632520] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-26T17:37:19.634062] [DEBUG] [LOCAL ] BJ: Trimmed 73808 records to 52156 (keeping 200 days of data) [2025-09-26T17:37:19.881244] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T17:37:19.960722] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-26T17:37:20.006470] [DEBUG] [LOCAL ] BJ: Primary data saved (52156 records). [2025-09-26T17:37:20.006638] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-26T17:37:20.009357] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BJ took 38.6s. Estimated remaining: 4h 32m 53s. Rate: 7.6 symbols/min [2025-09-26T17:37:20.182507] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:20.225381] [DEBUG] [LOCAL ] BKH: Loaded 36896 existing records from primary storage. [2025-09-26T17:37:20.225533] [INFO ] [MAIN ] BKH: Loaded 36896 existing records. [2025-09-26T17:37:20.450189] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:20.450439] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-26T17:37:20.450490] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-26T17:37:20.451820] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-26T17:37:20.451883] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-26T17:37:20.759026] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-26T17:37:20.853346] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:20.884691] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T17:37:21.556739] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-26T17:37:21.841474] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T17:37:21.852629] [INFO ] [REMOTE ] BK: Full fetch complete (77481 records). [2025-09-26T17:37:21.852857] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-26T17:37:22.103016] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:37:22.310074] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-26T17:37:22.310158] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-26T17:37:22.310925] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-26T17:37:22.310991] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-26T17:37:22.312445] [DEBUG] [LOCAL ] BK: Trimmed 77481 records to 54319 (keeping 200 days of data) [2025-09-26T17:37:22.368301] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-26T17:37:22.648314] [DEBUG] [LOCAL ] BK: Primary data saved (54319 records). [2025-09-26T17:37:22.648475] [INFO ] [MAIN ] BK: Full history saved. [2025-09-26T17:37:22.649713] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 28.9s. Estimated remaining: 4h 32m 7s. Rate: 7.7 symbols/min [2025-09-26T17:37:22.827674] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:22.867488] [DEBUG] [LOCAL ] BKKT: Loaded 34785 existing records from primary storage. [2025-09-26T17:37:22.867709] [INFO ] [MAIN ] BKKT: Loaded 34785 existing records. [2025-09-26T17:37:23.077924] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:23.078427] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-26T17:37:23.078716] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-26T17:37:23.079951] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-26T17:37:23.080021] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-26T17:37:23.163054] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-26T17:37:23.289779] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T17:37:23.544010] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:23.613357] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:37:23.956766] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-26T17:37:24.354015] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T17:37:24.756730] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-26T17:37:25.222141] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:37:25.556738] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-26T17:37:25.869175] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T17:37:26.356729] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-26T17:37:27.082992] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T17:37:27.093545] [INFO ] [REMOTE ] BKD: Full fetch complete (71518 records). [2025-09-26T17:37:27.093746] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-26T17:37:27.163023] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-26T17:37:27.524668] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-26T17:37:27.524950] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-26T17:37:27.525892] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-26T17:37:27.526002] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-26T17:37:27.527812] [DEBUG] [LOCAL ] BKD: Trimmed 71518 records to 50889 (keeping 200 days of data) [2025-09-26T17:37:27.635004] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:37:27.846975] [DEBUG] [LOCAL ] BKD: Primary data saved (50889 records). [2025-09-26T17:37:27.847161] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-26T17:37:27.847262] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BKD took 31.0s. Estimated remaining: 4h 31m 40s. Rate: 7.7 symbols/min [2025-09-26T17:37:27.960907] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-26T17:37:28.033755] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:28.043280] [DEBUG] [LOCAL ] BKN: Loaded 7820 existing records from primary storage. [2025-09-26T17:37:28.043399] [INFO ] [MAIN ] BKN: Loaded 7820 existing records. [2025-09-26T17:37:28.238115] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:28.238405] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-26T17:37:28.238478] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-26T17:37:28.238938] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-26T17:37:28.239028] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-26T17:37:28.625768] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:28.756732] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-26T17:37:28.797445] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T17:37:29.556790] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-26T17:37:29.692020] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T17:37:29.875639] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T17:37:30.356733] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-26T17:37:30.629192] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T17:37:31.156735] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-26T17:37:31.735021] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T17:37:31.956755] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-26T17:37:32.317147] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T17:37:32.756725] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-26T17:37:32.870695] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T17:37:33.556736] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-26T17:37:34.246772] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T17:37:34.356740] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-26T17:37:34.534581] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T17:37:34.887372] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:37:35.156746] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-26T17:37:35.956737] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-26T17:37:36.756725] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-26T17:37:36.817607] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T17:37:37.247677] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:37:37.556719] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-26T17:37:38.365259] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-26T17:37:38.368567] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T17:37:38.878631] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:37:38.886248] [INFO ] [REMOTE ] BKE: Full fetch complete (50214 records). [2025-09-26T17:37:38.886448] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-26T17:37:39.019089] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T17:37:39.161805] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-26T17:37:39.310627] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-26T17:37:39.310792] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-26T17:37:39.312265] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-26T17:37:39.312346] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-26T17:37:39.313781] [DEBUG] [LOCAL ] BKE: Trimmed 50214 records to 35206 (keeping 200 days of data) [2025-09-26T17:37:39.546599] [DEBUG] [LOCAL ] BKE: Primary data saved (35206 records). [2025-09-26T17:37:39.546989] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-26T17:37:39.551791] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKE took 26.9s. Estimated remaining: 4h 32m 0s. Rate: 7.7 symbols/min [2025-09-26T17:37:39.817309] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:39.878558] [DEBUG] [LOCAL ] BKSY: Loaded 48651 existing records from primary storage. [2025-09-26T17:37:39.878769] [INFO ] [MAIN ] BKSY: Loaded 48651 existing records. [2025-09-26T17:37:39.964266] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-26T17:37:40.069173] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T17:37:40.154972] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:40.155381] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-26T17:37:40.155456] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-26T17:37:40.157222] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-26T17:37:40.157395] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-26T17:37:40.702069] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:40.756931] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-26T17:37:41.524317] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T17:37:41.556710] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-26T17:37:42.227426] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:37:42.356741] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-26T17:37:42.488247] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T17:37:43.156736] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-26T17:37:43.822604] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T17:37:43.956720] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-26T17:37:44.246836] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:37:44.756727] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-26T17:37:45.201842] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:37:45.556723] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-26T17:37:46.015809] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-26T17:37:46.306823] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T17:37:46.356755] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-26T17:37:47.073130] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T17:37:47.156773] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-26T17:37:47.956774] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-26T17:37:48.413085] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T17:37:48.461189] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T17:37:48.756738] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-26T17:37:49.556734] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-26T17:37:50.361863] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-26T17:37:50.375232] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:37:50.396803] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T17:37:51.156732] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-26T17:37:51.808489] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T17:37:51.956699] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-26T17:37:52.134374] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T17:37:52.756762] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-26T17:37:52.847412] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T17:37:52.849746] [INFO ] [REMOTE ] BKN: Full fetch complete (11981 records). [2025-09-26T17:37:52.849832] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-26T17:37:53.255708] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-26T17:37:53.255799] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-26T17:37:53.256083] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-26T17:37:53.256144] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-26T17:37:53.256680] [DEBUG] [LOCAL ] BKN: Trimmed 11981 records to 7853 (keeping 200 days of data) [2025-09-26T17:37:53.306846] [DEBUG] [LOCAL ] BKN: Primary data saved (7853 records). [2025-09-26T17:37:53.307010] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-26T17:37:53.307137] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKN took 25.5s. Estimated remaining: 4h 32m 35s. Rate: 7.6 symbols/min [2025-09-26T17:37:53.496152] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:53.509144] [DEBUG] [LOCAL ] BKT: Loaded 11032 existing records from primary storage. [2025-09-26T17:37:53.509277] [INFO ] [MAIN ] BKT: Loaded 11032 existing records. [2025-09-26T17:37:53.561788] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-26T17:37:53.730225] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:53.730512] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-26T17:37:53.730571] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-26T17:37:53.731222] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-26T17:37:53.731303] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-26T17:37:54.104546] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:54.356740] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-26T17:37:54.898869] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T17:37:54.992813] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:37:55.156741] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-26T17:37:55.804801] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T17:37:55.956780] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-26T17:37:56.756729] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-26T17:37:56.777118] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T17:37:56.803152] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T17:37:56.814282] [INFO ] [REMOTE ] BKH: Full fetch complete (52231 records). [2025-09-26T17:37:56.814428] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-26T17:37:57.389730] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-26T17:37:57.389880] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-26T17:37:57.390766] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-26T17:37:57.390840] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-26T17:37:57.392304] [DEBUG] [LOCAL ] BKH: Trimmed 52231 records to 37133 (keeping 200 days of data) [2025-09-26T17:37:57.558825] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-26T17:37:57.690234] [DEBUG] [LOCAL ] BKH: Primary data saved (37133 records). [2025-09-26T17:37:57.690407] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-26T17:37:57.691300] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKH took 37.7s. Estimated remaining: 4h 32m 2s. Rate: 7.6 symbols/min [2025-09-26T17:37:57.862951] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:37:57.910277] [DEBUG] [LOCAL ] BKU: Loaded 42162 existing records from primary storage. [2025-09-26T17:37:57.910422] [INFO ] [MAIN ] BKU: Loaded 42162 existing records. [2025-09-26T17:37:58.093964] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:37:58.094483] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-26T17:37:58.094545] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-26T17:37:58.095869] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-26T17:37:58.095933] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-26T17:37:58.357248] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-26T17:37:58.486757] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:37:58.515344] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T17:37:58.521636] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T17:37:59.156742] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-26T17:37:59.961844] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-26T17:37:59.975854] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T17:38:00.756740] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-26T17:38:00.776918] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T17:38:01.415147] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-26T17:38:01.427911] [INFO ] [REMOTE ] BKKT: Full fetch complete (49906 records). [2025-09-26T17:38:01.428149] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-26T17:38:01.561807] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-26T17:38:01.854585] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-26T17:38:01.854692] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-26T17:38:01.855307] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-26T17:38:01.855354] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-26T17:38:01.856415] [DEBUG] [LOCAL ] BKKT: Trimmed 49906 records to 35164 (keeping 200 days of data) [2025-09-26T17:38:02.069099] [DEBUG] [LOCAL ] BKKT: Primary data saved (35164 records). [2025-09-26T17:38:02.069263] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-26T17:38:02.069355] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKKT took 39.4s. Estimated remaining: 4h 31m 30s. Rate: 7.7 symbols/min [2025-09-26T17:38:02.251373] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:02.281683] [DEBUG] [LOCAL ] BKV: Loaded 29986 existing records from primary storage. [2025-09-26T17:38:02.281854] [INFO ] [MAIN ] BKV: Loaded 29986 existing records. [2025-09-26T17:38:02.356814] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-26T17:38:02.481429] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:02.481872] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-26T17:38:02.482047] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-26T17:38:02.492160] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-26T17:38:02.510242] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-26T17:38:02.573731] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T17:38:02.963300] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:38:02.996816] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:03.138846] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T17:38:03.156699] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-26T17:38:03.956727] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-26T17:38:04.174583] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T17:38:04.756735] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-26T17:38:05.556743] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-26T17:38:06.005900] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T17:38:06.141336] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:38:06.181975] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T17:38:06.356777] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-26T17:38:07.156690] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-26T17:38:07.240613] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:38:07.956747] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-26T17:38:08.571447] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:38:08.756756] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-26T17:38:08.789340] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T17:38:09.556764] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-26T17:38:10.356742] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-26T17:38:10.951497] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-26T17:38:10.987439] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T17:38:11.034538] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T17:38:11.156759] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-26T17:38:11.956745] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-26T17:38:12.638687] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:38:12.756767] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-26T17:38:13.269097] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:38:13.414199] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T17:38:13.556734] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-26T17:38:14.356691] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-26T17:38:14.756426] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T17:38:14.763011] [INFO ] [REMOTE ] BKT: Full fetch complete (15052 records). [2025-09-26T17:38:14.763217] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-26T17:38:15.166934] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-26T17:38:15.166726] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-26T17:38:15.168042] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-26T17:38:15.168459] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-26T17:38:15.168556] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-26T17:38:15.169448] [DEBUG] [LOCAL ] BKT: Trimmed 15052 records to 11125 (keeping 200 days of data) [2025-09-26T17:38:15.247962] [DEBUG] [LOCAL ] BKT: Primary data saved (11125 records). [2025-09-26T17:38:15.248108] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-26T17:38:15.248285] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKT took 21.9s. Estimated remaining: 4h 32m 0s. Rate: 7.6 symbols/min [2025-09-26T17:38:15.424051] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:15.465525] [DEBUG] [LOCAL ] BLCO: Loaded 35907 existing records from primary storage. [2025-09-26T17:38:15.465716] [INFO ] [MAIN ] BLCO: Loaded 35907 existing records. [2025-09-26T17:38:15.676400] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:15.677876] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-26T17:38:15.677974] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-26T17:38:15.679550] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-26T17:38:15.679625] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-26T17:38:15.966271] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-26T17:38:16.074050] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:16.326637] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T17:38:16.339206] [INFO ] [REMOTE ] BKSY: Full fetch complete (69425 records). [2025-09-26T17:38:16.339386] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-26T17:38:16.765218] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-26T17:38:16.761526] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-26T17:38:16.766594] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-26T17:38:16.767561] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-26T17:38:16.768022] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-26T17:38:16.769581] [DEBUG] [LOCAL ] BKSY: Trimmed 69425 records to 48993 (keeping 200 days of data) [2025-09-26T17:38:16.903376] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T17:38:17.102463] [DEBUG] [LOCAL ] BKSY: Primary data saved (48993 records). [2025-09-26T17:38:17.102617] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-26T17:38:17.102764] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKSY took 37.6s. Estimated remaining: 4h 31m 10s. Rate: 7.7 symbols/min [2025-09-26T17:38:17.285744] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:17.314847] [DEBUG] [LOCAL ] BLD: Loaded 28248 existing records from primary storage. [2025-09-26T17:38:17.314994] [INFO ] [MAIN ] BLD: Loaded 28248 existing records. [2025-09-26T17:38:17.507763] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:17.508287] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-26T17:38:17.508418] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-26T17:38:17.509342] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-26T17:38:17.509403] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-26T17:38:17.567265] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-26T17:38:17.845441] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T17:38:17.940850] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:18.324603] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T17:38:18.356694] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-26T17:38:18.949331] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:38:19.156753] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-26T17:38:19.412422] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T17:38:19.956780] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-26T17:38:20.157200] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:38:20.756799] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-26T17:38:21.364120] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T17:38:21.556719] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-26T17:38:21.848833] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T17:38:22.356730] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-26T17:38:23.156723] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-26T17:38:23.232970] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T17:38:23.572213] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T17:38:23.956758] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-26T17:38:24.331076] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:38:24.756801] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-26T17:38:24.936593] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T17:38:25.556717] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-26T17:38:25.844450] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T17:38:26.356733] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-26T17:38:26.801932] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:38:27.156732] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-26T17:38:27.724697] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T17:38:27.956751] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-26T17:38:28.756716] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-26T17:38:28.810235] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T17:38:28.893424] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T17:38:28.899244] [INFO ] [REMOTE ] BKV: Full fetch complete (44972 records). [2025-09-26T17:38:28.899373] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-26T17:38:29.298815] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-26T17:38:29.298902] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-26T17:38:29.299465] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-26T17:38:29.299530] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-26T17:38:29.300628] [DEBUG] [LOCAL ] BKV: Trimmed 44972 records to 30278 (keeping 200 days of data) [2025-09-26T17:38:29.495591] [DEBUG] [LOCAL ] BKV: Primary data saved (30278 records). [2025-09-26T17:38:29.495800] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-26T17:38:29.496005] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKV took 27.4s. Estimated remaining: 4h 31m 34s. Rate: 7.6 symbols/min [2025-09-26T17:38:29.565211] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-26T17:38:29.698963] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:29.755374] [DEBUG] [LOCAL ] BLDR: Loaded 52046 existing records from primary storage. [2025-09-26T17:38:29.755546] [INFO ] [MAIN ] BLDR: Loaded 52046 existing records. [2025-09-26T17:38:29.960488] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:29.960939] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-26T17:38:29.961087] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-26T17:38:29.962588] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-26T17:38:29.962678] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-26T17:38:30.106072] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T17:38:30.361884] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-26T17:38:30.393477] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:30.749828] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T17:38:31.156747] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-26T17:38:31.500360] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:38:31.956733] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-26T17:38:32.518617] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:38:32.756734] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-26T17:38:33.496605] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:38:33.504701] [INFO ] [REMOTE ] BKU: Full fetch complete (59781 records). [2025-09-26T17:38:33.504835] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-26T17:38:33.565725] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-26T17:38:33.930873] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-26T17:38:33.931063] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-26T17:38:33.931881] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-26T17:38:33.932061] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-26T17:38:33.933474] [DEBUG] [LOCAL ] BKU: Trimmed 59781 records to 42412 (keeping 200 days of data) [2025-09-26T17:38:34.056197] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T17:38:34.235704] [DEBUG] [LOCAL ] BKU: Primary data saved (42412 records). [2025-09-26T17:38:34.235843] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-26T17:38:34.235932] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKU took 36.5s. Estimated remaining: 4h 31m 4s. Rate: 7.7 symbols/min [2025-09-26T17:38:34.361797] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-26T17:38:34.427732] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:34.446171] [DEBUG] [LOCAL ] BLE: Loaded 14657 existing records from primary storage. [2025-09-26T17:38:34.446327] [INFO ] [MAIN ] BLE: Loaded 14657 existing records. [2025-09-26T17:38:34.661767] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:34.662136] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-26T17:38:34.662192] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-26T17:38:34.662737] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-26T17:38:34.662802] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-26T17:38:35.075049] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:35.156687] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-26T17:38:35.517430] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T17:38:35.519721] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T17:38:35.956786] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-26T17:38:36.321070] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:38:36.756724] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-26T17:38:37.292624] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-26T17:38:37.326033] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T17:38:37.556732] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-26T17:38:38.356738] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-26T17:38:39.016693] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T17:38:39.156731] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-26T17:38:39.249425] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:38:39.956722] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-26T17:38:39.998317] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T17:38:40.756727] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-26T17:38:41.263988] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:38:41.556726] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-26T17:38:42.356710] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-26T17:38:42.475979] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:38:43.156712] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-26T17:38:43.283966] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T17:38:43.305929] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:38:43.956738] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-26T17:38:44.329385] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T17:38:44.654620] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T17:38:44.756716] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-26T17:38:45.556714] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-26T17:38:46.356752] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-26T17:38:46.455053] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T17:38:46.656491] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:38:47.156736] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-26T17:38:47.689851] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T17:38:47.695896] [INFO ] [REMOTE ] BLD: Full fetch complete (40423 records). [2025-09-26T17:38:47.696082] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-26T17:38:47.962442] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-26T17:38:47.962271] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T17:38:48.163516] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-26T17:38:48.163614] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-26T17:38:48.164139] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-26T17:38:48.164202] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-26T17:38:48.165264] [DEBUG] [LOCAL ] BLD: Trimmed 40423 records to 28408 (keeping 200 days of data) [2025-09-26T17:38:48.341559] [DEBUG] [LOCAL ] BLD: Primary data saved (28408 records). [2025-09-26T17:38:48.341763] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-26T17:38:48.341863] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLD took 31.2s. Estimated remaining: 4h 31m 40s. Rate: 7.6 symbols/min [2025-09-26T17:38:48.524752] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:48.564186] [DEBUG] [LOCAL ] BLK: Loaded 35037 existing records from primary storage. [2025-09-26T17:38:48.564351] [INFO ] [MAIN ] BLK: Loaded 35037 existing records. [2025-09-26T17:38:48.766337] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-26T17:38:48.773679] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:48.773934] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-26T17:38:48.773987] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-26T17:38:48.775168] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-26T17:38:48.775232] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-26T17:38:49.172553] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:49.407767] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:38:49.556731] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-26T17:38:49.647261] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T17:38:50.356739] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-26T17:38:51.156772] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-26T17:38:51.218931] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:38:51.392142] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T17:38:51.956791] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-26T17:38:52.730774] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:38:52.756687] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-26T17:38:53.388866] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:38:53.556718] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-26T17:38:53.637838] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:38:54.356769] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-26T17:38:54.635816] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T17:38:55.156752] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-26T17:38:55.963349] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-26T17:38:55.979218] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T17:38:56.231620] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:38:56.239852] [INFO ] [REMOTE ] BLCO: Full fetch complete (52746 records). [2025-09-26T17:38:56.240011] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-26T17:38:56.641146] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-26T17:38:56.641272] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-26T17:38:56.641887] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-26T17:38:56.641952] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-26T17:38:56.643189] [DEBUG] [LOCAL ] BLCO: Trimmed 52746 records to 36110 (keeping 200 days of data) [2025-09-26T17:38:56.757000] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-26T17:38:56.875456] [DEBUG] [LOCAL ] BLCO: Primary data saved (36110 records). [2025-09-26T17:38:56.875669] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-26T17:38:56.875830] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLCO took 41.6s. Estimated remaining: 4h 31m 37s. Rate: 7.6 symbols/min [2025-09-26T17:38:57.056290] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:57.104141] [DEBUG] [LOCAL ] BLND: Loaded 49802 existing records from primary storage. [2025-09-26T17:38:57.104312] [INFO ] [MAIN ] BLND: Loaded 49802 existing records. [2025-09-26T17:38:57.291822] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:38:57.292314] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-26T17:38:57.292521] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-26T17:38:57.293893] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-26T17:38:57.293970] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-26T17:38:57.557669] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-26T17:38:57.585238] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T17:38:57.616839] [INFO ] [REMOTE ] BLE: Full fetch complete (20485 records). [2025-09-26T17:38:57.627871] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-26T17:38:57.812453] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:57.854980] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T17:38:58.149292] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-26T17:38:58.149388] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-26T17:38:58.149784] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-26T17:38:58.149847] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-26T17:38:58.150479] [DEBUG] [LOCAL ] BLE: Trimmed 20485 records to 14718 (keeping 200 days of data) [2025-09-26T17:38:58.250614] [DEBUG] [LOCAL ] BLE: Primary data saved (14718 records). [2025-09-26T17:38:58.250794] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-26T17:38:58.250905] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLE took 24.0s. Estimated remaining: 4h 30m 44s. Rate: 7.7 symbols/min [2025-09-26T17:38:58.361940] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-26T17:38:58.456320] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:38:58.456511] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-26T17:38:58.456552] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-26T17:38:58.456746] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-26T17:38:58.456832] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-26T17:38:58.456884] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-26T17:38:58.456919] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-26T17:38:58.848572] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:38:59.156763] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-26T17:38:59.376518] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T17:38:59.833627] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:38:59.956761] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-26T17:39:00.173408] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:00.173761] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-26T17:39:00.764304] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-26T17:39:00.770147] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T17:39:01.556740] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-26T17:39:02.356737] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-26T17:39:02.486845] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T17:39:02.579289] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:02.579609] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-26T17:39:03.156741] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-26T17:39:03.442908] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T17:39:03.956725] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-26T17:39:04.171844] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:04.172149] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-26T17:39:04.676219] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:39:04.756785] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-26T17:39:05.556712] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-26T17:39:06.133595] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T17:39:06.356746] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-26T17:39:06.871936] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:39:07.156737] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-26T17:39:07.956722] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-26T17:39:08.110238] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T17:39:08.120471] [INFO ] [REMOTE ] BLDR: Full fetch complete (74375 records). [2025-09-26T17:39:08.120696] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-26T17:39:08.193152] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:08.222124] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-26T17:39:08.541213] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-26T17:39:08.541426] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-26T17:39:08.542282] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-26T17:39:08.542371] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-26T17:39:08.563910] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T17:39:08.571289] [DEBUG] [LOCAL ] BLDR: Trimmed 74375 records to 52403 (keeping 200 days of data) [2025-09-26T17:39:08.764070] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-26T17:39:08.921955] [DEBUG] [LOCAL ] BLDR: Primary data saved (52403 records). [2025-09-26T17:39:08.922119] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-26T17:39:08.922211] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLDR took 39.4s. Estimated remaining: 4h 30m 56s. Rate: 7.6 symbols/min [2025-09-26T17:39:09.179134] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:09.194140] [DEBUG] [LOCAL ] BLW: Loaded 12881 existing records from primary storage. [2025-09-26T17:39:09.194269] [INFO ] [MAIN ] BLW: Loaded 12881 existing records. [2025-09-26T17:39:09.383008] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:09.383279] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-26T17:39:09.383327] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-26T17:39:09.383845] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-26T17:39:09.383906] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-26T17:39:09.561812] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-26T17:39:09.768268] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:09.894866] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:09.895220] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-26T17:39:10.356724] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-26T17:39:10.669100] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T17:39:10.708277] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:10.708722] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-26T17:39:11.156756] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-26T17:39:11.671325] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:11.671731] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-26T17:39:11.956750] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-26T17:39:12.756726] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-26T17:39:13.556735] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-26T17:39:13.727961] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T17:39:14.326920] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T17:39:14.356679] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-26T17:39:14.399063] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T17:39:15.156724] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-26T17:39:15.287146] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:39:15.956764] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-26T17:39:16.756737] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-26T17:39:16.852066] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:39:16.858990] [INFO ] [REMOTE ] BLK: Full fetch complete (52748 records). [2025-09-26T17:39:16.859108] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-26T17:39:17.291962] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-26T17:39:17.292502] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-26T17:39:17.293315] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-26T17:39:17.293891] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-26T17:39:17.307678] [DEBUG] [LOCAL ] BLK: Trimmed 52748 records to 35240 (keeping 200 days of data) [2025-09-26T17:39:17.309040] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T17:39:17.415305] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T17:39:17.565312] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-26T17:39:17.598612] [DEBUG] [LOCAL ] BLK: Primary data saved (35240 records). [2025-09-26T17:39:17.598803] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-26T17:39:17.598910] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 29.3s. Estimated remaining: 4h 30m 54s. Rate: 7.6 symbols/min [2025-09-26T17:39:17.775530] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:17.775724] [DEBUG] [LOCAL ] BLX: No existing data file found in primary storage. [2025-09-26T17:39:17.775773] [WARN ] [MAIN ] BLX: No existing data found, performing full refresh instead. [2025-09-26T17:39:17.775936] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-26T17:39:17.775979] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-26T17:39:17.776021] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-09-26T17:39:17.776054] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-26T17:39:18.152397] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:18.356729] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-26T17:39:18.985602] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:39:19.097622] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T17:39:19.156730] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-26T17:39:19.956693] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-26T17:39:20.028037] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T17:39:20.178499] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:39:20.178863] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-26T17:39:20.756737] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-26T17:39:21.556722] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-26T17:39:22.338278] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:39:22.356671] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-26T17:39:22.845799] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T17:39:23.156747] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-26T17:39:23.719005] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T17:39:23.956753] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-26T17:39:24.593304] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T17:39:24.604052] [INFO ] [REMOTE ] BLSH: Full fetch complete (12216 records). [2025-09-26T17:39:24.604165] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-26T17:39:24.765942] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-26T17:39:24.819217] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 32 unique days, need 200 days [2025-09-26T17:39:24.819613] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:39:24.819710] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:39:24.819784] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-26T17:39:24.819874] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-26T17:39:24.819965] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-26T17:39:24.820033] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-26T17:39:24.820155] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLSH took 26.6s. Estimated remaining: 4h 30m 42s. Rate: 7.6 symbols/min [2025-09-26T17:39:25.037883] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:25.085280] [DEBUG] [LOCAL ] BMA: Loaded 35339 existing records from primary storage. [2025-09-26T17:39:25.090819] [INFO ] [MAIN ] BMA: Loaded 35339 existing records. [2025-09-26T17:39:25.101268] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:39:25.308800] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:25.309150] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-26T17:39:25.309219] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-26T17:39:25.310541] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-26T17:39:25.310618] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-26T17:39:25.561878] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-26T17:39:25.726547] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:25.741439] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T17:39:26.356749] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-26T17:39:26.907120] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T17:39:27.156722] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-26T17:39:27.509548] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T17:39:27.956760] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-26T17:39:28.756784] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-26T17:39:29.056967] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T17:39:29.097597] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T17:39:29.556725] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-26T17:39:29.896961] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T17:39:30.229910] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T17:39:30.356753] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-26T17:39:30.934002] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:39:31.156749] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-26T17:39:31.956744] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-26T17:39:32.197581] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:39:32.531813] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T17:39:32.756721] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-26T17:39:33.556719] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-26T17:39:33.989769] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T17:39:34.356762] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-26T17:39:35.116418] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T17:39:35.147560] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T17:39:35.157121] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-26T17:39:35.159582] [INFO ] [REMOTE ] BLND: Full fetch complete (72227 records). [2025-09-26T17:39:35.159893] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-26T17:39:35.579522] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-26T17:39:35.579623] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-26T17:39:35.580458] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-26T17:39:35.580532] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-26T17:39:35.582018] [DEBUG] [LOCAL ] BLND: Trimmed 72227 records to 50107 (keeping 200 days of data) [2025-09-26T17:39:35.872251] [DEBUG] [LOCAL ] BLND: Primary data saved (50107 records). [2025-09-26T17:39:35.872423] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-26T17:39:35.872547] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLND took 39.0s. Estimated remaining: 4h 30m 56s. Rate: 7.6 symbols/min [2025-09-26T17:39:35.961944] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-26T17:39:36.058290] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:36.071204] [DEBUG] [LOCAL ] BME: Loaded 10912 existing records from primary storage. [2025-09-26T17:39:36.071333] [INFO ] [MAIN ] BME: Loaded 10912 existing records. [2025-09-26T17:39:36.254232] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:36.254807] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-26T17:39:36.254982] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-26T17:39:36.255734] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-26T17:39:36.255802] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-26T17:39:36.598203] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:39:36.689596] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:36.699497] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:39:36.756709] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-26T17:39:37.556712] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-26T17:39:37.723048] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T17:39:38.356738] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-26T17:39:38.835007] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T17:39:38.994571] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T17:39:39.156730] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-26T17:39:39.956732] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-26T17:39:40.465414] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T17:39:40.545176] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:39:40.756728] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-26T17:39:41.564009] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-26T17:39:41.566498] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T17:39:42.356723] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-26T17:39:42.935802] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T17:39:42.960841] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:39:43.156722] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-26T17:39:43.956711] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-26T17:39:44.396860] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T17:39:44.401110] [INFO ] [REMOTE ] BLW: Full fetch complete (18976 records). [2025-09-26T17:39:44.401271] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-26T17:39:44.762165] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-26T17:39:44.901247] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:39:44.988019] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-26T17:39:44.988140] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-26T17:39:44.988591] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-26T17:39:44.988638] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-26T17:39:44.989749] [DEBUG] [LOCAL ] BLW: Trimmed 18976 records to 13044 (keeping 200 days of data) [2025-09-26T17:39:45.102903] [DEBUG] [LOCAL ] BLW: Primary data saved (13044 records). [2025-09-26T17:39:45.103111] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-26T17:39:45.103277] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLW took 36.2s. Estimated remaining: 4h 30m 58s. Rate: 7.6 symbols/min [2025-09-26T17:39:45.403176] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:45.433550] [DEBUG] [LOCAL ] BMEZ: Loaded 26209 existing records from primary storage. [2025-09-26T17:39:45.433748] [INFO ] [MAIN ] BMEZ: Loaded 26209 existing records. [2025-09-26T17:39:45.563408] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-26T17:39:45.659417] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:45.659751] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-26T17:39:45.659809] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-26T17:39:45.660805] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-26T17:39:45.660870] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-26T17:39:46.045539] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:46.128468] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T17:39:46.356769] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-26T17:39:46.550006] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T17:39:46.553922] [INFO ] [REMOTE ] BLX: Full fetch complete (22710 records). [2025-09-26T17:39:46.554073] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-26T17:39:46.977554] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-26T17:39:46.977659] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-26T17:39:46.978042] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-26T17:39:46.978085] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-26T17:39:46.978789] [DEBUG] [LOCAL ] BLX: Trimmed 22710 records to 15880 (keeping 200 days of data) [2025-09-26T17:39:47.075893] [DEBUG] [LOCAL ] BLX: Primary data saved (15880 records). [2025-09-26T17:39:47.076056] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-26T17:39:47.076145] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 29.5s. Estimated remaining: 4h 30m 10s. Rate: 7.7 symbols/min [2025-09-26T17:39:47.161841] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-26T17:39:47.261173] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:47.261349] [DEBUG] [LOCAL ] BMI: No existing data file found in primary storage. [2025-09-26T17:39:47.261388] [WARN ] [MAIN ] BMI: No existing data found, performing full refresh instead. [2025-09-26T17:39:47.261543] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-26T17:39:47.261588] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-26T17:39:47.261632] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-09-26T17:39:47.261707] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-26T17:39:47.638769] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:47.956727] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-26T17:39:48.074471] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:39:48.083738] [INFO ] [REMOTE ] BMA: Full fetch complete (51272 records). [2025-09-26T17:39:48.083911] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-26T17:39:48.534394] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-26T17:39:48.534803] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-26T17:39:48.535479] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-26T17:39:48.535565] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-26T17:39:48.537959] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T17:39:48.546783] [DEBUG] [LOCAL ] BMA: Trimmed 51272 records to 35645 (keeping 200 days of data) [2025-09-26T17:39:48.756928] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-26T17:39:48.788615] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T17:39:48.800481] [DEBUG] [LOCAL ] BMA: Primary data saved (35645 records). [2025-09-26T17:39:48.800675] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-26T17:39:48.802161] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 24.0s. Estimated remaining: 4h 29m 20s. Rate: 7.7 symbols/min [2025-09-26T17:39:48.987504] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:39:48.992851] [DEBUG] [LOCAL ] BMN: Loaded 2536 existing records from primary storage. [2025-09-26T17:39:48.992967] [INFO ] [MAIN ] BMN: Loaded 2536 existing records. [2025-09-26T17:39:49.175712] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:39:49.175964] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-26T17:39:49.176013] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-26T17:39:49.176380] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-26T17:39:49.176443] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-26T17:39:49.544275] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:39:49.556676] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-26T17:39:49.728331] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:39:49.969028] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-26T17:39:50.356727] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-26T17:39:50.881970] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T17:39:51.156773] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-26T17:39:51.956781] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-26T17:39:51.968945] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T17:39:52.756733] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-26T17:39:53.087498] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:39:53.556743] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-26T17:39:53.805612] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:39:54.356740] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-26T17:39:54.489285] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T17:39:55.006203] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T17:39:55.156785] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-26T17:39:55.946786] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T17:39:55.956680] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-26T17:39:56.756742] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-26T17:39:56.851213] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T17:39:57.085772] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T17:39:57.556781] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-26T17:39:58.356722] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-26T17:39:58.905585] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T17:39:59.156767] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-26T17:39:59.184942] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T17:39:59.956739] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-26T17:40:00.180689] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T17:40:00.477953] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T17:40:00.756764] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-26T17:40:01.556726] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-26T17:40:02.189686] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:40:02.356789] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-26T17:40:02.655477] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:40:03.156721] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-26T17:40:03.260739] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T17:40:03.628366] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-26T17:40:03.956768] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-26T17:40:04.756743] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-26T17:40:04.936292] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T17:40:05.321079] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T17:40:05.556723] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-26T17:40:06.036397] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T17:40:06.356742] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-26T17:40:06.826173] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T17:40:07.156750] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-26T17:40:07.956746] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-26T17:40:08.143887] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T17:40:08.146780] [INFO ] [REMOTE ] BME: Full fetch complete (16047 records). [2025-09-26T17:40:08.146868] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-26T17:40:08.583253] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T17:40:08.583477] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-26T17:40:08.585164] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-26T17:40:08.585679] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-26T17:40:08.585760] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-26T17:40:08.586487] [DEBUG] [LOCAL ] BME: Trimmed 16047 records to 10968 (keeping 200 days of data) [2025-09-26T17:40:08.661187] [DEBUG] [LOCAL ] BME: Primary data saved (10968 records). [2025-09-26T17:40:08.661371] [INFO ] [MAIN ] BME: Full history saved. [2025-09-26T17:40:08.661473] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BME took 32.8s. Estimated remaining: 4h 30m 34s. Rate: 7.6 symbols/min [2025-09-26T17:40:08.761822] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-26T17:40:08.868980] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:08.913790] [DEBUG] [LOCAL ] BMO: Loaded 41667 existing records from primary storage. [2025-09-26T17:40:08.913961] [INFO ] [MAIN ] BMO: Loaded 41667 existing records. [2025-09-26T17:40:09.131467] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:09.131742] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-26T17:40:09.131800] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-26T17:40:09.133255] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-26T17:40:09.133331] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-26T17:40:09.556781] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:09.556928] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-26T17:40:09.884085] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T17:40:09.907637] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T17:40:10.356724] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-26T17:40:11.156742] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-26T17:40:11.956813] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-26T17:40:12.709848] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T17:40:12.722729] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T17:40:12.723946] [INFO ] [REMOTE ] BMN: Full fetch complete (3724 records). [2025-09-26T17:40:12.724022] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-26T17:40:12.761798] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-26T17:40:13.098693] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (2.74 seconds). [2025-09-26T17:40:13.143244] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-26T17:40:13.143325] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-26T17:40:13.143471] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-26T17:40:13.143555] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-26T17:40:13.144102] [DEBUG] [LOCAL ] BMN: Trimmed 3724 records to 2548 (keeping 200 days of data) [2025-09-26T17:40:13.162549] [DEBUG] [LOCAL ] BMN: Primary data saved (2548 records). [2025-09-26T17:40:13.162638] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-26T17:40:13.162777] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BMN took 24.4s. Estimated remaining: 4h 30m 3s. Rate: 7.6 symbols/min [2025-09-26T17:40:13.343731] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:13.343967] [DEBUG] [LOCAL ] BMY: No existing data file found in primary storage. [2025-09-26T17:40:13.344025] [WARN ] [MAIN ] BMY: No existing data found, performing full refresh instead. [2025-09-26T17:40:13.344191] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-26T17:40:13.344235] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-26T17:40:13.344279] [DEBUG] [LOCAL ] BMY: No primary data file found to delete. [2025-09-26T17:40:13.344312] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-26T17:40:13.561878] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-26T17:40:13.737067] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:14.186764] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T17:40:14.356737] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-26T17:40:14.454976] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T17:40:15.156795] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-26T17:40:15.531591] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T17:40:15.956728] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-26T17:40:16.756744] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-26T17:40:16.914958] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:40:17.086735] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:40:17.556722] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-26T17:40:18.112703] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T17:40:18.356724] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-26T17:40:18.748778] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T17:40:18.755832] [INFO ] [REMOTE ] BMI: Full fetch complete (32989 records). [2025-09-26T17:40:18.755983] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-26T17:40:19.162178] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-26T17:40:19.215301] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-26T17:40:19.215495] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-26T17:40:19.216022] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-26T17:40:19.216094] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-26T17:40:19.217022] [DEBUG] [LOCAL ] BMI: Trimmed 32989 records to 24611 (keeping 200 days of data) [2025-09-26T17:40:19.376460] [DEBUG] [LOCAL ] BMI: Primary data saved (24611 records). [2025-09-26T17:40:19.376605] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-26T17:40:19.376710] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMI took 32.3s. Estimated remaining: 4h 29m 45s. Rate: 7.6 symbols/min [2025-09-26T17:40:19.566388] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:19.621370] [DEBUG] [LOCAL ] BN: Loaded 53384 existing records from primary storage. [2025-09-26T17:40:19.621511] [INFO ] [MAIN ] BN: Loaded 53384 existing records. [2025-09-26T17:40:19.825590] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:19.826048] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-26T17:40:19.826101] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-26T17:40:19.827596] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-26T17:40:19.827695] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-26T17:40:19.960630] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-26T17:40:20.219582] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T17:40:20.297670] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:20.291793] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T17:40:20.756739] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-26T17:40:21.556720] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-26T17:40:21.726879] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:40:21.951131] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T17:40:22.356740] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-26T17:40:23.156735] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-26T17:40:23.496246] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T17:40:23.569998] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T17:40:23.956779] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-26T17:40:24.756731] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-26T17:40:24.813485] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T17:40:24.884579] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:40:25.556714] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-26T17:40:25.738163] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T17:40:26.356737] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-26T17:40:27.156726] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-26T17:40:27.258144] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T17:40:27.844387] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T17:40:27.956744] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-26T17:40:28.183873] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T17:40:28.189449] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40870 records). [2025-09-26T17:40:28.189542] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-26T17:40:28.594803] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-26T17:40:28.594894] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-26T17:40:28.595426] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-26T17:40:28.595493] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-26T17:40:28.596562] [DEBUG] [LOCAL ] BMEZ: Trimmed 40870 records to 26421 (keeping 200 days of data) [2025-09-26T17:40:28.758341] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26421 records). [2025-09-26T17:40:28.758472] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-26T17:40:28.756861] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-26T17:40:28.758623] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMEZ took 43.7s. Estimated remaining: 4h 29m 47s. Rate: 7.6 symbols/min [2025-09-26T17:40:28.943083] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:28.943320] [DEBUG] [LOCAL ] BNED: No existing data file found in primary storage. [2025-09-26T17:40:28.943377] [WARN ] [MAIN ] BNED: No existing data found, performing full refresh instead. [2025-09-26T17:40:28.943522] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-26T17:40:28.943565] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-26T17:40:28.943608] [DEBUG] [LOCAL ] BNED: No primary data file found to delete. [2025-09-26T17:40:28.943661] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-26T17:40:29.325865] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:29.556696] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-26T17:40:29.686210] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T17:40:30.356738] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-26T17:40:30.649952] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T17:40:31.106736] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T17:40:31.156800] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-26T17:40:31.561576] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T17:40:31.956735] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-26T17:40:32.756745] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-26T17:40:32.832349] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T17:40:33.556713] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-26T17:40:33.671844] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T17:40:34.078124] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:40:34.356760] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-26T17:40:35.052664] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T17:40:35.061762] [INFO ] [REMOTE ] BMO: Full fetch complete (59738 records). [2025-09-26T17:40:35.061954] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-26T17:40:35.164527] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-26T17:40:35.504533] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-26T17:40:35.504624] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-26T17:40:35.505394] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-26T17:40:35.505496] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-26T17:40:35.514629] [DEBUG] [LOCAL ] BMO: Trimmed 59738 records to 41940 (keeping 200 days of data) [2025-09-26T17:40:35.793243] [DEBUG] [LOCAL ] BMO: Primary data saved (41940 records). [2025-09-26T17:40:35.793842] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-26T17:40:35.794186] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 27.1s. Estimated remaining: 4h 29m 34s. Rate: 7.6 symbols/min [2025-09-26T17:40:35.967124] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-26T17:40:35.990974] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:36.034596] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T17:40:36.037612] [DEBUG] [LOCAL ] BNH: Loaded 4902 existing records from primary storage. [2025-09-26T17:40:36.037823] [INFO ] [MAIN ] BNH: Loaded 4902 existing records. [2025-09-26T17:40:36.250241] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:36.250924] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-26T17:40:36.250987] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-26T17:40:36.251380] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-26T17:40:36.251450] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-26T17:40:36.460137] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:40:36.732910] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:36.756751] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-26T17:40:37.436244] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T17:40:37.556753] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-26T17:40:38.138278] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T17:40:38.300795] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T17:40:38.356748] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-26T17:40:39.156723] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-26T17:40:39.956732] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-26T17:40:40.160493] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T17:40:40.212477] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T17:40:40.756734] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-26T17:40:41.091525] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T17:40:41.556722] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-26T17:40:41.693018] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T17:40:41.915461] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T17:40:42.356769] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-26T17:40:43.156765] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-26T17:40:43.956714] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-26T17:40:44.181862] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T17:40:44.218527] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T17:40:44.686086] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:40:44.756731] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-26T17:40:45.125108] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-26T17:40:45.556724] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-26T17:40:46.115551] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T17:40:46.356754] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-26T17:40:47.156811] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-26T17:40:47.956734] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-26T17:40:48.731367] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:40:48.756677] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-26T17:40:48.845531] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-26T17:40:48.929900] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:40:48.940720] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-09-26T17:40:48.940894] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-26T17:40:49.364837] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-26T17:40:49.364987] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-26T17:40:49.365890] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-26T17:40:49.365960] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-26T17:40:49.367691] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54537 (keeping 200 days of data) [2025-09-26T17:40:49.571962] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-26T17:40:49.732363] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T17:40:49.763610] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-09-26T17:40:49.763787] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-26T17:40:49.763875] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 36.6s. Estimated remaining: 4h 30m 6s. Rate: 7.6 symbols/min [2025-09-26T17:40:49.941206] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:49.945995] [DEBUG] [LOCAL ] BNJ: Loaded 2610 existing records from primary storage. [2025-09-26T17:40:49.946084] [INFO ] [MAIN ] BNJ: Loaded 2610 existing records. [2025-09-26T17:40:50.120097] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T17:40:50.146752] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:50.147602] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-26T17:40:50.147693] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-26T17:40:50.148060] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-26T17:40:50.148376] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-26T17:40:50.366570] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-26T17:40:50.547473] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:51.019892] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T17:40:51.156713] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-26T17:40:51.665753] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T17:40:51.667305] [INFO ] [REMOTE ] BNH: Full fetch complete (6876 records). [2025-09-26T17:40:51.667382] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-26T17:40:51.961980] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-26T17:40:52.065962] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-26T17:40:52.066126] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-26T17:40:52.066333] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-26T17:40:52.066377] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-26T17:40:52.066899] [DEBUG] [LOCAL ] BNH: Trimmed 6876 records to 4926 (keeping 200 days of data) [2025-09-26T17:40:52.098465] [DEBUG] [LOCAL ] BNH: Primary data saved (4926 records). [2025-09-26T17:40:52.098631] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-26T17:40:52.098771] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BNH took 16.3s. Estimated remaining: 4h 29m 22s. Rate: 7.6 symbols/min [2025-09-26T17:40:52.281994] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:40:52.340931] [DEBUG] [LOCAL ] BNL: Loaded 47233 existing records from primary storage. [2025-09-26T17:40:52.341105] [INFO ] [MAIN ] BNL: Loaded 47233 existing records. [2025-09-26T17:40:52.529427] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:40:52.529726] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-26T17:40:52.529825] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-26T17:40:52.531206] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-26T17:40:52.531271] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-26T17:40:52.765470] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T17:40:52.765557] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-26T17:40:52.956599] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:40:53.556741] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-26T17:40:54.288402] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T17:40:54.356765] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-26T17:40:55.156730] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-26T17:40:55.211483] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T17:40:55.837461] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T17:40:55.956775] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-26T17:40:56.436108] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T17:40:56.756734] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-26T17:40:56.985995] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:40:57.239817] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T17:40:57.556739] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-26T17:40:58.356752] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-26T17:40:59.011279] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T17:40:59.156757] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-26T17:40:59.652701] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-26T17:40:59.734406] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T17:40:59.740210] [INFO ] [REMOTE ] BNED: Full fetch complete (44121 records). [2025-09-26T17:40:59.740340] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-26T17:40:59.963225] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-26T17:41:00.140416] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-26T17:41:00.140509] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-26T17:41:00.141052] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-26T17:41:00.141116] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-26T17:41:00.142345] [DEBUG] [LOCAL ] BNED: Trimmed 44121 records to 30226 (keeping 200 days of data) [2025-09-26T17:41:00.329495] [DEBUG] [LOCAL ] BNED: Primary data saved (30226 records). [2025-09-26T17:41:00.329669] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-26T17:41:00.329771] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BNED took 31.6s. Estimated remaining: 4h 29m 17s. Rate: 7.6 symbols/min [2025-09-26T17:41:00.512682] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:00.570981] [DEBUG] [LOCAL ] BNS: Loaded 51844 existing records from primary storage. [2025-09-26T17:41:00.571134] [INFO ] [MAIN ] BNS: Loaded 51844 existing records. [2025-09-26T17:41:00.684921] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T17:41:00.765811] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-26T17:41:00.775339] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:00.776717] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-26T17:41:00.776794] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-26T17:41:00.778353] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-26T17:41:00.778424] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-26T17:41:01.171307] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:01.556731] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-26T17:41:02.356732] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-26T17:41:02.731232] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T17:41:02.801296] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T17:41:03.156737] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-26T17:41:03.956802] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-26T17:41:04.235870] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T17:41:04.756783] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-26T17:41:05.003896] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T17:41:05.290683] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:41:05.556721] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-26T17:41:06.031118] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T17:41:06.356771] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-26T17:41:07.156752] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-26T17:41:07.157783] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:41:07.956695] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-26T17:41:08.133851] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T17:41:08.759421] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-26T17:41:08.765912] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:41:08.777329] [INFO ] [REMOTE ] BN: Full fetch complete (76645 records). [2025-09-26T17:41:08.777561] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-26T17:41:09.220108] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-26T17:41:09.220227] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-26T17:41:09.221200] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-26T17:41:09.221291] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-26T17:41:09.223287] [DEBUG] [LOCAL ] BN: Trimmed 76645 records to 53774 (keeping 200 days of data) [2025-09-26T17:41:09.318522] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T17:41:09.323121] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T17:41:09.571129] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-26T17:41:09.626429] [DEBUG] [LOCAL ] BN: Primary data saved (53774 records). [2025-09-26T17:41:09.626604] [INFO ] [MAIN ] BN: Full history saved. [2025-09-26T17:41:09.626747] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BN took 50.2s. Estimated remaining: 4h 29m 18s. Rate: 7.6 symbols/min [2025-09-26T17:41:09.819418] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:09.824713] [DEBUG] [LOCAL ] BNT: Loaded 3437 existing records from primary storage. [2025-09-26T17:41:09.824802] [INFO ] [MAIN ] BNT: Loaded 3437 existing records. [2025-09-26T17:41:10.020549] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:10.020887] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-26T17:41:10.020944] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-26T17:41:10.021288] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-26T17:41:10.021354] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-26T17:41:10.098955] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T17:41:10.361874] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-26T17:41:10.422394] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:10.832488] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T17:41:11.156724] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-26T17:41:11.607005] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-26T17:41:11.956769] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-26T17:41:12.756753] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-26T17:41:13.298865] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T17:41:13.556743] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-26T17:41:14.147214] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T17:41:14.149464] [INFO ] [REMOTE ] BNJ: Full fetch complete (4421 records). [2025-09-26T17:41:14.149910] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-26T17:41:14.361185] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-26T17:41:14.370977] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T17:41:14.602786] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-26T17:41:14.602899] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-26T17:41:14.603067] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-26T17:41:14.603127] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-26T17:41:14.603532] [DEBUG] [LOCAL ] BNJ: Trimmed 4421 records to 2631 (keeping 200 days of data) [2025-09-26T17:41:14.622376] [DEBUG] [LOCAL ] BNJ: Primary data saved (2631 records). [2025-09-26T17:41:14.622510] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-26T17:41:14.622601] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNJ took 24.9s. Estimated remaining: 4h 28m 52s. Rate: 7.6 symbols/min [2025-09-26T17:41:14.799968] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:14.809016] [DEBUG] [LOCAL ] BNY: Loaded 7428 existing records from primary storage. [2025-09-26T17:41:14.809137] [INFO ] [MAIN ] BNY: Loaded 7428 existing records. [2025-09-26T17:41:14.991917] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:14.992166] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-26T17:41:14.992214] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-26T17:41:14.992619] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-26T17:41:14.992738] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-26T17:41:15.107591] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T17:41:15.161828] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-26T17:41:15.392008] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:15.713536] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T17:41:15.956743] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-26T17:41:16.756761] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-26T17:41:17.288464] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:41:17.556743] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-26T17:41:17.632998] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T17:41:18.356747] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-26T17:41:18.455617] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:41:19.156733] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-26T17:41:19.801770] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T17:41:19.943165] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:41:19.956675] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-26T17:41:20.756748] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-26T17:41:21.531781] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T17:41:21.541383] [INFO ] [REMOTE ] BNL: Full fetch complete (66707 records). [2025-09-26T17:41:21.541522] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-26T17:41:21.564803] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-26T17:41:21.955281] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-26T17:41:21.955388] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-26T17:41:21.956115] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-26T17:41:21.956184] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-26T17:41:21.958083] [DEBUG] [LOCAL ] BNL: Trimmed 66707 records to 47577 (keeping 200 days of data) [2025-09-26T17:41:22.225697] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T17:41:22.226147] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T17:41:22.314977] [DEBUG] [LOCAL ] BNL: Primary data saved (47577 records). [2025-09-26T17:41:22.315124] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-26T17:41:22.315227] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNL took 30.2s. Estimated remaining: 4h 28m 43s. Rate: 7.6 symbols/min [2025-09-26T17:41:22.361801] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-26T17:41:22.500815] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:22.520412] [DEBUG] [LOCAL ] BOC: Loaded 18500 existing records from primary storage. [2025-09-26T17:41:22.520558] [INFO ] [MAIN ] BOC: Loaded 18500 existing records. [2025-09-26T17:41:22.708843] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:22.709166] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-26T17:41:22.709245] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-26T17:41:22.709968] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-26T17:41:22.710033] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-26T17:41:23.128993] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:23.129395] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T17:41:23.156670] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-26T17:41:23.639918] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T17:41:23.956796] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-26T17:41:24.553398] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T17:41:24.756764] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-26T17:41:25.452764] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:41:25.556732] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-26T17:41:26.238716] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T17:41:26.356755] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-26T17:41:27.073823] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T17:41:27.156730] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-26T17:41:27.956774] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-26T17:41:28.756718] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-26T17:41:28.903671] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:41:28.932078] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T17:41:29.233212] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-26T17:41:29.556770] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-26T17:41:30.328032] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T17:41:30.356795] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-26T17:41:31.156713] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-26T17:41:31.393615] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:41:31.956724] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-26T17:41:32.757380] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-26T17:41:32.763501] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T17:41:32.807061] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T17:41:33.161954] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-26T17:41:33.556708] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-26T17:41:34.137318] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T17:41:34.356739] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-26T17:41:35.156732] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-26T17:41:35.893837] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T17:41:35.898164] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T17:41:35.956752] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-26T17:41:36.756699] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-26T17:41:36.902324] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:41:37.039533] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-26T17:41:37.556722] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-26T17:41:38.356715] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-26T17:41:38.585447] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T17:41:38.890548] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-26T17:41:38.892294] [INFO ] [REMOTE ] BNT: Full fetch complete (4502 records). [2025-09-26T17:41:38.892368] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-26T17:41:39.161906] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-26T17:41:39.274384] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-26T17:41:39.274495] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-26T17:41:39.274673] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-26T17:41:39.274734] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-26T17:41:39.275104] [DEBUG] [LOCAL ] BNT: Trimmed 4502 records to 3473 (keeping 200 days of data) [2025-09-26T17:41:39.299887] [DEBUG] [LOCAL ] BNT: Primary data saved (3473 records). [2025-09-26T17:41:39.300076] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-26T17:41:39.300206] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNT took 29.7s. Estimated remaining: 4h 29m 34s. Rate: 7.6 symbols/min [2025-09-26T17:41:39.956696] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-26T17:41:40.108094] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T17:41:40.110314] [INFO ] [REMOTE ] BNY: Full fetch complete (10466 records). [2025-09-26T17:41:40.110398] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-26T17:41:40.541320] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-26T17:41:40.541438] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-26T17:41:40.541842] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-26T17:41:40.541918] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-26T17:41:40.542915] [DEBUG] [LOCAL ] BNY: Trimmed 10466 records to 7446 (keeping 200 days of data) [2025-09-26T17:41:40.599413] [DEBUG] [LOCAL ] BNY: Primary data saved (7446 records). [2025-09-26T17:41:40.599565] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-26T17:41:40.599690] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNY took 26.0s. Estimated remaining: 4h 28m 44s. Rate: 7.6 symbols/min [2025-09-26T17:41:40.756768] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-26T17:41:41.591393] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:41:41.602785] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-26T17:41:41.845285] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:41:42.356745] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-26T17:41:43.279170] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T17:41:43.289821] [INFO ] [REMOTE ] BNS: Full fetch complete (74184 records). [2025-09-26T17:41:43.290011] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-26T17:41:43.410019] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T17:41:43.414759] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-26T17:41:43.717546] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-26T17:41:43.717680] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-26T17:41:43.718455] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-26T17:41:43.718504] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-26T17:41:43.720095] [DEBUG] [LOCAL ] BNS: Trimmed 74184 records to 52212 (keeping 200 days of data) [2025-09-26T17:41:44.050453] [DEBUG] [LOCAL ] BNS: Primary data saved (52212 records). [2025-09-26T17:41:44.050720] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-26T17:41:44.050902] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNS took 43.7s. Estimated remaining: 4h 28m 8s. Rate: 7.7 symbols/min [2025-09-26T17:41:44.533467] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T17:41:44.538577] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-26T17:41:46.517001] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T17:41:46.522801] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-26T17:41:48.351183] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:41:48.355371] [INFO ] [REMOTE ] BOC: Full fetch complete (25704 records). [2025-09-26T17:41:48.355536] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-26T17:41:48.356307] [FATAL] [VALIDATOR ] BOC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:41:48.356427] [FATAL] [MAIN ] BOC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:41:48.356474] [WARN ] [MAIN ] BOC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:41:48.356540] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-26T17:41:48.356697] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-09-26T17:41:48.356785] [INFO ] [LOCAL ] BOC: Starting deletion of derivative data. [2025-09-26T17:41:48.357393] [DEBUG] [LOCAL ] BOC: Deleted derivative data file. [2025-09-26T17:41:48.357578] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 26.0s. Estimated remaining: 4h 27m 37s. Rate: 7.7 symbols/min [2025-09-26T17:41:49.108204] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:49.173120] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:49.225605] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:49.280308] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:41:49.280833] [DEBUG] [LOCAL ] BOE: No existing data file found in primary storage. [2025-09-26T17:41:49.280890] [WARN ] [MAIN ] BOE: No existing data found, performing full refresh instead. [2025-09-26T17:41:49.281020] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-26T17:41:49.281061] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-26T17:41:49.281103] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-09-26T17:41:49.281137] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-26T17:41:49.444452] [DEBUG] [LOCAL ] BOH: Loaded 31510 existing records from primary storage. [2025-09-26T17:41:49.496114] [INFO ] [MAIN ] BOH: Loaded 31510 existing records. [2025-09-26T17:41:49.608874] [DEBUG] [LOCAL ] BOND: Loaded 32348 existing records from primary storage. [2025-09-26T17:41:49.655083] [INFO ] [MAIN ] BOND: Loaded 32348 existing records. [2025-09-26T17:41:49.744482] [DEBUG] [LOCAL ] BOOT: Loaded 41144 existing records from primary storage. [2025-09-26T17:41:49.848478] [INFO ] [MAIN ] BOOT: Loaded 41144 existing records. [2025-09-26T17:41:50.127909] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:50.185613] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:50.217672] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-26T17:41:50.303850] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-26T17:41:50.403565] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:50.396335] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:41:50.361754] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-26T17:41:50.404082] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-26T17:41:50.404261] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-26T17:41:50.404364] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-26T17:41:50.404565] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-26T17:41:50.405325] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-26T17:41:50.405399] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-26T17:41:50.410596] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-26T17:41:50.410679] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-26T17:41:50.443856] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-26T17:41:50.443947] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-26T17:41:51.586325] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:51.574216] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:51.587452] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-26T17:41:51.588983] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-26T17:41:51.690764] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:41:51.692220] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:41:51.698079] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-26T17:41:51.692613] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-26T17:41:52.806415] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T17:41:52.811901] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-26T17:41:52.958247] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:41:52.965886] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-26T17:41:52.985437] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T17:41:52.991692] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-26T17:41:53.059395] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T17:41:53.068084] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-26T17:41:53.438249] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:41:53.442807] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-26T17:41:53.912982] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T17:41:53.922521] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-26T17:41:54.072978] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T17:41:54.280344] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T17:41:54.334884] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T17:41:54.356751] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-26T17:41:54.768473] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T17:41:55.156774] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-26T17:41:55.563410] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T17:41:55.956772] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-26T17:41:56.755836] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T17:41:56.763475] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-26T17:41:57.556725] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-26T17:41:57.760973] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T17:41:58.356785] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-26T17:41:58.783570] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T17:41:59.164148] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-26T17:41:59.173255] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-26T17:41:59.260717] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T17:41:59.956748] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-26T17:42:00.161750] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T17:42:00.756759] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-26T17:42:01.024819] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T17:42:01.556715] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-26T17:42:01.584296] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T17:42:02.356798] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-26T17:42:02.790392] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T17:42:03.156726] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-26T17:42:03.788969] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T17:42:03.956795] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-26T17:42:04.187161] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T17:42:04.756767] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-26T17:42:05.425226] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:42:05.556737] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-26T17:42:05.677938] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T17:42:06.155671] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:42:06.356765] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-26T17:42:07.156754] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-26T17:42:07.712967] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T17:42:07.956772] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-26T17:42:08.352498] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:42:08.756772] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-26T17:42:09.049415] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T17:42:09.556726] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-26T17:42:10.251014] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:42:10.356737] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-26T17:42:10.890783] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:42:11.156785] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-26T17:42:11.794283] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T17:42:11.956750] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-26T17:42:12.506159] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:42:12.756774] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-26T17:42:13.489324] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T17:42:13.496994] [INFO ] [REMOTE ] BOND: Full fetch complete (46324 records). [2025-09-26T17:42:13.497178] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-26T17:42:13.564745] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-26T17:42:13.917843] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-26T17:42:13.926934] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-26T17:42:13.928430] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-26T17:42:13.928851] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T17:42:13.929128] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-26T17:42:13.934332] [DEBUG] [LOCAL ] BOND: Trimmed 46324 records to 32554 (keeping 200 days of data) [2025-09-26T17:42:14.146278] [DEBUG] [LOCAL ] BOND: Primary data saved (32554 records). [2025-09-26T17:42:14.146491] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-26T17:42:14.146694] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOND took 25.8s. Estimated remaining: 4h 29m 24s. Rate: 7.6 symbols/min [2025-09-26T17:42:14.336826] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:14.365894] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-26T17:42:14.390060] [DEBUG] [LOCAL ] BORR: Loaded 51538 existing records from primary storage. [2025-09-26T17:42:14.390232] [INFO ] [MAIN ] BORR: Loaded 51538 existing records. [2025-09-26T17:42:14.573865] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:14.574118] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-26T17:42:14.574209] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-26T17:42:14.575823] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-26T17:42:14.575898] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-26T17:42:14.964179] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:15.156738] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-26T17:42:15.186883] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T17:42:15.193526] [INFO ] [REMOTE ] BOH: Full fetch complete (44890 records). [2025-09-26T17:42:15.193754] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-26T17:42:15.568759] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T17:42:15.606234] [INFO ] [REMOTE ] BOE: Full fetch complete (26680 records). [2025-09-26T17:42:15.652806] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-26T17:42:15.719326] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-26T17:42:15.756998] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-26T17:42:15.786551] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-26T17:42:15.791262] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-26T17:42:15.855501] [DEBUG] [LOCAL ] BOH: Trimmed 44890 records to 31676 (keeping 200 days of data) [2025-09-26T17:42:16.016666] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-26T17:42:16.208756] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-26T17:42:16.209379] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-26T17:42:16.211411] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-26T17:42:16.212030] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-26T17:42:16.219424] [DEBUG] [LOCAL ] BOE: Trimmed 26680 records to 17816 (keeping 200 days of data) [2025-09-26T17:42:16.421037] [DEBUG] [LOCAL ] BOH: Primary data saved (31676 records). [2025-09-26T17:42:16.423253] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-26T17:42:16.423456] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOH took 28.1s. Estimated remaining: 4h 28m 41s. Rate: 7.6 symbols/min [2025-09-26T17:42:16.572364] [DEBUG] [LOCAL ] BOE: Primary data saved (17816 records). [2025-09-26T17:42:16.633977] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-26T17:42:16.639347] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOE took 28.3s. Estimated remaining: 4h 27m 44s. Rate: 7.6 symbols/min [2025-09-26T17:42:16.639072] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:16.749749] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T17:42:16.824390] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-26T17:42:16.898634] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:16.899693] [DEBUG] [LOCAL ] BOW: Loaded 23795 existing records from primary storage. [2025-09-26T17:42:16.900052] [INFO ] [MAIN ] BOW: Loaded 23795 existing records. [2025-09-26T17:42:17.119536] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:17.119948] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-26T17:42:17.120032] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-26T17:42:17.120938] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-26T17:42:17.121016] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-26T17:42:17.249108] [DEBUG] [LOCAL ] BOX: Loaded 50653 existing records from primary storage. [2025-09-26T17:42:17.254934] [INFO ] [MAIN ] BOX: Loaded 50653 existing records. [2025-09-26T17:42:17.655855] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:17.696578] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-26T17:42:17.701997] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-26T17:42:17.742204] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:17.742789] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-26T17:42:17.743887] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-26T17:42:17.743980] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-26T17:42:18.100774] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T17:42:18.231893] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:18.361855] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-26T17:42:18.372773] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:42:18.965962] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T17:42:19.156747] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-26T17:42:19.916872] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:42:19.956698] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-26T17:42:20.444088] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-26T17:42:20.756761] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-26T17:42:20.782934] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:42:21.556743] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-26T17:42:22.128426] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T17:42:22.136033] [INFO ] [REMOTE ] BOOT: Full fetch complete (60270 records). [2025-09-26T17:42:22.136198] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-26T17:42:22.367327] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-26T17:42:22.576485] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-26T17:42:22.576737] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-26T17:42:22.577552] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-26T17:42:22.577710] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-26T17:42:22.597462] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T17:42:22.604555] [DEBUG] [LOCAL ] BOOT: Trimmed 60270 records to 41409 (keeping 200 days of data) [2025-09-26T17:42:22.871166] [DEBUG] [LOCAL ] BOOT: Primary data saved (41409 records). [2025-09-26T17:42:22.871302] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-26T17:42:22.871384] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOOT took 34.5s. Estimated remaining: 4h 27m 26s. Rate: 7.7 symbols/min [2025-09-26T17:42:23.062307] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:23.117357] [DEBUG] [LOCAL ] BP: Loaded 54101 existing records from primary storage. [2025-09-26T17:42:23.117513] [INFO ] [MAIN ] BP: Loaded 54101 existing records. [2025-09-26T17:42:23.161926] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-26T17:42:23.307309] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:23.307577] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-26T17:42:23.307630] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-26T17:42:23.309572] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-26T17:42:23.309709] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-26T17:42:23.714112] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:23.957079] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-26T17:42:23.961483] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:42:24.467448] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:42:24.756751] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-26T17:42:25.556746] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-26T17:42:26.283041] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T17:42:26.362797] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-26T17:42:26.403462] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-26T17:42:26.437441] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T17:42:27.156772] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-26T17:42:27.956705] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-26T17:42:28.128877] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T17:42:28.692581] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:42:28.762489] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-26T17:42:28.774672] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T17:42:29.556708] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-26T17:42:30.356733] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-26T17:42:30.597685] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T17:42:30.847034] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T17:42:31.156738] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-26T17:42:31.956691] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-26T17:42:32.456562] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-26T17:42:32.789243] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-26T17:42:32.810917] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T17:42:33.556691] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-26T17:42:33.731446] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:42:33.766081] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T17:42:34.356723] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-26T17:42:34.974339] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:42:35.156728] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-26T17:42:35.956718] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-26T17:42:36.252199] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T17:42:36.322330] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T17:42:36.756736] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-26T17:42:37.502406] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T17:42:37.556702] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-26T17:42:37.704668] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T17:42:37.709502] [INFO ] [REMOTE ] BOW: Full fetch complete (31170 records). [2025-09-26T17:42:37.709597] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-26T17:42:38.108956] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-26T17:42:38.109038] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-26T17:42:38.109457] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-26T17:42:38.109497] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-26T17:42:38.110353] [DEBUG] [LOCAL ] BOW: Trimmed 31170 records to 23974 (keeping 200 days of data) [2025-09-26T17:42:38.250626] [DEBUG] [LOCAL ] BOW: Primary data saved (23974 records). [2025-09-26T17:42:38.250784] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-26T17:42:38.250874] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 21.8s. Estimated remaining: 4h 28m 6s. Rate: 7.6 symbols/min [2025-09-26T17:42:38.365669] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-26T17:42:38.453249] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:38.453471] [DEBUG] [LOCAL ] BR: No existing data file found in primary storage. [2025-09-26T17:42:38.453538] [WARN ] [MAIN ] BR: No existing data found, performing full refresh instead. [2025-09-26T17:42:38.453868] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-26T17:42:38.453929] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-26T17:42:38.453980] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-09-26T17:42:38.454033] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-26T17:42:38.854986] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:38.933148] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T17:42:39.156757] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-26T17:42:39.956719] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-26T17:42:40.040602] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:42:40.756693] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-26T17:42:40.832533] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T17:42:41.556749] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-26T17:42:41.669041] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T17:42:42.356760] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-26T17:42:42.497874] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T17:42:43.156739] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-26T17:42:43.490495] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T17:42:43.612713] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T17:42:43.956768] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-26T17:42:44.756728] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-26T17:42:45.123274] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T17:42:45.164386] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T17:42:45.556713] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-26T17:42:46.361868] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-26T17:42:46.378396] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T17:42:46.392027] [INFO ] [REMOTE ] BOX: Full fetch complete (72106 records). [2025-09-26T17:42:46.392222] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-26T17:42:46.875673] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-26T17:42:46.876932] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:42:46.876308] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-26T17:42:46.877947] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-26T17:42:46.886142] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-26T17:42:46.888338] [DEBUG] [LOCAL ] BOX: Trimmed 72106 records to 51017 (keeping 200 days of data) [2025-09-26T17:42:47.173441] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-26T17:42:47.215831] [DEBUG] [LOCAL ] BOX: Primary data saved (51017 records). [2025-09-26T17:42:47.215976] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-26T17:42:47.216105] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BOX took 30.6s. Estimated remaining: 4h 28m 5s. Rate: 7.6 symbols/min [2025-09-26T17:42:47.395485] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:47.454073] [DEBUG] [LOCAL ] BRBR: Loaded 51612 existing records from primary storage. [2025-09-26T17:42:47.454219] [INFO ] [MAIN ] BRBR: Loaded 51612 existing records. [2025-09-26T17:42:47.648297] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:47.648560] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-26T17:42:47.648609] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-26T17:42:47.650292] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-26T17:42:47.650369] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-26T17:42:47.958971] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-26T17:42:48.042507] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:48.640630] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-26T17:42:48.714448] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T17:42:48.756715] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-26T17:42:49.211836] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T17:42:49.556717] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-26T17:42:50.356328] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T17:42:50.360011] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-26T17:42:50.367986] [INFO ] [REMOTE ] BORR: Full fetch complete (74716 records). [2025-09-26T17:42:50.368095] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-26T17:42:50.801725] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-26T17:42:50.801846] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-26T17:42:50.802618] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-26T17:42:50.802868] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-26T17:42:50.805006] [DEBUG] [LOCAL ] BORR: Trimmed 74716 records to 51902 (keeping 200 days of data) [2025-09-26T17:42:50.942087] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T17:42:51.153765] [DEBUG] [LOCAL ] BORR: Primary data saved (51902 records). [2025-09-26T17:42:51.153928] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-26T17:42:51.154036] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BORR took 37.0s. Estimated remaining: 4h 27m 32s. Rate: 7.6 symbols/min [2025-09-26T17:42:51.166032] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-26T17:42:51.336423] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:42:51.356935] [DEBUG] [LOCAL ] BRC: Loaded 19466 existing records from primary storage. [2025-09-26T17:42:51.357079] [INFO ] [MAIN ] BRC: Loaded 19466 existing records. [2025-09-26T17:42:51.583500] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:42:51.584348] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-26T17:42:51.584600] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-26T17:42:51.585569] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-26T17:42:51.585706] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-26T17:42:51.832320] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T17:42:51.961904] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-26T17:42:52.036928] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:42:52.756752] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-26T17:42:53.249205] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:42:53.288987] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T17:42:53.556735] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-26T17:42:53.929306] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T17:42:54.356771] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-26T17:42:54.470854] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T17:42:55.156747] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-26T17:42:55.550895] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T17:42:55.956742] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-26T17:42:56.288026] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T17:42:56.756777] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-26T17:42:57.556726] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-26T17:42:58.006128] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T17:42:58.148794] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-26T17:42:58.356747] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-26T17:42:58.751623] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T17:42:59.002794] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T17:42:59.156769] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-26T17:42:59.956735] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-26T17:43:00.756782] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-26T17:43:01.054142] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T17:43:01.091949] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T17:43:01.556693] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-26T17:43:01.954581] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T17:43:02.356752] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-26T17:43:03.156748] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-26T17:43:03.408903] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T17:43:03.525790] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T17:43:03.533430] [INFO ] [REMOTE ] BR: Full fetch complete (49074 records). [2025-09-26T17:43:03.533574] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-26T17:43:03.952529] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-26T17:43:03.952615] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-26T17:43:03.953245] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-26T17:43:03.953306] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-26T17:43:03.955489] [DEBUG] [LOCAL ] BR: Trimmed 49074 records to 35251 (keeping 200 days of data) [2025-09-26T17:43:03.956773] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-26T17:43:04.190801] [DEBUG] [LOCAL ] BR: Primary data saved (35251 records). [2025-09-26T17:43:04.190951] [INFO ] [MAIN ] BR: Full history saved. [2025-09-26T17:43:04.191035] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BR took 25.9s. Estimated remaining: 4h 27m 57s. Rate: 7.6 symbols/min [2025-09-26T17:43:04.381125] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:04.428161] [DEBUG] [LOCAL ] BRCC: Loaded 40672 existing records from primary storage. [2025-09-26T17:43:04.428378] [INFO ] [MAIN ] BRCC: Loaded 40672 existing records. [2025-09-26T17:43:04.618868] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:04.619173] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-26T17:43:04.619230] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-26T17:43:04.620581] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-26T17:43:04.620675] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-26T17:43:04.757165] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-26T17:43:04.955303] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T17:43:05.045548] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:05.079087] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T17:43:05.556724] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-26T17:43:06.356699] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-26T17:43:06.560541] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T17:43:07.164098] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-26T17:43:07.169722] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:43:07.956744] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-26T17:43:08.219671] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T17:43:08.230746] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-09-26T17:43:08.230902] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-26T17:43:08.675711] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-26T17:43:08.675897] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-26T17:43:08.676963] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-26T17:43:08.677071] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-26T17:43:08.711913] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 54491 (keeping 200 days of data) [2025-09-26T17:43:08.714091] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T17:43:08.793215] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-26T17:43:09.095178] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T17:43:09.140508] [DEBUG] [LOCAL ] BP: Primary data saved (54491 records). [2025-09-26T17:43:09.140715] [INFO ] [MAIN ] BP: Full history saved. [2025-09-26T17:43:09.140855] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BP took 46.3s. Estimated remaining: 4h 27m 31s. Rate: 7.6 symbols/min [2025-09-26T17:43:09.324223] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:09.392464] [DEBUG] [LOCAL ] BRO: Loaded 52300 existing records from primary storage. [2025-09-26T17:43:09.392673] [INFO ] [MAIN ] BRO: Loaded 52300 existing records. [2025-09-26T17:43:09.561863] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-26T17:43:09.602824] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:09.603160] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-26T17:43:09.603218] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-26T17:43:09.604948] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-26T17:43:09.605012] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-26T17:43:09.981008] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:10.326438] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T17:43:10.356682] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-26T17:43:10.964871] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T17:43:11.156748] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-26T17:43:11.918153] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:43:11.928920] [INFO ] [REMOTE ] BRBR: Full fetch complete (71905 records). [2025-09-26T17:43:11.929064] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-26T17:43:11.965920] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-26T17:43:12.401043] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-26T17:43:12.401242] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-26T17:43:12.402176] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-26T17:43:12.402258] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-26T17:43:12.403983] [DEBUG] [LOCAL ] BRBR: Trimmed 71905 records to 51987 (keeping 200 days of data) [2025-09-26T17:43:12.646567] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T17:43:12.756933] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-26T17:43:12.767411] [DEBUG] [LOCAL ] BRBR: Primary data saved (51987 records). [2025-09-26T17:43:12.767531] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-26T17:43:12.767623] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRBR took 25.6s. Estimated remaining: 4h 26m 57s. Rate: 7.6 symbols/min [2025-09-26T17:43:12.971273] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:13.028725] [DEBUG] [LOCAL ] BROS: Loaded 53677 existing records from primary storage. [2025-09-26T17:43:13.028883] [INFO ] [MAIN ] BROS: Loaded 53677 existing records. [2025-09-26T17:43:13.251755] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:13.253065] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:43:13.258219] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-26T17:43:13.258626] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-26T17:43:13.260206] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-26T17:43:13.260275] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-26T17:43:13.560969] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-26T17:43:13.644270] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:14.356801] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-26T17:43:14.565419] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:43:14.622754] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T17:43:15.156773] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-26T17:43:15.956729] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-26T17:43:16.026889] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:43:16.051238] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T17:43:16.756743] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-26T17:43:17.432857] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T17:43:17.556707] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-26T17:43:18.093200] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T17:43:18.356731] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-26T17:43:19.096475] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T17:43:19.136025] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T17:43:19.156680] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-26T17:43:19.956735] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-26T17:43:20.756757] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-26T17:43:20.899838] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T17:43:21.072479] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T17:43:21.556727] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-26T17:43:22.351176] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:43:22.361519] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-26T17:43:23.156743] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-26T17:43:23.537267] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T17:43:23.652006] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T17:43:23.956748] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-26T17:43:24.613047] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T17:43:24.618107] [INFO ] [REMOTE ] BRC: Full fetch complete (29139 records). [2025-09-26T17:43:24.618239] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-26T17:43:24.768729] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-26T17:43:25.013338] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-26T17:43:25.013421] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-26T17:43:25.013900] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-26T17:43:25.013965] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-26T17:43:25.014781] [DEBUG] [LOCAL ] BRC: Trimmed 29139 records to 19567 (keeping 200 days of data) [2025-09-26T17:43:25.136114] [DEBUG] [LOCAL ] BRC: Primary data saved (19567 records). [2025-09-26T17:43:25.136266] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-26T17:43:25.136369] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRC took 34.0s. Estimated remaining: 4h 27m 17s. Rate: 7.6 symbols/min [2025-09-26T17:43:25.314122] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:25.314312] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-26T17:43:25.314350] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-26T17:43:25.314490] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-26T17:43:25.314533] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-26T17:43:25.314574] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-26T17:43:25.314607] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-26T17:43:25.584732] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-26T17:43:25.707881] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:25.999960] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T17:43:26.062039] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T17:43:26.356737] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-26T17:43:27.156730] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-26T17:43:27.244767] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T17:43:27.905662] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T17:43:27.956753] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-26T17:43:28.166687] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:28.167074] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-26T17:43:28.758971] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-26T17:43:28.761698] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:43:29.556721] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-26T17:43:30.356708] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-26T17:43:30.455428] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T17:43:30.719572] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T17:43:31.156726] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-26T17:43:31.830025] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:43:31.956722] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-26T17:43:32.756729] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-26T17:43:33.154140] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T17:43:33.310433] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:43:33.556730] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-26T17:43:33.762015] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:33.762469] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-26T17:43:33.980625] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T17:43:34.356788] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-26T17:43:35.156786] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-26T17:43:35.360340] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:35.360764] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-26T17:43:35.956446] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T17:43:35.956726] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-26T17:43:36.170300] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:36.170620] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-26T17:43:36.756773] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-26T17:43:37.556771] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-26T17:43:37.769830] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:37.770167] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-26T17:43:38.356751] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-26T17:43:38.564303] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:38.564669] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-26T17:43:38.635343] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T17:43:39.156735] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-26T17:43:39.956726] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-26T17:43:40.694039] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T17:43:40.702959] [INFO ] [REMOTE ] BRCC: Full fetch complete (57856 records). [2025-09-26T17:43:40.703111] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-26T17:43:40.768003] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-26T17:43:41.121126] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-26T17:43:41.121255] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-26T17:43:41.122392] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-26T17:43:41.122474] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-26T17:43:41.123944] [DEBUG] [LOCAL ] BRCC: Trimmed 57856 records to 40896 (keeping 200 days of data) [2025-09-26T17:43:41.370613] [DEBUG] [LOCAL ] BRCC: Primary data saved (40896 records). [2025-09-26T17:43:41.370782] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-26T17:43:41.370908] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRCC took 37.2s. Estimated remaining: 4h 28m 0s. Rate: 7.6 symbols/min [2025-09-26T17:43:41.560915] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-26T17:43:41.564761] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:41.606152] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T17:43:41.648385] [DEBUG] [LOCAL ] BRSP: Loaded 37224 existing records from primary storage. [2025-09-26T17:43:41.648565] [INFO ] [MAIN ] BRSP: Loaded 37224 existing records. [2025-09-26T17:43:41.794363] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:43:41.848962] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-26T17:43:41.856517] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:41.856837] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-26T17:43:41.856908] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-26T17:43:41.858115] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-26T17:43:41.858200] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-26T17:43:42.295120] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:42.356765] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-26T17:43:42.568359] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T17:43:42.579002] [INFO ] [REMOTE ] BROS: Full fetch complete (76999 records). [2025-09-26T17:43:42.579158] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-26T17:43:43.004482] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-26T17:43:43.004570] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-26T17:43:43.005423] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-26T17:43:43.005491] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-26T17:43:43.007058] [DEBUG] [LOCAL ] BROS: Trimmed 76999 records to 54067 (keeping 200 days of data) [2025-09-26T17:43:43.183721] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-26T17:43:43.342971] [DEBUG] [LOCAL ] BROS: Primary data saved (54067 records). [2025-09-26T17:43:43.343111] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-26T17:43:43.343233] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BROS took 30.6s. Estimated remaining: 4h 27m 16s. Rate: 7.6 symbols/min [2025-09-26T17:43:43.532719] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:43.558885] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T17:43:43.570549] [DEBUG] [LOCAL ] BRT: Loaded 4999 existing records from primary storage. [2025-09-26T17:43:43.570718] [INFO ] [MAIN ] BRT: Loaded 4999 existing records. [2025-09-26T17:43:43.759095] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:43.759338] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-26T17:43:43.759387] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-26T17:43:43.759926] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-26T17:43:43.759991] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-26T17:43:43.958703] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-26T17:43:44.157434] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:44.756738] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-26T17:43:44.815343] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:43:44.825808] [INFO ] [REMOTE ] BRO: Full fetch complete (74206 records). [2025-09-26T17:43:44.825956] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-26T17:43:45.251184] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-26T17:43:45.251585] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-26T17:43:45.256554] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-26T17:43:45.256756] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-26T17:43:45.257708] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T17:43:45.279750] [DEBUG] [LOCAL ] BRO: Trimmed 74206 records to 52664 (keeping 200 days of data) [2025-09-26T17:43:45.280797] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:43:45.557349] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-26T17:43:45.641869] [DEBUG] [LOCAL ] BRO: Primary data saved (52664 records). [2025-09-26T17:43:45.642088] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-26T17:43:45.642211] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRO took 36.5s. Estimated remaining: 4h 26m 35s. Rate: 7.6 symbols/min [2025-09-26T17:43:45.822693] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:45.844400] [DEBUG] [LOCAL ] BRW: Loaded 19574 existing records from primary storage. [2025-09-26T17:43:45.844535] [INFO ] [MAIN ] BRW: Loaded 19574 existing records. [2025-09-26T17:43:46.031117] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:46.031418] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-26T17:43:46.031466] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-26T17:43:46.031793] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-26T17:43:46.031853] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-26T17:43:46.344152] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T17:43:46.361820] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-26T17:43:46.441369] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:47.156732] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-26T17:43:47.620147] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T17:43:47.651607] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T17:43:47.956771] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-26T17:43:48.756752] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-26T17:43:49.355138] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:43:49.398931] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:43:49.556731] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-26T17:43:50.356729] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-26T17:43:51.048550] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T17:43:51.047412] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T17:43:51.156746] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-26T17:43:51.956731] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-26T17:43:52.637428] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T17:43:52.670462] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T17:43:52.756751] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-26T17:43:53.556722] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-26T17:43:54.361890] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-26T17:43:54.380904] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T17:43:54.391896] [INFO ] [REMOTE ] BRSL: Full fetch complete (22342 records). [2025-09-26T17:43:54.392094] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-26T17:43:54.606826] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 61 unique days, need 200 days [2025-09-26T17:43:54.619705] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:43:54.620305] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:43:54.620935] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T17:43:54.621023] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-26T17:43:54.625870] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-26T17:43:54.626508] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-26T17:43:54.626607] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-26T17:43:54.626734] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BRSL took 29.5s. Estimated remaining: 4h 26m 34s. Rate: 7.6 symbols/min [2025-09-26T17:43:54.809394] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:43:54.863004] [DEBUG] [LOCAL ] BRX: Loaded 52115 existing records from primary storage. [2025-09-26T17:43:54.863154] [INFO ] [MAIN ] BRX: Loaded 52115 existing records. [2025-09-26T17:43:55.049248] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:43:55.049579] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-26T17:43:55.049636] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-26T17:43:55.049945] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-26T17:43:55.050004] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-26T17:43:55.161819] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-26T17:43:55.421681] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:43:55.956697] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-26T17:43:56.087291] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T17:43:56.127925] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:43:56.756731] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-26T17:43:57.430735] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T17:43:57.549370] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:43:57.560136] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-26T17:43:58.356751] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-26T17:43:58.880075] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:43:59.080775] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T17:43:59.156768] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-26T17:43:59.956732] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-26T17:44:00.332545] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T17:44:00.756759] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-26T17:44:01.403116] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T17:44:01.444442] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T17:44:01.556733] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-26T17:44:02.356738] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-26T17:44:02.563976] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T17:44:03.156798] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-26T17:44:03.368754] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T17:44:03.956750] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-26T17:44:04.669392] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T17:44:04.756792] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-26T17:44:05.556719] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-26T17:44:05.591325] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T17:44:06.238935] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T17:44:06.263815] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T17:44:06.356750] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-26T17:44:07.156768] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-26T17:44:07.956734] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-26T17:44:08.056487] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:44:08.064262] [INFO ] [REMOTE ] BRSP: Full fetch complete (54010 records). [2025-09-26T17:44:08.064441] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-26T17:44:08.201408] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T17:44:08.489361] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-26T17:44:08.489452] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-26T17:44:08.490091] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-26T17:44:08.490192] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-26T17:44:08.491468] [DEBUG] [LOCAL ] BRSP: Trimmed 54010 records to 37442 (keeping 200 days of data) [2025-09-26T17:44:08.716253] [DEBUG] [LOCAL ] BRSP: Primary data saved (37442 records). [2025-09-26T17:44:08.716413] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-26T17:44:08.716502] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRSP took 27.3s. Estimated remaining: 4h 27m 3s. Rate: 7.6 symbols/min [2025-09-26T17:44:08.761871] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-26T17:44:08.830128] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T17:44:08.835983] [INFO ] [REMOTE ] BRT: Full fetch complete (6818 records). [2025-09-26T17:44:08.846593] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-26T17:44:08.993743] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:09.282034] [DEBUG] [LOCAL ] BSAC: Loaded 33282 existing records from primary storage. [2025-09-26T17:44:09.307991] [INFO ] [MAIN ] BSAC: Loaded 33282 existing records. [2025-09-26T17:44:09.351813] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-26T17:44:09.364291] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-26T17:44:09.389132] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-26T17:44:09.408053] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-26T17:44:09.435932] [DEBUG] [LOCAL ] BRT: Trimmed 6818 records to 5034 (keeping 200 days of data) [2025-09-26T17:44:09.556827] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:09.556955] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-26T17:44:09.560354] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-26T17:44:09.560779] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-26T17:44:09.561349] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-26T17:44:09.562032] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-26T17:44:09.576141] [DEBUG] [LOCAL ] BRT: Primary data saved (5034 records). [2025-09-26T17:44:09.602054] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-26T17:44:09.639044] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRT took 26.3s. Estimated remaining: 4h 26m 14s. Rate: 7.6 symbols/min [2025-09-26T17:44:10.029017] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:10.165992] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:10.193119] [DEBUG] [LOCAL ] BSBR: Loaded 35491 existing records from primary storage. [2025-09-26T17:44:10.193280] [INFO ] [MAIN ] BSBR: Loaded 35491 existing records. [2025-09-26T17:44:10.362118] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-26T17:44:10.398376] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:10.399953] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-26T17:44:10.400015] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-26T17:44:10.400266] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-26T17:44:10.400430] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-26T17:44:10.668746] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T17:44:10.819023] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:10.849525] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-26T17:44:11.156749] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-26T17:44:11.629872] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:44:11.956766] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-26T17:44:12.593861] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T17:44:12.756761] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-26T17:44:13.045869] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T17:44:13.413476] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T17:44:13.556725] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-26T17:44:14.356746] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-26T17:44:14.955039] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T17:44:15.156766] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-26T17:44:15.530639] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:44:15.958421] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-26T17:44:15.968170] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T17:44:16.756767] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-26T17:44:16.801149] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:44:17.556724] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-26T17:44:18.231108] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:44:18.356729] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-26T17:44:18.493231] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T17:44:19.156774] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-26T17:44:19.327578] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:44:19.335926] [INFO ] [REMOTE ] BRW: Full fetch complete (29799 records). [2025-09-26T17:44:19.336152] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-26T17:44:19.978575] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-26T17:44:19.993189] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-26T17:44:19.993277] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-26T17:44:19.993810] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-26T17:44:19.993899] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-26T17:44:19.994668] [DEBUG] [LOCAL ] BRW: Trimmed 29799 records to 19862 (keeping 200 days of data) [2025-09-26T17:44:20.119848] [DEBUG] [LOCAL ] BRW: Primary data saved (19862 records). [2025-09-26T17:44:20.120028] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-26T17:44:20.120127] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 34.5s. Estimated remaining: 4h 26m 22s. Rate: 7.6 symbols/min [2025-09-26T17:44:20.295355] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T17:44:20.350598] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:20.362204] [DEBUG] [LOCAL ] BSL: Loaded 8077 existing records from primary storage. [2025-09-26T17:44:20.362317] [INFO ] [MAIN ] BSL: Loaded 8077 existing records. [2025-09-26T17:44:20.554268] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:20.554561] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-26T17:44:20.554610] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-26T17:44:20.554854] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-26T17:44:20.554912] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-26T17:44:20.766872] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-26T17:44:20.920999] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:21.556699] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-26T17:44:21.638372] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T17:44:21.768588] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T17:44:22.356731] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-26T17:44:22.659683] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T17:44:23.156735] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-26T17:44:23.795271] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T17:44:23.956767] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-26T17:44:24.358569] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T17:44:24.756735] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-26T17:44:25.056047] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T17:44:25.556723] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-26T17:44:25.679005] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T17:44:26.326248] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:44:26.356680] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-26T17:44:27.156743] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-26T17:44:27.575229] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T17:44:27.956811] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-26T17:44:28.756720] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-26T17:44:28.843099] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T17:44:29.530011] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T17:44:29.556680] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-26T17:44:29.669574] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T17:44:30.356721] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-26T17:44:30.989096] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T17:44:31.156727] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-26T17:44:31.956732] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-26T17:44:31.996286] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T17:44:32.006797] [INFO ] [REMOTE ] BRX: Full fetch complete (74865 records). [2025-09-26T17:44:32.006976] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-26T17:44:32.441160] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-26T17:44:32.441323] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-26T17:44:32.442318] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-26T17:44:32.442548] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-26T17:44:32.474868] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T17:44:32.475311] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:44:32.473392] [DEBUG] [LOCAL ] BRX: Trimmed 74865 records to 52462 (keeping 200 days of data) [2025-09-26T17:44:32.488197] [INFO ] [REMOTE ] BSBR: Full fetch complete (50612 records). [2025-09-26T17:44:32.488339] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-26T17:44:32.763367] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-26T17:44:33.033925] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-26T17:44:33.034284] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-26T17:44:33.035321] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-26T17:44:33.035406] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-26T17:44:33.039113] [DEBUG] [LOCAL ] BSBR: Trimmed 50612 records to 35731 (keeping 200 days of data) [2025-09-26T17:44:33.387831] [DEBUG] [LOCAL ] BSBR: Primary data saved (35731 records). [2025-09-26T17:44:33.388542] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-26T17:44:33.389274] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BSBR took 23.7s. Estimated remaining: 4h 26m 46s. Rate: 7.6 symbols/min [2025-09-26T17:44:33.557617] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-26T17:44:33.591769] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:33.663390] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T17:44:33.697765] [DEBUG] [LOCAL ] BSM: Loaded 32577 existing records from primary storage. [2025-09-26T17:44:33.698495] [INFO ] [MAIN ] BSM: Loaded 32577 existing records. [2025-09-26T17:44:33.901462] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:33.903241] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-26T17:44:33.905214] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-26T17:44:33.905103] [DEBUG] [LOCAL ] BRX: Primary data saved (52462 records). [2025-09-26T17:44:33.905429] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-26T17:44:33.905557] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BRX took 39.3s. Estimated remaining: 4h 25m 54s. Rate: 7.6 symbols/min [2025-09-26T17:44:33.905628] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-26T17:44:33.905997] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-26T17:44:34.293354] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:34.312462] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-09-26T17:44:34.362861] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-09-26T17:44:34.362718] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-26T17:44:34.399529] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-26T17:44:34.429608] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-26T17:44:34.429886] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-26T17:44:34.429976] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-26T17:44:34.638928] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:34.925171] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:35.023550] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T17:44:35.039230] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T17:44:35.156768] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-26T17:44:35.956746] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-26T17:44:36.473478] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T17:44:36.756767] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-26T17:44:37.171445] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T17:44:37.556761] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-26T17:44:37.703469] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T17:44:37.709997] [INFO ] [REMOTE ] BSAC: Full fetch complete (43547 records). [2025-09-26T17:44:37.710136] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-26T17:44:38.116020] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-26T17:44:38.116244] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-26T17:44:38.116907] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-26T17:44:38.117067] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-26T17:44:38.125375] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T17:44:38.128636] [DEBUG] [LOCAL ] BSAC: Trimmed 43547 records to 33389 (keeping 200 days of data) [2025-09-26T17:44:38.340434] [DEBUG] [LOCAL ] BSAC: Primary data saved (33389 records). [2025-09-26T17:44:38.340586] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-26T17:44:38.340703] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSAC took 29.6s. Estimated remaining: 4h 25m 26s. Rate: 7.6 symbols/min [2025-09-26T17:44:38.363960] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-26T17:44:38.576186] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:38.602483] [DEBUG] [LOCAL ] BSTZ: Loaded 25007 existing records from primary storage. [2025-09-26T17:44:38.602634] [INFO ] [MAIN ] BSTZ: Loaded 25007 existing records. [2025-09-26T17:44:38.803570] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:38.803892] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-26T17:44:38.803973] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-26T17:44:38.804202] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-26T17:44:38.804262] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-26T17:44:39.161827] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-26T17:44:39.242438] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:39.408997] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:44:39.764384] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T17:44:39.956735] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-26T17:44:40.756729] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-26T17:44:41.189224] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T17:44:41.556736] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-26T17:44:42.232019] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T17:44:42.356691] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-26T17:44:42.733317] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T17:44:43.098784] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T17:44:43.156723] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-26T17:44:43.956705] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-26T17:44:44.109850] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T17:44:44.647551] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T17:44:44.756747] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-26T17:44:45.379612] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T17:44:45.556733] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-26T17:44:46.356737] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-26T17:44:46.843430] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T17:44:47.156763] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-26T17:44:47.563995] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T17:44:47.956787] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-26T17:44:48.073777] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T17:44:48.756733] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-26T17:44:49.087314] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:44:49.556726] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-26T17:44:49.601956] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T17:44:50.356765] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-26T17:44:50.891816] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T17:44:51.156729] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-26T17:44:51.524786] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T17:44:51.527005] [INFO ] [REMOTE ] BSL: Full fetch complete (12528 records). [2025-09-26T17:44:51.527079] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-26T17:44:51.527559] [FATAL] [VALIDATOR ] BSL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:44:51.527666] [FATAL] [MAIN ] BSL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:44:51.527726] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:44:51.527793] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-26T17:44:51.527861] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-09-26T17:44:51.527898] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-09-26T17:44:51.528311] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-09-26T17:44:51.528412] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSL took 31.4s. Estimated remaining: 4h 25m 50s. Rate: 7.6 symbols/min [2025-09-26T17:44:51.708430] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:44:51.764609] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-09-26T17:44:51.764808] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-09-26T17:44:51.965287] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-26T17:44:51.974069] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:44:51.974371] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-26T17:44:51.974441] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-26T17:44:51.974769] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-26T17:44:51.974848] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-26T17:44:52.389286] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:44:52.392132] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:44:52.756736] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-26T17:44:53.524600] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:44:53.556700] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-26T17:44:53.809627] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-26T17:44:54.288751] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T17:44:54.356724] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-26T17:44:55.156764] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-26T17:44:55.956737] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-26T17:44:56.231130] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:44:56.401248] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T17:44:56.629911] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T17:44:56.756751] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-26T17:44:57.556720] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-26T17:44:57.775810] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T17:44:58.356735] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-26T17:44:59.156763] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-26T17:44:59.479777] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T17:44:59.956727] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-26T17:45:00.055458] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T17:45:00.756788] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-26T17:45:01.556748] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-26T17:45:02.294708] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (3.14 seconds). [2025-09-26T17:45:02.356743] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-26T17:45:02.728332] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-09-26T17:45:03.130839] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-26T17:45:03.156727] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-26T17:45:03.404110] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T17:45:03.607612] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:45:03.614576] [INFO ] [REMOTE ] BSM: Full fetch complete (47311 records). [2025-09-26T17:45:03.614744] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-26T17:45:03.615463] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:45:03.615569] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:45:03.615670] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:45:03.615759] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-26T17:45:03.615872] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-09-26T17:45:03.615955] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-09-26T17:45:03.616342] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-09-26T17:45:03.616520] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSM took 30.2s. Estimated remaining: 4h 26m 7s. Rate: 7.6 symbols/min [2025-09-26T17:45:03.806429] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:03.807685] [DEBUG] [LOCAL ] BTA: No existing data file found in primary storage. [2025-09-26T17:45:03.807745] [WARN ] [MAIN ] BTA: No existing data found, performing full refresh instead. [2025-09-26T17:45:03.807985] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-26T17:45:03.808041] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-26T17:45:03.808087] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-09-26T17:45:03.808121] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-26T17:45:03.961894] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-26T17:45:04.191853] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:04.712633] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T17:45:04.717584] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36448 records). [2025-09-26T17:45:04.717756] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-26T17:45:04.718472] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:45:04.718767] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:45:04.718846] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:45:04.718921] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-26T17:45:04.718992] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-09-26T17:45:04.719029] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-09-26T17:45:04.719432] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-09-26T17:45:04.719534] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BSTZ took 26.4s. Estimated remaining: 4h 25m 19s. Rate: 7.6 symbols/min [2025-09-26T17:45:04.761827] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-26T17:45:04.909339] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:04.909580] [DEBUG] [LOCAL ] BTCM: No existing data file found in primary storage. [2025-09-26T17:45:04.909638] [WARN ] [MAIN ] BTCM: No existing data found, performing full refresh instead. [2025-09-26T17:45:04.909818] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-26T17:45:04.909865] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-26T17:45:04.909915] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-09-26T17:45:04.909952] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-26T17:45:05.232245] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T17:45:05.324424] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:05.556733] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-26T17:45:06.356767] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-26T17:45:06.718871] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:45:06.805029] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T17:45:06.961731] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T17:45:07.156733] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-26T17:45:07.878686] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T17:45:07.956764] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-26T17:45:08.756705] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-26T17:45:09.057765] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T17:45:09.556739] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-26T17:45:10.325713] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T17:45:10.356700] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-26T17:45:10.927859] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T17:45:11.156779] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-26T17:45:11.832994] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T17:45:11.956739] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-26T17:45:12.406550] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T17:45:12.756736] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-26T17:45:13.101777] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T17:45:13.263394] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:45:13.556742] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-26T17:45:14.270174] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T17:45:14.356782] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-26T17:45:15.156738] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-26T17:45:15.675792] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T17:45:15.708791] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T17:45:15.712963] [INFO ] [REMOTE ] BST: Full fetch complete (28721 records). [2025-09-26T17:45:15.713046] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-26T17:45:15.961869] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-26T17:45:16.123630] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-26T17:45:16.123765] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-26T17:45:16.124209] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-26T17:45:16.124276] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-26T17:45:16.125263] [DEBUG] [LOCAL ] BST: Trimmed 28721 records to 19385 (keeping 200 days of data) [2025-09-26T17:45:16.266932] [DEBUG] [LOCAL ] BST: Primary data saved (19385 records). [2025-09-26T17:45:16.267134] [INFO ] [MAIN ] BST: Full history saved. [2025-09-26T17:45:16.267254] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BST took 42.4s. Estimated remaining: 4h 25m 33s. Rate: 7.6 symbols/min [2025-09-26T17:45:16.466807] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:16.524991] [DEBUG] [LOCAL ] BTE: Loaded 53117 existing records from primary storage. [2025-09-26T17:45:16.525154] [INFO ] [MAIN ] BTE: Loaded 53117 existing records. [2025-09-26T17:45:16.727355] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:16.727664] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-26T17:45:16.727740] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-26T17:45:16.728011] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-26T17:45:16.728070] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-26T17:45:16.762417] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-26T17:45:17.149558] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:17.512685] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T17:45:17.556734] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-26T17:45:18.070187] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T17:45:18.086853] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T17:45:18.356735] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-26T17:45:18.976322] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T17:45:19.156768] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-26T17:45:19.956775] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-26T17:45:20.756808] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-26T17:45:20.816888] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T17:45:20.996595] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T17:45:21.556727] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-26T17:45:22.350851] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T17:45:22.361885] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-26T17:45:22.554670] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:45:22.556601] [INFO ] [REMOTE ] BTA: Full fetch complete (9607 records). [2025-09-26T17:45:22.556717] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-26T17:45:22.954224] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-26T17:45:22.954318] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-26T17:45:22.954675] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-26T17:45:22.954744] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-26T17:45:22.955319] [DEBUG] [LOCAL ] BTA: Trimmed 9607 records to 5464 (keeping 200 days of data) [2025-09-26T17:45:22.988881] [DEBUG] [LOCAL ] BTA: Primary data saved (5464 records). [2025-09-26T17:45:22.989005] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-26T17:45:22.989087] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BTA took 19.4s. Estimated remaining: 4h 25m 19s. Rate: 7.6 symbols/min [2025-09-26T17:45:23.167534] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-26T17:45:23.171099] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:23.245355] [DEBUG] [LOCAL ] BTI: Loaded 53946 existing records from primary storage. [2025-09-26T17:45:23.245533] [INFO ] [MAIN ] BTI: Loaded 53946 existing records. [2025-09-26T17:45:23.434475] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:23.434760] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-26T17:45:23.434817] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-26T17:45:23.435088] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-26T17:45:23.435147] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-26T17:45:23.805632] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:23.956687] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-26T17:45:24.424123] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T17:45:24.490085] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T17:45:24.756726] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-26T17:45:25.568042] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-26T17:45:25.574175] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T17:45:25.968229] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T17:45:25.983761] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-26T17:45:26.356744] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-26T17:45:27.156734] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-26T17:45:27.609042] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T17:45:27.919361] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:45:27.956722] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-26T17:45:28.756739] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-26T17:45:29.556741] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-26T17:45:29.890236] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T17:45:30.243331] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T17:45:30.356774] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-26T17:45:30.987729] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T17:45:31.156727] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-26T17:45:31.956773] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-26T17:45:32.255631] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T17:45:32.266518] [INFO ] [REMOTE ] BSX: Full fetch complete (77694 records). [2025-09-26T17:45:32.266699] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-26T17:45:32.694541] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-26T17:45:32.694723] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-26T17:45:32.695777] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-26T17:45:32.695925] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-26T17:45:32.703201] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T17:45:32.707344] [DEBUG] [LOCAL ] BSX: Trimmed 77694 records to 54468 (keeping 200 days of data) [2025-09-26T17:45:32.775720] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-26T17:45:32.985506] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T17:45:33.122024] [DEBUG] [LOCAL ] BSX: Primary data saved (54468 records). [2025-09-26T17:45:33.122182] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-26T17:45:33.122276] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BSX took 41.6s. Estimated remaining: 4h 25m 24s. Rate: 7.6 symbols/min [2025-09-26T17:45:33.313172] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:33.328846] [DEBUG] [LOCAL ] BTO: Loaded 8942 existing records from primary storage. [2025-09-26T17:45:33.329009] [INFO ] [MAIN ] BTO: Loaded 8942 existing records. [2025-09-26T17:45:33.526063] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:33.526386] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-26T17:45:33.526442] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-26T17:45:33.526683] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-26T17:45:33.526743] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-26T17:45:33.561884] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-26T17:45:33.953727] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:34.312282] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T17:45:34.356764] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-26T17:45:34.440221] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T17:45:35.156787] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-26T17:45:35.280870] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T17:45:35.956787] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-26T17:45:36.450848] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-26T17:45:36.756788] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-26T17:45:36.844583] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T17:45:37.257996] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T17:45:37.556741] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-26T17:45:38.356804] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-26T17:45:39.156781] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-26T17:45:39.605808] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T17:45:39.750863] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T17:45:39.956795] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-26T17:45:40.626151] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:45:40.756798] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-26T17:45:41.370557] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:45:41.507481] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T17:45:41.556747] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-26T17:45:42.356773] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-26T17:45:42.541048] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T17:45:43.156768] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-26T17:45:43.805801] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T17:45:43.811119] [INFO ] [REMOTE ] BTCM: Full fetch complete (19435 records). [2025-09-26T17:45:43.811225] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-26T17:45:43.942152] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:45:43.963249] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-26T17:45:44.236357] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-26T17:45:44.236443] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-26T17:45:44.236825] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-26T17:45:44.236890] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-26T17:45:44.237551] [DEBUG] [LOCAL ] BTCM: Trimmed 19435 records to 15122 (keeping 200 days of data) [2025-09-26T17:45:44.340398] [DEBUG] [LOCAL ] BTCM: Primary data saved (15122 records). [2025-09-26T17:45:44.340634] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-26T17:45:44.340789] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTCM took 39.6s. Estimated remaining: 4h 25m 36s. Rate: 7.6 symbols/min [2025-09-26T17:45:44.530826] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:44.550458] [DEBUG] [LOCAL ] BTT: Loaded 16032 existing records from primary storage. [2025-09-26T17:45:44.550630] [INFO ] [MAIN ] BTT: Loaded 16032 existing records. [2025-09-26T17:45:44.755286] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:44.755608] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-26T17:45:44.755689] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-26T17:45:44.755944] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-26T17:45:44.756004] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-26T17:45:44.767933] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-26T17:45:45.146438] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:45.556718] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-26T17:45:46.128781] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-26T17:45:46.242013] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T17:45:46.356783] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-26T17:45:46.860572] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:45:47.156817] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-26T17:45:47.234920] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T17:45:47.956771] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-26T17:45:48.756717] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-26T17:45:49.025035] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T17:45:49.073146] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T17:45:49.231580] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T17:45:49.556748] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-26T17:45:50.356787] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-26T17:45:50.398403] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T17:45:51.156781] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-26T17:45:51.682353] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T17:45:51.961829] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-26T17:45:51.984180] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:45:52.756749] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-26T17:45:52.813771] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:45:52.816773] [INFO ] [REMOTE ] BTO: Full fetch complete (13283 records). [2025-09-26T17:45:52.816917] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-26T17:45:53.207364] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-26T17:45:53.207454] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-26T17:45:53.207769] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-26T17:45:53.207832] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-26T17:45:53.208353] [DEBUG] [LOCAL ] BTO: Trimmed 13283 records to 8982 (keeping 200 days of data) [2025-09-26T17:45:53.266072] [DEBUG] [LOCAL ] BTO: Primary data saved (8982 records). [2025-09-26T17:45:53.266220] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-26T17:45:53.266313] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BTO took 20.1s. Estimated remaining: 4h 25m 34s. Rate: 7.6 symbols/min [2025-09-26T17:45:53.450192] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:53.513755] [DEBUG] [LOCAL ] BTU: Loaded 53693 existing records from primary storage. [2025-09-26T17:45:53.513952] [INFO ] [MAIN ] BTU: Loaded 53693 existing records. [2025-09-26T17:45:53.561937] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-26T17:45:53.720717] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:45:53.721051] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-26T17:45:53.721109] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-26T17:45:53.721518] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-26T17:45:53.721582] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-26T17:45:54.156955] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:54.356785] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-26T17:45:54.752839] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T17:45:54.946859] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T17:45:55.156776] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-26T17:45:55.319833] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T17:45:55.330351] [INFO ] [REMOTE ] BTI: Full fetch complete (77040 records). [2025-09-26T17:45:55.330512] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-26T17:45:55.332938] [FATAL] [VALIDATOR ] BTI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:45:55.333061] [FATAL] [MAIN ] BTI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:45:55.333106] [WARN ] [MAIN ] BTI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:45:55.333157] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-26T17:45:55.333217] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-09-26T17:45:55.333299] [INFO ] [LOCAL ] BTI: Starting deletion of derivative data. [2025-09-26T17:45:55.333734] [DEBUG] [LOCAL ] BTI: Deleted derivative data file. [2025-09-26T17:45:55.333836] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTI took 32.3s. Estimated remaining: 4h 24m 52s. Rate: 7.6 symbols/min [2025-09-26T17:45:55.523761] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:45:55.523956] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-26T17:45:55.523996] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-26T17:45:55.524138] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-26T17:45:55.524182] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-26T17:45:55.524225] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-26T17:45:55.524258] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-26T17:45:55.936734] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:45:55.950910] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T17:45:55.956668] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-26T17:45:56.756771] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-26T17:45:57.121512] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T17:45:57.556719] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-26T17:45:58.356712] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-26T17:45:58.492367] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T17:45:58.538866] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T17:45:58.571185] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:45:58.571518] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-26T17:45:59.156786] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-26T17:45:59.956745] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-26T17:46:00.756700] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-26T17:46:01.030056] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:46:01.032536] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T17:46:01.556731] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-26T17:46:02.356723] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-26T17:46:02.528126] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T17:46:02.576201] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:46:02.578872] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T17:46:02.578965] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-26T17:46:02.590295] [INFO ] [REMOTE ] BTE: Full fetch complete (75997 records). [2025-09-26T17:46:02.590403] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-26T17:46:03.013215] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-26T17:46:03.013319] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-26T17:46:03.014162] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-26T17:46:03.014231] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-26T17:46:03.015855] [DEBUG] [LOCAL ] BTE: Trimmed 75997 records to 53505 (keeping 200 days of data) [2025-09-26T17:46:03.204782] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-26T17:46:03.367280] [DEBUG] [LOCAL ] BTE: Primary data saved (53505 records). [2025-09-26T17:46:03.367461] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-26T17:46:03.367576] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTE took 47.1s. Estimated remaining: 4h 24m 45s. Rate: 7.6 symbols/min [2025-09-26T17:46:03.561014] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:03.586419] [DEBUG] [LOCAL ] BTZ: Loaded 22899 existing records from primary storage. [2025-09-26T17:46:03.586572] [INFO ] [MAIN ] BTZ: Loaded 22899 existing records. [2025-09-26T17:46:03.789270] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:46:03.789540] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-26T17:46:03.789592] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-26T17:46:03.789866] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-26T17:46:03.789927] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-26T17:46:03.961505] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-26T17:46:04.219830] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:04.756755] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-26T17:46:05.012429] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T17:46:05.033847] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:46:05.037806] [INFO ] [REMOTE ] BTT: Full fetch complete (24303 records). [2025-09-26T17:46:05.037893] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-26T17:46:05.457710] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-26T17:46:05.457882] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-26T17:46:05.459003] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-26T17:46:05.459467] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-26T17:46:05.459375] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T17:46:05.464073] [DEBUG] [LOCAL ] BTT: Trimmed 24303 records to 16126 (keeping 200 days of data) [2025-09-26T17:46:05.556945] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-26T17:46:05.574605] [DEBUG] [LOCAL ] BTT: Primary data saved (16126 records). [2025-09-26T17:46:05.574970] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-26T17:46:05.575082] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTT took 21.2s. Estimated remaining: 4h 24m 5s. Rate: 7.6 symbols/min [2025-09-26T17:46:05.766950] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:05.820339] [DEBUG] [LOCAL ] BUD: Loaded 53125 existing records from primary storage. [2025-09-26T17:46:05.820550] [INFO ] [MAIN ] BUD: Loaded 53125 existing records. [2025-09-26T17:46:06.033143] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:46:06.033485] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-26T17:46:06.033543] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-26T17:46:06.033880] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-26T17:46:06.033940] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-26T17:46:06.361961] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-26T17:46:06.450778] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:06.831784] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T17:46:07.156755] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-26T17:46:07.279923] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T17:46:07.956765] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-26T17:46:08.756893] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-26T17:46:08.953943] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:46:09.000256] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T17:46:09.556726] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-26T17:46:10.157941] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T17:46:10.356760] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-26T17:46:10.420881] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:46:11.156770] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-26T17:46:11.956714] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-26T17:46:12.069511] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T17:46:12.114287] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T17:46:12.756721] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-26T17:46:12.780084] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T17:46:13.556739] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-26T17:46:14.230296] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T17:46:14.356738] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-26T17:46:15.101370] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:46:15.156732] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-26T17:46:15.273710] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T17:46:15.956750] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-26T17:46:16.690899] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T17:46:16.756736] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-26T17:46:17.556735] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-26T17:46:17.969901] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T17:46:18.356756] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-26T17:46:18.737975] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T17:46:18.811545] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T17:46:18.821870] [INFO ] [REMOTE ] BTX: Full fetch complete (36384 records). [2025-09-26T17:46:18.822129] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-26T17:46:19.045118] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 152 unique days, need 200 days [2025-09-26T17:46:19.045726] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:46:19.045818] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:46:19.045929] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-26T17:46:19.046043] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-26T17:46:19.046140] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-26T17:46:19.046229] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-26T17:46:19.046336] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTX took 23.7s. Estimated remaining: 4h 24m 29s. Rate: 7.6 symbols/min [2025-09-26T17:46:19.161841] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-26T17:46:19.269670] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:19.269852] [DEBUG] [LOCAL ] BUI: No existing data file found in primary storage. [2025-09-26T17:46:19.269891] [WARN ] [MAIN ] BUI: No existing data found, performing full refresh instead. [2025-09-26T17:46:19.270112] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-26T17:46:19.270177] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-26T17:46:19.270238] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-09-26T17:46:19.270307] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-26T17:46:19.671273] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:19.889489] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T17:46:19.956731] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-26T17:46:20.756755] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-26T17:46:21.241458] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T17:46:21.278628] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T17:46:21.462026] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T17:46:21.556734] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-26T17:46:22.356726] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-26T17:46:22.716162] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T17:46:23.156730] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-26T17:46:23.956684] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-26T17:46:24.148833] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T17:46:24.234326] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T17:46:24.756738] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-26T17:46:25.319346] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T17:46:25.556772] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-26T17:46:26.134903] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T17:46:26.356777] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-26T17:46:26.896108] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T17:46:27.156786] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-26T17:46:27.684433] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T17:46:27.826891] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T17:46:27.956747] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-26T17:46:28.543886] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T17:46:28.756782] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-26T17:46:29.556755] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-26T17:46:30.356777] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-26T17:46:30.568492] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-26T17:46:30.636286] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T17:46:31.156777] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-26T17:46:31.956739] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-26T17:46:32.297459] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T17:46:32.315376] [DEBUG] [REMOTE ] BTZ: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-26T17:46:32.316397] [WARN ] [REMOTE ] BTZ: No data returned for month 2025-08 [2025-09-26T17:46:32.631116] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T17:46:32.756791] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-26T17:46:33.556720] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-26T17:46:34.356723] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-26T17:46:34.745826] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T17:46:34.756976] [INFO ] [REMOTE ] BUD: Full fetch complete (76490 records). [2025-09-26T17:46:34.757181] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-26T17:46:34.962631] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T17:46:35.054480] [INFO ] [REMOTE ] BTZ: Full fetch complete (30369 records). [2025-09-26T17:46:35.104819] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-26T17:46:35.161556] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-26T17:46:35.465411] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-26T17:46:35.498457] [WARN ] [VALIDATOR ] BTZ: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T17:46:35.498602] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-26T17:46:35.500161] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-26T17:46:35.500309] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-26T17:46:35.500949] [FATAL] [MAIN ] BTZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:46:35.501430] [WARN ] [MAIN ] BTZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:46:35.501580] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-26T17:46:35.501877] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-09-26T17:46:35.502000] [INFO ] [LOCAL ] BTZ: Starting deletion of derivative data. [2025-09-26T17:46:35.502606] [DEBUG] [LOCAL ] BTZ: Deleted derivative data file. [2025-09-26T17:46:35.502764] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTZ took 32.1s. Estimated remaining: 4h 25m 11s. Rate: 7.6 symbols/min [2025-09-26T17:46:35.508559] [DEBUG] [LOCAL ] BUD: Trimmed 76490 records to 53504 (keeping 200 days of data) [2025-09-26T17:46:35.802938] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:35.864066] [DEBUG] [LOCAL ] BUR: Loaded 45395 existing records from primary storage. [2025-09-26T17:46:35.865881] [INFO ] [MAIN ] BUR: Loaded 45395 existing records. [2025-09-26T17:46:35.866525] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T17:46:35.962808] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-26T17:46:36.189273] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:46:36.191399] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-26T17:46:36.192510] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-26T17:46:36.194018] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-26T17:46:36.194465] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-26T17:46:36.646526] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-26T17:46:36.645298] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:36.660886] [INFO ] [REMOTE ] BTU: Full fetch complete (76851 records). [2025-09-26T17:46:36.661095] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-26T17:46:36.757627] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-26T17:46:36.915227] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:46:37.185562] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-26T17:46:37.185973] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-26T17:46:37.187002] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-26T17:46:37.187762] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-26T17:46:37.193166] [DEBUG] [LOCAL ] BTU: Trimmed 76851 records to 54082 (keeping 200 days of data) [2025-09-26T17:46:37.298918] [DEBUG] [LOCAL ] BUD: Primary data saved (53504 records). [2025-09-26T17:46:37.299572] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-26T17:46:37.300011] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BUD took 31.7s. Estimated remaining: 4h 24m 28s. Rate: 7.6 symbols/min [2025-09-26T17:46:37.509094] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:37.559725] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-26T17:46:37.626804] [DEBUG] [LOCAL ] BURL: Loaded 46617 existing records from primary storage. [2025-09-26T17:46:37.653852] [INFO ] [MAIN ] BURL: Loaded 46617 existing records. [2025-09-26T17:46:37.861909] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:46:37.863271] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-26T17:46:37.863580] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-26T17:46:37.864209] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-26T17:46:37.864285] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-26T17:46:38.280046] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:38.359436] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-26T17:46:38.432439] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T17:46:38.455347] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T17:46:38.474952] [DEBUG] [LOCAL ] BTU: Primary data saved (54082 records). [2025-09-26T17:46:38.475122] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-26T17:46:38.475232] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BTU took 45.2s. Estimated remaining: 4h 23m 42s. Rate: 7.6 symbols/min [2025-09-26T17:46:38.657798] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:46:38.658059] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-09-26T17:46:38.658134] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-09-26T17:46:38.658288] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-26T17:46:38.658333] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-26T17:46:38.658375] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-09-26T17:46:38.658407] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-26T17:46:39.057221] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:46:39.156747] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-26T17:46:39.956752] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-26T17:46:40.100077] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T17:46:40.269821] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T17:46:40.756766] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-26T17:46:40.922814] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T17:46:41.556738] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-26T17:46:42.317412] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T17:46:42.338471] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T17:46:42.356742] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-26T17:46:43.156743] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-26T17:46:43.911125] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:46:43.956058] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T17:46:43.959331] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-26T17:46:44.756776] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-26T17:46:45.556736] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-26T17:46:45.596665] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T17:46:45.648108] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T17:46:46.356740] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-26T17:46:46.797781] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T17:46:47.156799] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-26T17:46:47.562340] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T17:46:47.704435] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T17:46:47.956763] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-26T17:46:48.756753] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-26T17:46:49.428191] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T17:46:49.556721] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-26T17:46:50.125324] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T17:46:50.356706] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-26T17:46:50.509854] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T17:46:51.156764] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-26T17:46:51.905861] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T17:46:51.931578] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T17:46:51.956736] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-26T17:46:52.756741] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-26T17:46:53.047002] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:46:53.556738] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-26T17:46:54.169117] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T17:46:54.191155] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T17:46:54.356743] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-26T17:46:55.156734] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-26T17:46:55.409403] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T17:46:55.412634] [INFO ] [REMOTE ] BUI: Full fetch complete (16208 records). [2025-09-26T17:46:55.412805] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-26T17:46:55.801416] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-26T17:46:55.801498] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-26T17:46:55.801831] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-26T17:46:55.801916] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-26T17:46:55.802541] [DEBUG] [LOCAL ] BUI: Trimmed 16208 records to 11615 (keeping 200 days of data) [2025-09-26T17:46:55.878169] [DEBUG] [LOCAL ] BUI: Primary data saved (11615 records). [2025-09-26T17:46:55.878324] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-26T17:46:55.878410] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUI took 36.8s. Estimated remaining: 4h 24m 28s. Rate: 7.6 symbols/min [2025-09-26T17:46:55.956724] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-26T17:46:56.731248] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:46:56.756685] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-26T17:46:57.239151] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T17:46:57.556748] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-26T17:46:57.782276] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T17:46:58.150271] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T17:46:58.356728] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-26T17:46:59.156740] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-26T17:46:59.290684] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:46:59.956775] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-26T17:47:00.756758] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-26T17:47:00.813280] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T17:47:01.178544] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T17:47:01.323381] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T17:47:01.556721] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-26T17:47:02.356753] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-26T17:47:03.156767] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-26T17:47:03.378166] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T17:47:03.650334] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:47:03.659583] [INFO ] [REMOTE ] BUR: Full fetch complete (63079 records). [2025-09-26T17:47:03.659778] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-26T17:47:03.660683] [FATAL] [VALIDATOR ] BUR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:47:03.660853] [FATAL] [MAIN ] BUR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:47:03.660929] [WARN ] [MAIN ] BUR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:47:03.660984] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-26T17:47:03.661060] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-26T17:47:03.661131] [INFO ] [LOCAL ] BUR: Starting deletion of derivative data. [2025-09-26T17:47:03.661727] [DEBUG] [LOCAL ] BUR: Deleted derivative data file. [2025-09-26T17:47:03.661833] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUR took 28.2s. Estimated remaining: 4h 24m 20s. Rate: 7.6 symbols/min [2025-09-26T17:47:03.956769] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-26T17:47:04.098799] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T17:47:04.756732] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-26T17:47:05.678390] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:47:05.692819] [INFO ] [REMOTE ] BURL: Full fetch complete (65694 records). [2025-09-26T17:47:05.693064] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-26T17:47:05.902105] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T17:47:05.977329] [INFO ] [REMOTE ] BUXX: Full fetch complete (20298 records). [2025-09-26T17:47:06.004706] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-26T17:47:06.341828] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-26T17:47:06.342017] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-26T17:47:06.343128] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-26T17:47:06.348740] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-26T17:47:06.440231] [DEBUG] [LOCAL ] BURL: Trimmed 65694 records to 46896 (keeping 200 days of data) [2025-09-26T17:47:06.758406] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-26T17:47:06.759442] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-26T17:47:06.760185] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-26T17:47:06.760594] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-26T17:47:06.764422] [DEBUG] [LOCAL ] BUXX: Trimmed 20298 records to 15364 (keeping 200 days of data) [2025-09-26T17:47:06.984176] [DEBUG] [LOCAL ] BUXX: Primary data saved (15364 records). [2025-09-26T17:47:06.984902] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-26T17:47:06.985365] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUXX took 28.5s. Estimated remaining: 4h 23m 47s. Rate: 7.6 symbols/min [2025-09-26T17:47:07.069063] [DEBUG] [LOCAL ] BURL: Primary data saved (46896 records). [2025-09-26T17:47:07.069270] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-26T17:47:07.072166] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 29.8s. Estimated remaining: 4h 22m 55s. Rate: 7.6 symbols/min [2025-09-26T17:47:07.829116] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:07.897824] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:07.950496] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:07.951464] [DEBUG] [LOCAL ] BVN: No existing data file found in primary storage. [2025-09-26T17:47:07.945372] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:07.951630] [WARN ] [MAIN ] BVN: No existing data found, performing full refresh instead. [2025-09-26T17:47:07.952329] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-26T17:47:07.952421] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-26T17:47:07.952546] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-09-26T17:47:07.952675] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-26T17:47:08.272235] [DEBUG] [LOCAL ] BW: Loaded 39935 existing records from primary storage. [2025-09-26T17:47:08.322826] [DEBUG] [LOCAL ] BV: Loaded 38782 existing records from primary storage. [2025-09-26T17:47:08.322096] [INFO ] [MAIN ] BW: Loaded 39935 existing records. [2025-09-26T17:47:08.339813] [INFO ] [MAIN ] BV: Loaded 38782 existing records. [2025-09-26T17:47:08.323491] [DEBUG] [LOCAL ] BWA: Loaded 52616 existing records from primary storage. [2025-09-26T17:47:08.407086] [INFO ] [MAIN ] BWA: Loaded 52616 existing records. [2025-09-26T17:47:08.786368] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:08.846223] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-26T17:47:09.044102] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:09.072687] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-26T17:47:09.072105] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:09.087959] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-26T17:47:09.094458] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:09.094751] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-26T17:47:09.094814] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-26T17:47:09.094943] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-26T17:47:09.095114] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-26T17:47:09.095237] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-26T17:47:09.107983] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-26T17:47:09.100455] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-26T17:47:09.113243] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-26T17:47:09.152432] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-26T17:47:09.220201] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-26T17:47:10.202206] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:10.234521] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-26T17:47:10.298902] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:10.303566] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-26T17:47:10.331091] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:10.331579] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-26T17:47:10.454427] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T17:47:10.464190] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-26T17:47:11.391962] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T17:47:11.399736] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-26T17:47:11.500775] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T17:47:11.509495] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-26T17:47:11.581370] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T17:47:11.591227] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-26T17:47:12.130466] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:47:12.141822] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-26T17:47:12.186769] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T17:47:12.400857] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T17:47:12.756764] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-26T17:47:13.263429] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T17:47:13.556769] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-26T17:47:13.619327] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T17:47:13.844933] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:47:14.356731] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-26T17:47:14.741680] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T17:47:15.156796] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-26T17:47:15.835950] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T17:47:15.956779] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-26T17:47:16.322136] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T17:47:16.756770] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-26T17:47:17.471927] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T17:47:17.556735] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-26T17:47:18.249774] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T17:47:18.356776] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-26T17:47:19.156755] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-26T17:47:19.322429] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:47:19.833095] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T17:47:19.956747] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-26T17:47:20.292264] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:47:20.756765] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-26T17:47:20.981729] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:47:21.556755] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-26T17:47:21.913290] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:47:22.356774] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-26T17:47:22.986208] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T17:47:23.156727] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-26T17:47:23.615186] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:47:23.956784] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-26T17:47:24.302185] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T17:47:24.756765] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-26T17:47:25.403355] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T17:47:25.556748] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-26T17:47:25.835488] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T17:47:26.356804] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-26T17:47:27.156733] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-26T17:47:27.204385] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T17:47:27.956724] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-26T17:47:28.030838] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T17:47:28.742307] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T17:47:28.750365] [INFO ] [REMOTE ] BV: Full fetch complete (53778 records). [2025-09-26T17:47:28.750481] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-26T17:47:28.765119] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-26T17:47:29.183915] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-26T17:47:29.184147] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-26T17:47:29.184876] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-26T17:47:29.184988] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-26T17:47:29.186715] [DEBUG] [LOCAL ] BV: Trimmed 53778 records to 39048 (keeping 200 days of data) [2025-09-26T17:47:29.309995] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:47:29.462931] [DEBUG] [LOCAL ] BV: Primary data saved (39048 records). [2025-09-26T17:47:29.463095] [INFO ] [MAIN ] BV: Full history saved. [2025-09-26T17:47:29.463187] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BV took 22.4s. Estimated remaining: 4h 24m 8s. Rate: 7.6 symbols/min [2025-09-26T17:47:29.565177] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-26T17:47:29.673672] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:29.688471] [DEBUG] [LOCAL ] BWG: Loaded 12430 existing records from primary storage. [2025-09-26T17:47:29.688616] [INFO ] [MAIN ] BWG: Loaded 12430 existing records. [2025-09-26T17:47:29.883596] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:29.883930] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-26T17:47:29.883982] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-26T17:47:29.884210] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-26T17:47:29.884271] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-26T17:47:30.301157] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:30.366316] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-26T17:47:30.388732] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:47:31.156747] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-26T17:47:31.269780] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:47:31.311932] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T17:47:31.956788] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-26T17:47:32.756765] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-26T17:47:32.817926] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:47:33.509192] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T17:47:33.556706] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-26T17:47:34.275804] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:47:34.356718] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-26T17:47:34.830295] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:47:34.840063] [INFO ] [REMOTE ] BVN: Full fetch complete (62771 records). [2025-09-26T17:47:34.840259] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-26T17:47:35.165728] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-26T17:47:35.339796] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-26T17:47:35.339911] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-26T17:47:35.340734] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-26T17:47:35.340843] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-26T17:47:35.342549] [DEBUG] [LOCAL ] BVN: Trimmed 62771 records to 44520 (keeping 200 days of data) [2025-09-26T17:47:35.645210] [DEBUG] [LOCAL ] BVN: Primary data saved (44520 records). [2025-09-26T17:47:35.645381] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-26T17:47:35.645545] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BVN took 28.6s. Estimated remaining: 4h 23m 51s. Rate: 7.6 symbols/min [2025-09-26T17:47:35.830556] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:35.862970] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T17:47:35.873694] [INFO ] [REMOTE ] BWA: Full fetch complete (75354 records). [2025-09-26T17:47:35.873879] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-26T17:47:35.874885] [FATAL] [VALIDATOR ] BWA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:47:35.874993] [FATAL] [MAIN ] BWA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:47:35.875053] [WARN ] [MAIN ] BWA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:47:35.875132] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-26T17:47:35.875204] [DEBUG] [LOCAL ] BWA: No primary data file found to delete. [2025-09-26T17:47:35.875257] [INFO ] [LOCAL ] BWA: Starting deletion of derivative data. [2025-09-26T17:47:35.875831] [DEBUG] [LOCAL ] BWA: Deleted derivative data file. [2025-09-26T17:47:35.876044] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BWA took 28.8s. Estimated remaining: 4h 23m 1s. Rate: 7.6 symbols/min [2025-09-26T17:47:35.961465] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-26T17:47:36.060270] [DEBUG] [LOCAL ] BWLP: Loaded 32989 existing records from primary storage. [2025-09-26T17:47:36.067633] [INFO ] [MAIN ] BWLP: Loaded 32989 existing records. [2025-09-26T17:47:36.091441] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:36.147709] [DEBUG] [LOCAL ] BWMX: No existing data file found in primary storage. [2025-09-26T17:47:36.164245] [WARN ] [MAIN ] BWMX: No existing data found, performing full refresh instead. [2025-09-26T17:47:36.202242] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-26T17:47:36.202540] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-26T17:47:36.203091] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-26T17:47:36.213797] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-26T17:47:36.337143] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:36.360714] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-26T17:47:36.379024] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-26T17:47:36.385010] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-26T17:47:36.404050] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-26T17:47:36.758067] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T17:47:36.857488] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:47:36.960134] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-26T17:47:37.146454] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:37.225289] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:37.556726] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-26T17:47:38.264085] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T17:47:38.356746] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-26T17:47:39.156740] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-26T17:47:39.275153] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T17:47:39.956706] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-26T17:47:39.996567] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T17:47:40.165380] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T17:47:40.748740] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T17:47:40.756696] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-26T17:47:41.556741] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-26T17:47:41.580946] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T17:47:42.356761] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-26T17:47:42.949287] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T17:47:43.156744] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-26T17:47:43.741439] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T17:47:43.905929] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:47:43.915712] [INFO ] [REMOTE ] BW: Full fetch complete (58753 records). [2025-09-26T17:47:43.915881] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-26T17:47:43.961836] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-26T17:47:44.326290] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-26T17:47:44.326401] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-26T17:47:44.327223] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-26T17:47:44.327291] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-26T17:47:44.328633] [DEBUG] [LOCAL ] BW: Trimmed 58753 records to 40297 (keeping 200 days of data) [2025-09-26T17:47:44.570761] [DEBUG] [LOCAL ] BW: Primary data saved (40297 records). [2025-09-26T17:47:44.570890] [INFO ] [MAIN ] BW: Full history saved. [2025-09-26T17:47:44.570990] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BW took 37.5s. Estimated remaining: 4h 22m 58s. Rate: 7.6 symbols/min [2025-09-26T17:47:44.752187] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:47:44.757324] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T17:47:44.757130] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-26T17:47:44.770102] [DEBUG] [LOCAL ] BWNB: Loaded 4463 existing records from primary storage. [2025-09-26T17:47:44.770208] [INFO ] [MAIN ] BWNB: Loaded 4463 existing records. [2025-09-26T17:47:44.950212] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:47:44.950464] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-26T17:47:44.950549] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-26T17:47:44.950763] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-26T17:47:44.950822] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-26T17:47:45.328880] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:47:45.556695] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-26T17:47:45.602041] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T17:47:46.356724] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-26T17:47:46.789092] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T17:47:46.790078] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T17:47:47.156748] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-26T17:47:47.956734] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-26T17:47:48.382167] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T17:47:48.384334] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T17:47:48.756743] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-26T17:47:49.104824] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T17:47:49.556718] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-26T17:47:50.356739] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-26T17:47:50.935390] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:47:50.979786] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T17:47:51.156776] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-26T17:47:51.925616] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T17:47:51.956700] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-26T17:47:52.480416] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T17:47:52.756737] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-26T17:47:53.161526] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T17:47:53.556746] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-26T17:47:54.356765] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-26T17:47:54.985461] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T17:47:55.051049] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:47:55.156761] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-26T17:47:55.517530] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T17:47:55.956734] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-26T17:47:56.756728] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-26T17:47:57.411556] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:47:57.556727] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-26T17:47:57.727158] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:47:58.356763] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-26T17:47:58.965058] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T17:47:58.985616] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T17:47:59.156746] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-26T17:47:59.956779] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-26T17:48:00.080194] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T17:48:00.474710] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T17:48:00.756751] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-26T17:48:01.336381] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T17:48:01.556773] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-26T17:48:02.356742] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-26T17:48:02.712752] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T17:48:03.156768] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-26T17:48:03.325560] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:48:03.327461] [INFO ] [REMOTE ] BWMX: Full fetch complete (10047 records). [2025-09-26T17:48:03.327536] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-26T17:48:03.719881] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-26T17:48:03.719964] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-26T17:48:03.720214] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-26T17:48:03.720254] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-26T17:48:03.720756] [DEBUG] [LOCAL ] BWMX: Trimmed 10047 records to 7676 (keeping 200 days of data) [2025-09-26T17:48:03.771590] [DEBUG] [LOCAL ] BWMX: Primary data saved (7676 records). [2025-09-26T17:48:03.771759] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-26T17:48:03.771859] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWMX took 27.9s. Estimated remaining: 4h 23m 52s. Rate: 7.6 symbols/min [2025-09-26T17:48:03.957431] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-26T17:48:03.957364] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:03.958983] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-09-26T17:48:03.959130] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-09-26T17:48:03.959318] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-26T17:48:03.959366] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-26T17:48:03.959412] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-26T17:48:03.959448] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-26T17:48:04.049410] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T17:48:04.404122] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:04.756710] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-26T17:48:04.827693] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T17:48:05.209586] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T17:48:05.556725] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-26T17:48:06.143664] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T17:48:06.356747] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-26T17:48:06.814309] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T17:48:07.156718] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-26T17:48:07.956703] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-26T17:48:08.225976] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:48:08.230290] [INFO ] [REMOTE ] BWG: Full fetch complete (17733 records). [2025-09-26T17:48:08.230402] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-26T17:48:08.491739] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T17:48:08.650881] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-26T17:48:08.650971] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-26T17:48:08.651387] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-26T17:48:08.651449] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-26T17:48:08.652307] [DEBUG] [LOCAL ] BWG: Trimmed 17733 records to 12478 (keeping 200 days of data) [2025-09-26T17:48:08.740747] [DEBUG] [LOCAL ] BWG: Primary data saved (12478 records). [2025-09-26T17:48:08.740909] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-26T17:48:08.741002] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWG took 39.3s. Estimated remaining: 4h 23m 28s. Rate: 7.6 symbols/min [2025-09-26T17:48:08.764090] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-26T17:48:08.932792] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:08.992759] [DEBUG] [LOCAL ] BWXT: Loaded 47108 existing records from primary storage. [2025-09-26T17:48:08.992919] [INFO ] [MAIN ] BWXT: Loaded 47108 existing records. [2025-09-26T17:48:09.179255] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:09.179502] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-26T17:48:09.179551] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-26T17:48:09.179816] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-26T17:48:09.179876] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-26T17:48:09.339871] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-26T17:48:09.560959] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:09.561067] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-26T17:48:10.038507] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-26T17:48:10.356728] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-26T17:48:11.156724] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-26T17:48:11.600198] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T17:48:11.606699] [INFO ] [REMOTE ] BWLP: Full fetch complete (48399 records). [2025-09-26T17:48:11.606835] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-26T17:48:11.785574] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T17:48:11.806174] [INFO ] [REMOTE ] BWNB: Full fetch complete (5720 records). [2025-09-26T17:48:11.814382] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-26T17:48:11.961050] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-26T17:48:12.271723] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-26T17:48:12.311040] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-26T17:48:12.346494] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-26T17:48:12.352726] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-26T17:48:12.400566] [DEBUG] [LOCAL ] BWLP: Trimmed 48399 records to 33185 (keeping 200 days of data) [2025-09-26T17:48:12.534315] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-26T17:48:12.534555] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-26T17:48:12.534793] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-26T17:48:12.534990] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-26T17:48:12.535571] [DEBUG] [LOCAL ] BWNB: Trimmed 5720 records to 4468 (keeping 200 days of data) [2025-09-26T17:48:12.601219] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T17:48:12.624122] [DEBUG] [LOCAL ] BWNB: Primary data saved (4468 records). [2025-09-26T17:48:12.625609] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-26T17:48:12.627072] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWNB took 28.1s. Estimated remaining: 4h 22m 58s. Rate: 7.6 symbols/min [2025-09-26T17:48:12.761982] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-26T17:48:12.829763] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:12.964333] [DEBUG] [LOCAL ] BX: Loaded 53887 existing records from primary storage. [2025-09-26T17:48:12.965381] [INFO ] [MAIN ] BX: Loaded 53887 existing records. [2025-09-26T17:48:13.140056] [DEBUG] [LOCAL ] BWLP: Primary data saved (33185 records). [2025-09-26T17:48:13.180182] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-26T17:48:13.185183] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWLP took 37.5s. Estimated remaining: 4h 22m 11s. Rate: 7.6 symbols/min [2025-09-26T17:48:13.184506] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:13.270330] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-26T17:48:13.288955] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-26T17:48:13.297159] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-26T17:48:13.318060] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T17:48:13.314859] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-26T17:48:13.495164] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:13.570473] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-26T17:48:13.709500] [DEBUG] [LOCAL ] BXC: Loaded 13822 existing records from primary storage. [2025-09-26T17:48:13.738271] [INFO ] [MAIN ] BXC: Loaded 13822 existing records. [2025-09-26T17:48:13.951726] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:14.030994] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:14.031337] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-26T17:48:14.031397] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-26T17:48:14.031630] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-26T17:48:14.031726] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-26T17:48:14.361891] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-26T17:48:14.430102] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:15.156725] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-26T17:48:15.193932] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T17:48:15.435831] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T17:48:15.812469] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T17:48:15.956743] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-26T17:48:16.756726] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-26T17:48:16.845118] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T17:48:17.556754] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-26T17:48:18.284974] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T17:48:18.356743] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-26T17:48:18.536139] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T17:48:18.740550] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T17:48:19.156794] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-26T17:48:19.776721] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T17:48:19.956745] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-26T17:48:20.554466] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T17:48:20.555829] [INFO ] [REMOTE ] BWSN: Full fetch complete (6138 records). [2025-09-26T17:48:20.555912] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-26T17:48:20.759583] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-26T17:48:20.975201] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-26T17:48:20.975293] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-26T17:48:20.975483] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-26T17:48:20.975524] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-26T17:48:20.975976] [DEBUG] [LOCAL ] BWSN: Trimmed 6138 records to 5130 (keeping 200 days of data) [2025-09-26T17:48:21.009346] [DEBUG] [LOCAL ] BWSN: Primary data saved (5130 records). [2025-09-26T17:48:21.009468] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-26T17:48:21.009542] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWSN took 17.2s. Estimated remaining: 4h 22m 3s. Rate: 7.6 symbols/min [2025-09-26T17:48:21.196537] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:21.252069] [DEBUG] [LOCAL ] BXMT: Loaded 47634 existing records from primary storage. [2025-09-26T17:48:21.252219] [INFO ] [MAIN ] BXMT: Loaded 47634 existing records. [2025-09-26T17:48:21.493442] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:21.493751] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-26T17:48:21.493807] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-26T17:48:21.494051] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-26T17:48:21.494109] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-26T17:48:21.561865] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-26T17:48:21.885070] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:22.294459] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T17:48:22.356688] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-26T17:48:23.010973] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:48:23.156783] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-26T17:48:23.634697] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T17:48:23.956770] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-26T17:48:24.716632] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T17:48:24.756776] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-26T17:48:25.556696] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-26T17:48:25.671508] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T17:48:26.356697] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-26T17:48:26.472569] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T17:48:26.941728] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T17:48:27.156780] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-26T17:48:27.676587] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:48:27.956729] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-26T17:48:28.396760] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T17:48:28.547790] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T17:48:28.756772] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-26T17:48:29.556736] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-26T17:48:30.356706] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-26T17:48:30.741090] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T17:48:31.011706] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T17:48:31.156788] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-26T17:48:31.520039] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T17:48:31.732566] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T17:48:31.956730] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-26T17:48:32.756729] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-26T17:48:33.399926] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T17:48:33.477484] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T17:48:33.556727] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-26T17:48:34.356761] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-26T17:48:35.000201] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T17:48:35.156770] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-26T17:48:35.678179] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T17:48:35.802383] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:48:35.956735] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-26T17:48:36.756773] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-26T17:48:37.556702] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-26T17:48:37.809918] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T17:48:38.198153] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T17:48:38.207557] [INFO ] [REMOTE ] BWXT: Full fetch complete (67370 records). [2025-09-26T17:48:38.207744] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-26T17:48:38.361325] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-26T17:48:38.631595] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-26T17:48:38.631715] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-26T17:48:38.632494] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-26T17:48:38.632541] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-26T17:48:38.634042] [DEBUG] [LOCAL ] BWXT: Trimmed 67370 records to 47442 (keeping 200 days of data) [2025-09-26T17:48:38.948826] [DEBUG] [LOCAL ] BWXT: Primary data saved (47442 records). [2025-09-26T17:48:38.948966] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-26T17:48:38.949114] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BWXT took 30.2s. Estimated remaining: 4h 22m 49s. Rate: 7.6 symbols/min [2025-09-26T17:48:39.134472] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:39.134763] [DEBUG] [LOCAL ] BXMX: No existing data file found in primary storage. [2025-09-26T17:48:39.134822] [WARN ] [MAIN ] BXMX: No existing data found, performing full refresh instead. [2025-09-26T17:48:39.134970] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-26T17:48:39.135017] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-26T17:48:39.135061] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-09-26T17:48:39.135096] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-26T17:48:39.168309] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-26T17:48:39.528584] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:39.617919] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T17:48:39.956738] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-26T17:48:40.010611] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T17:48:40.237898] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T17:48:40.756733] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-26T17:48:41.175820] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T17:48:41.556738] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-26T17:48:41.711864] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T17:48:42.356732] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-26T17:48:43.070727] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T17:48:43.121218] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T17:48:43.156747] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-26T17:48:43.956739] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-26T17:48:44.735146] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T17:48:44.756676] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-26T17:48:45.556719] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-26T17:48:45.978005] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T17:48:46.020377] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T17:48:46.120251] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T17:48:46.356725] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-26T17:48:47.156709] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-26T17:48:47.412195] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T17:48:47.877983] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T17:48:47.881022] [INFO ] [REMOTE ] BXC: Full fetch complete (17819 records). [2025-09-26T17:48:47.881106] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-26T17:48:47.961886] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-26T17:48:48.276367] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-26T17:48:48.276504] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-26T17:48:48.276893] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-26T17:48:48.276958] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-26T17:48:48.277614] [DEBUG] [LOCAL ] BXC: Trimmed 17819 records to 13880 (keeping 200 days of data) [2025-09-26T17:48:48.363884] [DEBUG] [LOCAL ] BXC: Primary data saved (13880 records). [2025-09-26T17:48:48.364035] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-26T17:48:48.364130] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BXC took 35.2s. Estimated remaining: 4h 22m 50s. Rate: 7.6 symbols/min [2025-09-26T17:48:48.555094] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:48.605447] [DEBUG] [LOCAL ] BXP: Loaded 50191 existing records from primary storage. [2025-09-26T17:48:48.605662] [INFO ] [MAIN ] BXP: Loaded 50191 existing records. [2025-09-26T17:48:48.766411] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-26T17:48:48.804776] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:48:48.805175] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-26T17:48:48.805237] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-26T17:48:48.805493] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-26T17:48:48.805554] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-26T17:48:49.179565] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:49.556745] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-26T17:48:49.844611] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T17:48:49.854976] [INFO ] [REMOTE ] BXMT: Full fetch complete (69555 records). [2025-09-26T17:48:49.855137] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-26T17:48:50.288449] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-26T17:48:50.288561] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-26T17:48:50.289333] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-26T17:48:50.289411] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-26T17:48:50.291021] [DEBUG] [LOCAL ] BXMT: Trimmed 69555 records to 47994 (keeping 200 days of data) [2025-09-26T17:48:50.357214] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-26T17:48:50.602175] [DEBUG] [LOCAL ] BXMT: Primary data saved (47994 records). [2025-09-26T17:48:50.602324] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-26T17:48:50.603418] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BXMT took 29.6s. Estimated remaining: 4h 22m 12s. Rate: 7.6 symbols/min [2025-09-26T17:48:50.793486] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:48:50.794146] [DEBUG] [LOCAL ] BXSL: No existing data file found in primary storage. [2025-09-26T17:48:50.794476] [WARN ] [MAIN ] BXSL: No existing data found, performing full refresh instead. [2025-09-26T17:48:50.810084] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-26T17:48:50.810238] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-26T17:48:50.810008] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T17:48:50.810566] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-09-26T17:48:50.816514] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-26T17:48:51.016749] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-26T17:48:51.159678] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-26T17:48:51.281016] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:48:51.776830] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T17:48:51.956794] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-26T17:48:52.756690] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-26T17:48:52.889808] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T17:48:53.556701] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-26T17:48:53.661921] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T17:48:53.697034] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T17:48:54.356804] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-26T17:48:55.156698] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-26T17:48:55.240068] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T17:48:55.943170] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:48:55.956687] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-26T17:48:56.238223] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T17:48:56.756723] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-26T17:48:57.279638] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T17:48:57.556736] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-26T17:48:58.356701] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-26T17:48:58.544121] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T17:48:58.704726] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T17:48:59.156726] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-26T17:48:59.492547] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T17:48:59.956732] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-26T17:49:00.756749] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-26T17:49:00.992106] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T17:49:01.556758] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-26T17:49:01.946061] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T17:49:02.158629] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-26T17:49:02.169915] [INFO ] [REMOTE ] BX: Full fetch complete (77402 records). [2025-09-26T17:49:02.170157] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-26T17:49:02.356945] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-26T17:49:02.609589] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-26T17:49:02.609787] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-26T17:49:02.610777] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-26T17:49:02.610847] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-26T17:49:02.612546] [DEBUG] [LOCAL ] BX: Trimmed 77402 records to 54270 (keeping 200 days of data) [2025-09-26T17:49:02.988185] [DEBUG] [LOCAL ] BX: Primary data saved (54270 records). [2025-09-26T17:49:02.988510] [INFO ] [MAIN ] BX: Full history saved. [2025-09-26T17:49:02.988760] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BX took 50.4s. Estimated remaining: 4h 22m 28s. Rate: 7.6 symbols/min [2025-09-26T17:49:03.162434] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-26T17:49:03.201276] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:03.215105] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T17:49:03.247392] [DEBUG] [LOCAL ] BY: Loaded 21748 existing records from primary storage. [2025-09-26T17:49:03.247543] [INFO ] [MAIN ] BY: Loaded 21748 existing records. [2025-09-26T17:49:03.449314] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:03.451222] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T17:49:03.455875] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-26T17:49:03.456157] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-26T17:49:03.456328] [INFO ] [REMOTE ] BXMX: Full fetch complete (28801 records). [2025-09-26T17:49:03.456479] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-26T17:49:03.483685] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-26T17:49:03.538616] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-26T17:49:03.977338] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-26T17:49:04.274091] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-26T17:49:04.279734] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-26T17:49:04.280273] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-26T17:49:04.280364] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-26T17:49:04.311775] [DEBUG] [LOCAL ] BXMX: Trimmed 28801 records to 19855 (keeping 200 days of data) [2025-09-26T17:49:04.315379] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:04.447783] [DEBUG] [LOCAL ] BXMX: Primary data saved (19855 records). [2025-09-26T17:49:04.447958] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-26T17:49:04.448046] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 25.5s. Estimated remaining: 4h 21m 46s. Rate: 7.6 symbols/min [2025-09-26T17:49:04.635876] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:04.671310] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:49:04.718422] [DEBUG] [LOCAL ] BYD: Loaded 45502 existing records from primary storage. [2025-09-26T17:49:04.718608] [INFO ] [MAIN ] BYD: Loaded 45502 existing records. [2025-09-26T17:49:04.762590] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-26T17:49:04.911662] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:04.911919] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-26T17:49:04.911968] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-26T17:49:04.912314] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-26T17:49:04.912374] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-26T17:49:05.291094] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:05.556728] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-26T17:49:05.895952] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T17:49:06.243728] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-26T17:49:06.356746] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-26T17:49:07.156735] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-26T17:49:07.630375] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T17:49:07.702514] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T17:49:07.956756] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-26T17:49:08.339115] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T17:49:08.756743] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-26T17:49:09.556753] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-26T17:49:09.667066] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T17:49:10.128039] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T17:49:10.356726] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-26T17:49:11.156713] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-26T17:49:11.211762] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T17:49:11.690089] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T17:49:11.956752] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-26T17:49:12.354339] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:49:12.756780] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-26T17:49:13.556713] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-26T17:49:13.711101] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T17:49:14.220949] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T17:49:14.356710] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-26T17:49:14.576258] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T17:49:15.156733] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-26T17:49:15.956723] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-26T17:49:16.195701] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T17:49:16.467456] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T17:49:16.756724] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-26T17:49:16.856902] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T17:49:17.556742] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-26T17:49:18.178480] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T17:49:18.356785] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-26T17:49:19.088625] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:49:19.156746] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-26T17:49:19.557616] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T17:49:19.956744] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-26T17:49:20.563186] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:49:20.756748] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-26T17:49:21.556729] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-26T17:49:21.827847] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T17:49:22.303246] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T17:49:22.313522] [INFO ] [REMOTE ] BXP: Full fetch complete (71321 records). [2025-09-26T17:49:22.313692] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-26T17:49:22.361925] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-26T17:49:22.737730] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-26T17:49:22.737827] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-26T17:49:22.738603] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-26T17:49:22.738674] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-26T17:49:22.740300] [DEBUG] [LOCAL ] BXP: Trimmed 71321 records to 50577 (keeping 200 days of data) [2025-09-26T17:49:23.069149] [DEBUG] [LOCAL ] BXP: Primary data saved (50577 records). [2025-09-26T17:49:23.069292] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-26T17:49:23.069384] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXP took 34.7s. Estimated remaining: 4h 22m 35s. Rate: 7.6 symbols/min [2025-09-26T17:49:23.160260] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-26T17:49:23.267938] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:23.268247] [DEBUG] [LOCAL ] BYM: No existing data file found in primary storage. [2025-09-26T17:49:23.278491] [WARN ] [MAIN ] BYM: No existing data found, performing full refresh instead. [2025-09-26T17:49:23.307071] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-26T17:49:23.311352] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T17:49:23.311950] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-26T17:49:23.314189] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T17:49:23.314410] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-09-26T17:49:23.329856] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-26T17:49:23.380052] [INFO ] [REMOTE ] BXSL: Full fetch complete (69328 records). [2025-09-26T17:49:23.403732] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-26T17:49:23.957681] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-26T17:49:24.099311] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:24.197077] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-26T17:49:24.197234] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-26T17:49:24.198396] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-26T17:49:24.198468] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-26T17:49:24.200351] [DEBUG] [LOCAL ] BXSL: Trimmed 69328 records to 48276 (keeping 200 days of data) [2025-09-26T17:49:24.469791] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:49:24.545140] [DEBUG] [LOCAL ] BXSL: Primary data saved (48276 records). [2025-09-26T17:49:24.545282] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-26T17:49:24.545363] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXSL took 33.9s. Estimated remaining: 4h 21m 53s. Rate: 7.6 symbols/min [2025-09-26T17:49:24.734267] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:24.756741] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-26T17:49:24.770851] [DEBUG] [LOCAL ] BZH: Loaded 32872 existing records from primary storage. [2025-09-26T17:49:24.771042] [INFO ] [MAIN ] BZH: Loaded 32872 existing records. [2025-09-26T17:49:24.970371] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:24.970625] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-26T17:49:24.970704] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-26T17:49:24.970967] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-26T17:49:24.971026] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-26T17:49:25.364502] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:25.380615] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T17:49:25.556701] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-26T17:49:25.861541] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T17:49:26.356731] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-26T17:49:26.900151] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T17:49:27.026676] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T17:49:27.156740] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-26T17:49:27.922433] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T17:49:27.956717] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-26T17:49:28.756782] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-26T17:49:28.787442] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T17:49:29.556724] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-26T17:49:29.691331] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:49:30.356686] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-26T17:49:30.676539] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T17:49:30.820398] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T17:49:31.156766] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-26T17:49:31.840755] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T17:49:31.956757] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-26T17:49:32.756746] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-26T17:49:33.556763] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-26T17:49:33.828245] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T17:49:33.838252] [INFO ] [REMOTE ] BYD: Full fetch complete (64906 records). [2025-09-26T17:49:33.838404] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-26T17:49:34.251672] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-26T17:49:34.252101] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-26T17:49:34.252906] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-26T17:49:34.253019] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-26T17:49:34.277960] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T17:49:34.276839] [DEBUG] [LOCAL ] BYD: Trimmed 64906 records to 45804 (keeping 200 days of data) [2025-09-26T17:49:34.381985] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-26T17:49:34.401691] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T17:49:34.613595] [DEBUG] [LOCAL ] BYD: Primary data saved (45804 records). [2025-09-26T17:49:34.613757] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-26T17:49:34.613853] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BYD took 30.2s. Estimated remaining: 4h 21m 57s. Rate: 7.6 symbols/min [2025-09-26T17:49:34.793473] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:34.793699] [DEBUG] [LOCAL ] C: No existing data file found in primary storage. [2025-09-26T17:49:34.793755] [WARN ] [MAIN ] C: No existing data found, performing full refresh instead. [2025-09-26T17:49:34.793961] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-26T17:49:34.794018] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-26T17:49:34.794065] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-09-26T17:49:34.794103] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-26T17:49:35.185837] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-26T17:49:35.195149] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:35.208911] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T17:49:35.956755] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-26T17:49:36.271523] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:49:36.756772] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-26T17:49:36.836957] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T17:49:36.841919] [INFO ] [REMOTE ] BY: Full fetch complete (29295 records). [2025-09-26T17:49:36.842069] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-26T17:49:37.283638] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-26T17:49:37.283753] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-26T17:49:37.284188] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-26T17:49:37.284232] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-26T17:49:37.285023] [DEBUG] [LOCAL ] BY: Trimmed 29295 records to 21895 (keeping 200 days of data) [2025-09-26T17:49:37.389273] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T17:49:37.440446] [DEBUG] [LOCAL ] BY: Primary data saved (21895 records). [2025-09-26T17:49:37.440588] [INFO ] [MAIN ] BY: Full history saved. [2025-09-26T17:49:37.440704] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BY took 34.5s. Estimated remaining: 4h 21m 22s. Rate: 7.6 symbols/min [2025-09-26T17:49:37.561808] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-26T17:49:37.622838] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:37.622993] [DEBUG] [LOCAL ] CAAP: No existing data file found in primary storage. [2025-09-26T17:49:37.623031] [WARN ] [MAIN ] CAAP: No existing data found, performing full refresh instead. [2025-09-26T17:49:37.623177] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-26T17:49:37.623221] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-26T17:49:37.623264] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-09-26T17:49:37.623297] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-26T17:49:38.002408] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:38.356732] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-26T17:49:38.763402] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T17:49:39.156185] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T17:49:39.158082] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-26T17:49:39.956757] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-26T17:49:40.239547] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T17:49:40.575259] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T17:49:40.756732] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-26T17:49:41.556748] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-26T17:49:42.356688] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-26T17:49:42.759569] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-26T17:49:42.808861] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T17:49:42.834806] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-26T17:49:43.156734] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-26T17:49:43.675575] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-26T17:49:43.956751] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-26T17:49:44.756752] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-26T17:49:45.496818] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T17:49:45.556740] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-26T17:49:45.802793] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T17:49:46.356746] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-26T17:49:46.571811] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T17:49:47.156739] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-26T17:49:47.956713] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-26T17:49:48.007750] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T17:49:48.010634] [INFO ] [REMOTE ] BYM: Full fetch complete (18008 records). [2025-09-26T17:49:48.010737] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-26T17:49:48.415234] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-26T17:49:48.415370] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-26T17:49:48.415908] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-26T17:49:48.416068] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-26T17:49:48.417323] [DEBUG] [LOCAL ] BYM: Trimmed 18008 records to 12225 (keeping 200 days of data) [2025-09-26T17:49:48.508780] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-26T17:49:48.543316] [DEBUG] [LOCAL ] BYM: Primary data saved (12225 records). [2025-09-26T17:49:48.543488] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-26T17:49:48.543575] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYM took 25.5s. Estimated remaining: 4h 21m 31s. Rate: 7.6 symbols/min [2025-09-26T17:49:48.728145] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:48.748333] [DEBUG] [LOCAL ] CABO: Loaded 17466 existing records from primary storage. [2025-09-26T17:49:48.748497] [INFO ] [MAIN ] CABO: Loaded 17466 existing records. [2025-09-26T17:49:48.761886] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-26T17:49:48.965497] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:48.966336] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-26T17:49:48.966425] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-26T17:49:48.966895] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-26T17:49:48.966964] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-26T17:49:49.315290] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T17:49:49.446380] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:49.559180] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-26T17:49:49.564449] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T17:49:50.356740] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-26T17:49:51.156772] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-26T17:49:51.409804] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T17:49:51.730893] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T17:49:51.956750] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-26T17:49:52.306032] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T17:49:52.312849] [INFO ] [REMOTE ] BZH: Full fetch complete (46994 records). [2025-09-26T17:49:52.313052] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-26T17:49:52.707799] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-26T17:49:52.707881] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-26T17:49:52.708422] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-26T17:49:52.708481] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-26T17:49:52.709549] [DEBUG] [LOCAL ] BZH: Trimmed 46994 records to 33088 (keeping 200 days of data) [2025-09-26T17:49:52.771327] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-26T17:49:52.932268] [DEBUG] [LOCAL ] BZH: Primary data saved (33088 records). [2025-09-26T17:49:52.932475] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-26T17:49:52.935107] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BZH took 28.4s. Estimated remaining: 4h 21m 5s. Rate: 7.6 symbols/min [2025-09-26T17:49:53.115047] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:49:53.147403] [DEBUG] [LOCAL ] CACI: Loaded 25258 existing records from primary storage. [2025-09-26T17:49:53.147575] [INFO ] [MAIN ] CACI: Loaded 25258 existing records. [2025-09-26T17:49:53.334378] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:49:53.334702] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-26T17:49:53.334763] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-26T17:49:53.335551] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-26T17:49:53.335690] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-26T17:49:53.568123] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-26T17:49:53.740100] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:49:53.856938] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:49:53.922043] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T17:49:54.279230] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T17:49:54.356745] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-26T17:49:55.156694] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-26T17:49:55.246318] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T17:49:55.956734] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-26T17:49:56.093128] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T17:49:56.544806] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T17:49:56.756742] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-26T17:49:57.556725] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-26T17:49:57.759701] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T17:49:58.104056] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T17:49:58.356773] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-26T17:49:59.002833] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T17:49:59.156736] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-26T17:49:59.956773] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-26T17:50:00.231928] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T17:50:00.756717] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-26T17:50:01.556746] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-26T17:50:02.027394] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T17:50:02.356728] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-26T17:50:02.425784] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T17:50:02.523816] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-26T17:50:02.950144] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T17:50:03.156744] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-26T17:50:03.956723] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-26T17:50:04.318370] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T17:50:04.756750] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-26T17:50:05.556741] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-26T17:50:06.011295] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T17:50:06.067298] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:50:06.356729] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-26T17:50:06.430247] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T17:50:07.156733] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-26T17:50:07.877061] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T17:50:07.956743] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-26T17:50:08.756734] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-26T17:50:09.132075] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T17:50:09.556723] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-26T17:50:09.606042] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-26T17:50:10.356706] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-26T17:50:10.388783] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T17:50:10.597024] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T17:50:11.156728] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-26T17:50:11.695002] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T17:50:11.701118] [INFO ] [REMOTE ] CAAP: Full fetch complete (27852 records). [2025-09-26T17:50:11.701263] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-26T17:50:11.961816] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-26T17:50:12.146004] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-26T17:50:12.146177] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-26T17:50:12.146724] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-26T17:50:12.146810] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-26T17:50:12.148012] [DEBUG] [LOCAL ] CAAP: Trimmed 27852 records to 20021 (keeping 200 days of data) [2025-09-26T17:50:12.165696] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T17:50:12.287366] [DEBUG] [LOCAL ] CAAP: Primary data saved (20021 records). [2025-09-26T17:50:12.287494] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-26T17:50:12.287570] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. CAAP took 34.8s. Estimated remaining: 4h 21m 57s. Rate: 7.6 symbols/min [2025-09-26T17:50:12.461903] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:12.509369] [DEBUG] [LOCAL ] CADE: Loaded 49165 existing records from primary storage. [2025-09-26T17:50:12.509548] [INFO ] [MAIN ] CADE: Loaded 49165 existing records. [2025-09-26T17:50:12.696290] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:12.696838] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-26T17:50:12.696946] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-26T17:50:12.704493] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-26T17:50:12.705397] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-26T17:50:12.705114] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-26T17:50:12.776752] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-26T17:50:12.776923] [INFO ] [REMOTE ] CABO: Full fetch complete (23043 records). [2025-09-26T17:50:12.782404] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-26T17:50:13.487746] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-26T17:50:13.493168] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-26T17:50:13.493104] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:13.493798] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-26T17:50:13.493862] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-26T17:50:13.494507] [DEBUG] [LOCAL ] CABO: Trimmed 23043 records to 17549 (keeping 200 days of data) [2025-09-26T17:50:13.571840] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-26T17:50:13.604892] [DEBUG] [LOCAL ] CABO: Primary data saved (17549 records). [2025-09-26T17:50:13.605027] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-26T17:50:13.605114] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CABO took 25.1s. Estimated remaining: 4h 21m 15s. Rate: 7.6 symbols/min [2025-09-26T17:50:13.787083] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:13.823521] [DEBUG] [LOCAL ] CAE: Loaded 39345 existing records from primary storage. [2025-09-26T17:50:13.823691] [INFO ] [MAIN ] CAE: Loaded 39345 existing records. [2025-09-26T17:50:14.021679] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:14.021934] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-26T17:50:14.021985] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-26T17:50:14.022233] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-26T17:50:14.022292] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-26T17:50:14.369431] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-26T17:50:14.419815] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:14.652863] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T17:50:15.007522] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-26T17:50:15.156720] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-26T17:50:15.956694] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-26T17:50:16.130496] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T17:50:16.314129] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T17:50:16.716760] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T17:50:16.756787] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-26T17:50:17.556791] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-26T17:50:18.093480] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:50:18.356743] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-26T17:50:19.156731] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-26T17:50:19.671738] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-26T17:50:19.683058] [INFO ] [REMOTE ] C: Full fetch complete (77785 records). [2025-09-26T17:50:19.683221] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-26T17:50:19.972623] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-26T17:50:19.979281] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T17:50:20.164922] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-26T17:50:20.165037] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-26T17:50:20.165923] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-26T17:50:20.165995] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-26T17:50:20.167720] [DEBUG] [LOCAL ] C: Trimmed 77785 records to 54521 (keeping 200 days of data) [2025-09-26T17:50:20.432479] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T17:50:20.559509] [DEBUG] [LOCAL ] C: Primary data saved (54521 records). [2025-09-26T17:50:20.559691] [INFO ] [MAIN ] C: Full history saved. [2025-09-26T17:50:20.559846] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. C took 45.9s. Estimated remaining: 4h 21m 3s. Rate: 7.6 symbols/min [2025-09-26T17:50:20.744928] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:20.751475] [DEBUG] [LOCAL ] CAF: Loaded 3458 existing records from primary storage. [2025-09-26T17:50:20.751599] [INFO ] [MAIN ] CAF: Loaded 3458 existing records. [2025-09-26T17:50:20.763229] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-26T17:50:20.952783] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:20.953111] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-26T17:50:20.953162] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-26T17:50:20.953416] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-26T17:50:20.953476] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-26T17:50:21.361925] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:21.375409] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T17:50:21.556750] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-26T17:50:21.573417] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T17:50:21.577778] [INFO ] [REMOTE ] CACI: Full fetch complete (39120 records). [2025-09-26T17:50:21.577895] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-26T17:50:21.975437] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-26T17:50:21.975536] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-26T17:50:21.976066] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-26T17:50:21.976133] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-26T17:50:21.977330] [DEBUG] [LOCAL ] CACI: Trimmed 39120 records to 25384 (keeping 200 days of data) [2025-09-26T17:50:22.143010] [DEBUG] [LOCAL ] CACI: Primary data saved (25384 records). [2025-09-26T17:50:22.143155] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-26T17:50:22.143247] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CACI took 29.2s. Estimated remaining: 4h 20m 22s. Rate: 7.6 symbols/min [2025-09-26T17:50:22.329419] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:22.360338] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-26T17:50:22.367741] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T17:50:22.391150] [DEBUG] [LOCAL ] CAG: Loaded 54049 existing records from primary storage. [2025-09-26T17:50:22.391309] [INFO ] [MAIN ] CAG: Loaded 54049 existing records. [2025-09-26T17:50:22.584828] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:22.585129] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-26T17:50:22.585192] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-26T17:50:22.585503] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-26T17:50:22.585564] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-26T17:50:22.994198] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:23.156754] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-26T17:50:23.788497] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T17:50:23.819978] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T17:50:23.956778] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-26T17:50:24.756800] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-26T17:50:25.462971] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T17:50:25.556723] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-26T17:50:26.167679] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T17:50:26.285540] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T17:50:26.356766] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-26T17:50:27.156745] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-26T17:50:27.754619] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T17:50:27.925250] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T17:50:27.956778] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-26T17:50:28.632451] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T17:50:28.756752] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-26T17:50:29.556727] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-26T17:50:30.356733] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-26T17:50:30.513315] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T17:50:31.156784] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-26T17:50:31.275397] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T17:50:31.818801] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T17:50:31.818976] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T17:50:31.956774] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-26T17:50:32.756741] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-26T17:50:33.243983] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-26T17:50:33.556700] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-26T17:50:33.661196] [DEBUG] [REMOTE ] CADE: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-26T17:50:33.661531] [WARN ] [REMOTE ] CADE: No data returned for month 2025-03 [2025-09-26T17:50:33.708899] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T17:50:34.356771] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-26T17:50:35.156750] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-26T17:50:35.886807] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:50:35.956763] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-26T17:50:36.725587] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:50:36.756764] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-26T17:50:37.126515] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T17:50:37.556743] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-26T17:50:38.356713] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-26T17:50:38.408043] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T17:50:38.948994] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T17:50:39.156694] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-26T17:50:39.338364] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T17:50:39.491036] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-26T17:50:39.956777] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-26T17:50:40.610391] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T17:50:40.612128] [INFO ] [REMOTE ] CAF: Full fetch complete (5635 records). [2025-09-26T17:50:40.612233] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-26T17:50:40.767686] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-26T17:50:41.001938] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-26T17:50:41.002034] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-26T17:50:41.002207] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-26T17:50:41.002307] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-26T17:50:41.002997] [DEBUG] [LOCAL ] CAF: Trimmed 5635 records to 3471 (keeping 200 days of data) [2025-09-26T17:50:41.026590] [DEBUG] [LOCAL ] CAF: Primary data saved (3471 records). [2025-09-26T17:50:41.026761] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-26T17:50:41.026945] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 20.5s. Estimated remaining: 4h 21m 11s. Rate: 7.6 symbols/min [2025-09-26T17:50:41.203269] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:41.286710] [DEBUG] [LOCAL ] CAH: Loaded 51826 existing records from primary storage. [2025-09-26T17:50:41.286914] [INFO ] [MAIN ] CAH: Loaded 51826 existing records. [2025-09-26T17:50:41.488398] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:41.488710] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-26T17:50:41.488780] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-26T17:50:41.489174] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-26T17:50:41.489247] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-26T17:50:41.561981] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-26T17:50:41.866353] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:42.356744] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-26T17:50:42.682149] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T17:50:42.826184] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T17:50:42.834183] [INFO ] [REMOTE ] CAE: Full fetch complete (55743 records). [2025-09-26T17:50:42.834351] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-26T17:50:43.161879] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-26T17:50:43.252844] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-26T17:50:43.252982] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-26T17:50:43.253697] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-26T17:50:43.253773] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-26T17:50:43.256108] [DEBUG] [LOCAL ] CAE: Trimmed 55743 records to 39622 (keeping 200 days of data) [2025-09-26T17:50:43.507556] [DEBUG] [LOCAL ] CAE: Primary data saved (39622 records). [2025-09-26T17:50:43.507768] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-26T17:50:43.507896] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CAE took 29.9s. Estimated remaining: 4h 20m 35s. Rate: 7.6 symbols/min [2025-09-26T17:50:43.695502] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:43.746827] [DEBUG] [LOCAL ] CAL: Loaded 43552 existing records from primary storage. [2025-09-26T17:50:43.746984] [INFO ] [MAIN ] CAL: Loaded 43552 existing records. [2025-09-26T17:50:43.946351] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:43.946994] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-26T17:50:43.947183] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-26T17:50:43.947588] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-26T17:50:43.947700] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-26T17:50:43.961980] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-26T17:50:44.282469] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T17:50:44.420090] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:44.756732] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-26T17:50:45.133733] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-26T17:50:45.556717] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-26T17:50:45.871771] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T17:50:46.090637] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T17:50:46.356785] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-26T17:50:47.156773] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-26T17:50:47.726734] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-26T17:50:47.956719] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-26T17:50:48.005498] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T17:50:48.390900] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T17:50:48.756766] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-26T17:50:49.500941] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T17:50:49.556729] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-26T17:50:50.356738] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-26T17:50:50.505560] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T17:50:51.156774] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-26T17:50:51.455327] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T17:50:51.469330] [INFO ] [REMOTE ] CAG: Full fetch complete (77650 records). [2025-09-26T17:50:51.469762] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-26T17:50:51.932004] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-26T17:50:51.932142] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-26T17:50:51.932996] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-26T17:50:51.933092] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-26T17:50:51.948824] [DEBUG] [LOCAL ] CAG: Trimmed 77650 records to 54439 (keeping 200 days of data) [2025-09-26T17:50:51.966259] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-26T17:50:51.972994] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T17:50:52.337143] [DEBUG] [LOCAL ] CAG: Primary data saved (54439 records). [2025-09-26T17:50:52.337317] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-26T17:50:52.338446] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CAG took 30.2s. Estimated remaining: 4h 20m 32s. Rate: 7.6 symbols/min [2025-09-26T17:50:52.570395] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:50:52.647350] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T17:50:52.645574] [DEBUG] [LOCAL ] CALX: Loaded 38755 existing records from primary storage. [2025-09-26T17:50:52.658670] [INFO ] [MAIN ] CALX: Loaded 38755 existing records. [2025-09-26T17:50:52.761846] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-26T17:50:52.870683] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:50:52.870992] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-26T17:50:52.871052] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-26T17:50:52.871343] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-26T17:50:52.871412] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-26T17:50:53.292484] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:50:53.316578] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T17:50:53.556721] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-26T17:50:54.242697] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T17:50:54.356737] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-26T17:50:54.607380] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T17:50:55.156780] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-26T17:50:55.453344] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T17:50:55.956771] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-26T17:50:56.756769] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-26T17:50:56.883183] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T17:50:57.119138] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T17:50:57.556802] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-26T17:50:57.691566] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T17:50:58.356807] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-26T17:50:58.771612] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T17:50:59.156826] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-26T17:50:59.401088] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:50:59.956796] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-26T17:51:00.756771] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-26T17:51:00.793132] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T17:51:01.567622] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-26T17:51:01.587574] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T17:51:01.601030] [INFO ] [REMOTE ] CADE: Full fetch complete (62799 records). [2025-09-26T17:51:01.601252] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-26T17:51:01.835543] [WARN ] [VALIDATOR ] CADE: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T17:51:01.836577] [FATAL] [MAIN ] CADE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:51:01.836691] [WARN ] [MAIN ] CADE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:51:01.836775] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-26T17:51:01.836929] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-26T17:51:01.836994] [INFO ] [LOCAL ] CADE: Starting deletion of derivative data. [2025-09-26T17:51:01.837785] [DEBUG] [LOCAL ] CADE: Deleted derivative data file. [2025-09-26T17:51:01.838310] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CADE took 49.6s. Estimated remaining: 4h 20m 33s. Rate: 7.6 symbols/min [2025-09-26T17:51:02.048334] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:02.081472] [DEBUG] [LOCAL ] CANG: Loaded 26949 existing records from primary storage. [2025-09-26T17:51:02.081709] [INFO ] [MAIN ] CANG: Loaded 26949 existing records. [2025-09-26T17:51:02.285299] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:02.285757] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-26T17:51:02.285992] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-26T17:51:02.286344] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-26T17:51:02.286481] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-26T17:51:02.364901] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-26T17:51:02.741210] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T17:51:02.775892] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:02.809783] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T17:51:03.156735] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-26T17:51:03.942369] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T17:51:03.956919] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-26T17:51:04.713472] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T17:51:04.756686] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-26T17:51:05.160167] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T17:51:05.556764] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-26T17:51:06.161493] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T17:51:06.356742] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-26T17:51:06.678834] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T17:51:07.156769] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-26T17:51:07.691534] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T17:51:07.956750] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-26T17:51:08.650331] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:51:08.756722] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-26T17:51:08.911867] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T17:51:09.556729] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-26T17:51:10.011127] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T17:51:10.357189] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-26T17:51:10.359741] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T17:51:11.156746] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-26T17:51:11.823193] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T17:51:11.956757] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-26T17:51:12.411243] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T17:51:12.756830] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-26T17:51:13.544201] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T17:51:13.556685] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-26T17:51:13.609454] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T17:51:14.356797] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-26T17:51:15.156849] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-26T17:51:15.730996] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-26T17:51:15.740419] [INFO ] [REMOTE ] CAL: Full fetch complete (61813 records). [2025-09-26T17:51:15.740570] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-26T17:51:15.957214] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-26T17:51:16.184562] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-26T17:51:16.184878] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-26T17:51:16.185801] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-26T17:51:16.185920] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-26T17:51:16.207545] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T17:51:16.215507] [DEBUG] [LOCAL ] CAL: Trimmed 61813 records to 43833 (keeping 200 days of data) [2025-09-26T17:51:16.346035] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T17:51:16.360363] [INFO ] [REMOTE ] CAH: Full fetch complete (74596 records). [2025-09-26T17:51:16.362043] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-26T17:51:16.762209] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-26T17:51:16.851102] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-26T17:51:16.851835] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-26T17:51:16.852768] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-26T17:51:16.852942] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-26T17:51:16.858036] [DEBUG] [LOCAL ] CAH: Trimmed 74596 records to 52209 (keeping 200 days of data) [2025-09-26T17:51:17.194204] [DEBUG] [LOCAL ] CAL: Primary data saved (43833 records). [2025-09-26T17:51:17.197759] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-26T17:51:17.198233] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAL took 33.7s. Estimated remaining: 4h 21m 3s. Rate: 7.6 symbols/min [2025-09-26T17:51:17.530141] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:17.551331] [DEBUG] [LOCAL ] CAPL: Loaded 5904 existing records from primary storage. [2025-09-26T17:51:17.552436] [INFO ] [MAIN ] CAPL: Loaded 5904 existing records. [2025-09-26T17:51:17.986349] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:17.999686] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T17:51:18.000210] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-26T17:51:18.012919] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-26T17:51:18.013691] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-26T17:51:18.013758] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-26T17:51:18.034626] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-26T17:51:18.424389] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T17:51:18.516403] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-26T17:51:18.524257] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:18.531863] [DEBUG] [LOCAL ] CAH: Primary data saved (52209 records). [2025-09-26T17:51:18.531997] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-26T17:51:18.532160] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 37.5s. Estimated remaining: 4h 20m 22s. Rate: 7.6 symbols/min [2025-09-26T17:51:18.728848] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:18.783452] [DEBUG] [LOCAL ] CARR: Loaded 53984 existing records from primary storage. [2025-09-26T17:51:18.783619] [INFO ] [MAIN ] CARR: Loaded 53984 existing records. [2025-09-26T17:51:18.985568] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:18.985867] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-26T17:51:18.985917] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-26T17:51:18.986150] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-26T17:51:18.986210] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-26T17:51:19.161090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-26T17:51:19.403110] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:19.439815] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:51:19.775581] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T17:51:19.956782] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-26T17:51:20.143785] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T17:51:20.756769] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-26T17:51:21.556724] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-26T17:51:21.911102] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T17:51:21.972638] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T17:51:21.980069] [INFO ] [REMOTE ] CALX: Full fetch complete (54186 records). [2025-09-26T17:51:21.980186] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-26T17:51:22.133581] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T17:51:22.368408] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-26T17:51:22.428630] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-26T17:51:22.428864] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-26T17:51:22.429558] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-26T17:51:22.429609] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-26T17:51:22.431161] [DEBUG] [LOCAL ] CALX: Trimmed 54186 records to 38931 (keeping 200 days of data) [2025-09-26T17:51:22.675313] [DEBUG] [LOCAL ] CALX: Primary data saved (38931 records). [2025-09-26T17:51:22.675470] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-26T17:51:22.676199] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 30.3s. Estimated remaining: 4h 19m 55s. Rate: 7.6 symbols/min [2025-09-26T17:51:22.861727] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:22.905974] [DEBUG] [LOCAL ] CARS: Loaded 40380 existing records from primary storage. [2025-09-26T17:51:22.906146] [INFO ] [MAIN ] CARS: Loaded 40380 existing records. [2025-09-26T17:51:23.110938] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:23.111243] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-26T17:51:23.111295] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-26T17:51:23.111583] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-26T17:51:23.111678] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-26T17:51:23.161870] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-26T17:51:23.568922] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:23.582786] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T17:51:23.632781] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T17:51:23.956747] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-26T17:51:24.756766] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-26T17:51:25.350970] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T17:51:25.556752] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-26T17:51:25.682390] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T17:51:26.356730] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-26T17:51:27.011154] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T17:51:27.156763] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-26T17:51:27.729947] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:51:27.956734] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-26T17:51:28.317689] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T17:51:28.324907] [INFO ] [REMOTE ] CANG: Full fetch complete (40674 records). [2025-09-26T17:51:28.325119] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-26T17:51:28.798221] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-26T17:51:28.762081] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-26T17:51:28.798436] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-26T17:51:28.800107] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-26T17:51:28.800188] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-26T17:51:28.801406] [DEBUG] [LOCAL ] CANG: Trimmed 40674 records to 27132 (keeping 200 days of data) [2025-09-26T17:51:28.936621] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T17:51:29.013353] [DEBUG] [LOCAL ] CANG: Primary data saved (27132 records). [2025-09-26T17:51:29.013522] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-26T17:51:29.013637] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CANG took 27.2s. Estimated remaining: 4h 19m 39s. Rate: 7.6 symbols/min [2025-09-26T17:51:29.213429] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:29.281303] [DEBUG] [LOCAL ] CAT: Loaded 53313 existing records from primary storage. [2025-09-26T17:51:29.281879] [INFO ] [MAIN ] CAT: Loaded 53313 existing records. [2025-09-26T17:51:29.499939] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:29.500441] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-26T17:51:29.500554] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-26T17:51:29.500976] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-26T17:51:29.501048] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-26T17:51:29.563087] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-26T17:51:29.938718] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:30.300173] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:51:30.356722] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-26T17:51:30.474752] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T17:51:31.156745] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-26T17:51:31.956701] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-26T17:51:32.029409] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T17:51:32.339448] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T17:51:32.756760] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-26T17:51:33.436884] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T17:51:33.464628] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T17:51:33.556769] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-26T17:51:34.153429] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T17:51:34.356755] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-26T17:51:35.156774] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-26T17:51:35.758048] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:51:35.956745] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-26T17:51:36.230761] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T17:51:36.756742] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-26T17:51:37.556774] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-26T17:51:37.939242] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T17:51:38.288731] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:51:38.317833] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-26T17:51:38.356738] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-26T17:51:39.156783] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-26T17:51:39.750583] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:51:39.956749] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-26T17:51:40.756734] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-26T17:51:41.276374] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T17:51:41.556731] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-26T17:51:41.778453] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T17:51:41.782603] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:51:41.794676] [INFO ] [REMOTE ] CAPL: Full fetch complete (8944 records). [2025-09-26T17:51:41.795121] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-26T17:51:42.212693] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-26T17:51:42.212788] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-26T17:51:42.213032] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-26T17:51:42.213075] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-26T17:51:42.213526] [DEBUG] [LOCAL ] CAPL: Trimmed 8944 records to 5930 (keeping 200 days of data) [2025-09-26T17:51:42.253393] [DEBUG] [LOCAL ] CAPL: Primary data saved (5930 records). [2025-09-26T17:51:42.253544] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-26T17:51:42.253672] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CAPL took 25.1s. Estimated remaining: 4h 19m 58s. Rate: 7.6 symbols/min [2025-09-26T17:51:42.361987] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-26T17:51:42.445126] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:42.455282] [DEBUG] [LOCAL ] CATO: Loaded 7254 existing records from primary storage. [2025-09-26T17:51:42.455435] [INFO ] [MAIN ] CATO: Loaded 7254 existing records. [2025-09-26T17:51:42.658699] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:42.659261] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-26T17:51:42.659315] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-26T17:51:42.659549] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-26T17:51:42.659610] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-26T17:51:43.061212] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:43.090213] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:51:43.156784] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-26T17:51:43.956778] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-26T17:51:44.549898] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-26T17:51:44.589689] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:51:44.756767] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-26T17:51:44.784678] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T17:51:45.556739] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-26T17:51:45.988300] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T17:51:46.356775] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-26T17:51:46.713000] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T17:51:47.156732] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-26T17:51:47.484976] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:51:47.588753] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T17:51:47.956743] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-26T17:51:48.756734] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-26T17:51:49.556730] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-26T17:51:50.004605] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T17:51:50.046459] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T17:51:50.054268] [INFO ] [REMOTE ] CARS: Full fetch complete (55332 records). [2025-09-26T17:51:50.054444] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-26T17:51:50.364989] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-26T17:51:50.491763] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-26T17:51:50.491846] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-26T17:51:50.492513] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-26T17:51:50.492578] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-26T17:51:50.493850] [DEBUG] [LOCAL ] CARS: Trimmed 55332 records to 40616 (keeping 200 days of data) [2025-09-26T17:51:50.739025] [DEBUG] [LOCAL ] CARS: Primary data saved (40616 records). [2025-09-26T17:51:50.739160] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-26T17:51:50.741285] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CARS took 28.1s. Estimated remaining: 4h 19m 54s. Rate: 7.6 symbols/min [2025-09-26T17:51:50.917786] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:50.973400] [DEBUG] [LOCAL ] CAVA: Loaded 53940 existing records from primary storage. [2025-09-26T17:51:50.973562] [INFO ] [MAIN ] CAVA: Loaded 53940 existing records. [2025-09-26T17:51:51.159254] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-26T17:51:51.163501] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:51.164838] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-26T17:51:51.164920] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-26T17:51:51.165261] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-26T17:51:51.165343] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-26T17:51:51.542907] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:51.580011] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-26T17:51:51.704408] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T17:51:51.772304] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T17:51:51.956725] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-26T17:51:52.736386] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T17:51:52.756738] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-26T17:51:53.556725] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-26T17:51:54.356768] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-26T17:51:54.712493] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T17:51:54.876428] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T17:51:55.156748] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-26T17:51:55.325875] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T17:51:55.337046] [INFO ] [REMOTE ] CARR: Full fetch complete (77602 records). [2025-09-26T17:51:55.337268] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-26T17:51:55.749332] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-26T17:51:55.749505] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-26T17:51:55.750387] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-26T17:51:55.750471] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-26T17:51:55.752278] [DEBUG] [LOCAL ] CARR: Trimmed 77602 records to 54374 (keeping 200 days of data) [2025-09-26T17:51:55.967089] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-26T17:51:56.093054] [DEBUG] [LOCAL ] CARR: Primary data saved (54374 records). [2025-09-26T17:51:56.093204] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-26T17:51:56.093315] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARR took 37.6s. Estimated remaining: 4h 19m 33s. Rate: 7.6 symbols/min [2025-09-26T17:51:56.313597] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:51:56.358616] [DEBUG] [LOCAL ] CB: Loaded 50444 existing records from primary storage. [2025-09-26T17:51:56.358789] [INFO ] [MAIN ] CB: Loaded 50444 existing records. [2025-09-26T17:51:56.503150] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T17:51:56.568705] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:51:56.569003] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-26T17:51:56.569062] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-26T17:51:56.569392] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-26T17:51:56.569476] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-26T17:51:56.762982] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-26T17:51:56.945540] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:51:57.096503] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T17:51:57.556740] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-26T17:51:58.318916] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T17:51:58.356685] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-26T17:51:59.123161] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T17:51:59.156674] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-26T17:51:59.956725] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-26T17:52:00.547944] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-26T17:52:00.711787] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T17:52:00.756725] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-26T17:52:00.977379] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T17:52:01.556736] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-26T17:52:02.356745] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-26T17:52:02.798993] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T17:52:03.156702] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-26T17:52:03.189911] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T17:52:03.437596] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T17:52:03.956731] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-26T17:52:04.756725] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-26T17:52:04.946733] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T17:52:04.949289] [INFO ] [REMOTE ] CATO: Full fetch complete (11764 records). [2025-09-26T17:52:04.949466] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-26T17:52:05.350152] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-26T17:52:05.350288] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-26T17:52:05.350795] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-26T17:52:05.350901] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-26T17:52:05.351900] [DEBUG] [LOCAL ] CATO: Trimmed 11764 records to 7286 (keeping 200 days of data) [2025-09-26T17:52:05.413202] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-26T17:52:05.426683] [INFO ] [REMOTE ] CAT: Full fetch complete (76657 records). [2025-09-26T17:52:05.427479] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-26T17:52:05.558737] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-26T17:52:05.644373] [DEBUG] [LOCAL ] CATO: Primary data saved (7286 records). [2025-09-26T17:52:05.693079] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-26T17:52:05.717785] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CATO took 23.5s. Estimated remaining: 4h 19m 34s. Rate: 7.6 symbols/min [2025-09-26T17:52:06.030931] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-26T17:52:06.031301] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-26T17:52:06.032602] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-26T17:52:06.033450] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-26T17:52:06.053611] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:06.054985] [DEBUG] [LOCAL ] CAT: Trimmed 76657 records to 53693 (keeping 200 days of data) [2025-09-26T17:52:06.168764] [DEBUG] [LOCAL ] CBAN: Loaded 11105 existing records from primary storage. [2025-09-26T17:52:06.174052] [INFO ] [MAIN ] CBAN: Loaded 11105 existing records. [2025-09-26T17:52:06.489778] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:06.492859] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-26T17:52:06.493301] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-26T17:52:06.496005] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-26T17:52:06.496154] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-26T17:52:06.975849] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:06.992325] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-26T17:52:07.001758] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-26T17:52:07.140202] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T17:52:07.156673] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-26T17:52:07.160572] [DEBUG] [LOCAL ] CAT: Primary data saved (53693 records). [2025-09-26T17:52:07.160689] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-26T17:52:07.160832] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CAT took 38.1s. Estimated remaining: 4h 18m 54s. Rate: 7.6 symbols/min [2025-09-26T17:52:07.908231] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T17:52:07.956705] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-26T17:52:08.756727] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-26T17:52:08.857614] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T17:52:09.325336] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T17:52:09.556726] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-26T17:52:10.026958] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:52:10.356815] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-26T17:52:11.156793] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-26T17:52:11.456215] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T17:52:11.726611] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T17:52:11.956731] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-26T17:52:12.551580] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-26T17:52:12.756786] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-26T17:52:12.959052] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T17:52:13.556741] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-26T17:52:14.356762] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-26T17:52:14.526200] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T17:52:14.754794] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T17:52:15.156768] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-26T17:52:15.956734] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-26T17:52:16.450767] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-26T17:52:16.756704] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-26T17:52:16.790088] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T17:52:16.907843] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T17:52:17.556725] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-26T17:52:18.356717] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-26T17:52:18.692188] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T17:52:19.015678] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T17:52:19.156767] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-26T17:52:19.244334] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:52:19.956760] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-26T17:52:20.756710] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-26T17:52:21.178723] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-26T17:52:21.370165] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T17:52:21.469602] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T17:52:21.556728] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-26T17:52:22.356753] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-26T17:52:23.156710] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-26T17:52:23.190939] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T17:52:23.736323] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T17:52:23.956738] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-26T17:52:24.273197] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T17:52:24.283859] [INFO ] [REMOTE ] CAVA: Full fetch complete (77287 records). [2025-09-26T17:52:24.284062] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-26T17:52:24.694055] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-26T17:52:24.694147] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-26T17:52:24.694997] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-26T17:52:24.695105] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-26T17:52:24.696764] [DEBUG] [LOCAL ] CAVA: Trimmed 77287 records to 54330 (keeping 200 days of data) [2025-09-26T17:52:24.769819] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-26T17:52:25.053926] [DEBUG] [LOCAL ] CAVA: Primary data saved (54330 records). [2025-09-26T17:52:25.054121] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-26T17:52:25.055443] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CAVA took 34.3s. Estimated remaining: 4h 19m 36s. Rate: 7.6 symbols/min [2025-09-26T17:52:25.480970] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T17:52:25.483932] [INFO ] [REMOTE ] CBAN: Full fetch complete (16064 records). [2025-09-26T17:52:25.484049] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-26T17:52:25.904309] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-26T17:52:25.918571] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-26T17:52:25.928744] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-26T17:52:25.929372] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-26T17:52:25.930710] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T17:52:25.941064] [DEBUG] [LOCAL ] CBAN: Trimmed 16064 records to 11141 (keeping 200 days of data) [2025-09-26T17:52:25.941202] [INFO ] [REMOTE ] CB: Full fetch complete (72717 records). [2025-09-26T17:52:25.941359] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-26T17:52:26.442392] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-26T17:52:26.442869] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-26T17:52:26.444812] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-26T17:52:26.445180] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-26T17:52:26.451219] [DEBUG] [LOCAL ] CBAN: Primary data saved (11141 records). [2025-09-26T17:52:26.451670] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-26T17:52:26.451797] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CBAN took 20.7s. Estimated remaining: 4h 18m 56s. Rate: 7.6 symbols/min [2025-09-26T17:52:26.452061] [DEBUG] [LOCAL ] CB: Trimmed 72717 records to 50773 (keeping 200 days of data) [2025-09-26T17:52:26.789549] [DEBUG] [LOCAL ] CB: Primary data saved (50773 records). [2025-09-26T17:52:26.789730] [INFO ] [MAIN ] CB: Full history saved. [2025-09-26T17:52:26.789832] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CB took 30.7s. Estimated remaining: 4h 18m 11s. Rate: 7.6 symbols/min [2025-09-26T17:52:27.543076] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:27.494514] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:27.548183] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:27.548958] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-26T17:52:27.549765] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-26T17:52:27.549938] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-26T17:52:27.549986] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-26T17:52:27.550030] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-26T17:52:27.550075] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-26T17:52:27.592798] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:27.668148] [DEBUG] [LOCAL ] CBNA: Loaded 2908 existing records from primary storage. [2025-09-26T17:52:27.688518] [INFO ] [MAIN ] CBNA: Loaded 2908 existing records. [2025-09-26T17:52:28.022196] [DEBUG] [LOCAL ] CBL: Loaded 16777 existing records from primary storage. [2025-09-26T17:52:28.090313] [INFO ] [MAIN ] CBL: Loaded 16777 existing records. [2025-09-26T17:52:28.092209] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:28.157232] [DEBUG] [LOCAL ] CBRE: Loaded 51010 existing records from primary storage. [2025-09-26T17:52:28.177638] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-26T17:52:28.188991] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-26T17:52:28.183126] [INFO ] [MAIN ] CBRE: Loaded 51010 existing records. [2025-09-26T17:52:28.213156] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-26T17:52:28.228799] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-26T17:52:28.438365] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:28.472144] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-26T17:52:28.690911] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:28.738087] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-26T17:52:28.795165] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:28.794566] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-26T17:52:28.882717] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-26T17:52:28.865174] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-26T17:52:28.900450] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-26T17:52:28.932548] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-26T17:52:28.921988] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:29.030149] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-26T17:52:29.061821] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-26T17:52:29.101541] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-26T17:52:29.188344] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-26T17:52:29.178002] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:29.319905] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-26T17:52:29.411167] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:29.468940] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-26T17:52:29.483546] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-26T17:52:29.627796] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:29.638377] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-26T17:52:29.832208] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:29.867989] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-26T17:52:29.882955] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-26T17:52:29.882598] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:30.211326] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T17:52:30.211002] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-26T17:52:30.356736] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-26T17:52:30.661098] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T17:52:30.793726] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T17:52:31.156794] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-26T17:52:31.956743] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-26T17:52:32.305012] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-26T17:52:32.727546] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T17:52:32.756699] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-26T17:52:33.556722] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-26T17:52:33.854851] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-26T17:52:34.197798] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T17:52:34.356731] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-26T17:52:35.156701] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-26T17:52:35.363700] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-26T17:52:35.408872] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T17:52:35.956771] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-26T17:52:36.582846] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T17:52:36.756767] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-26T17:52:37.012003] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-26T17:52:37.556720] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-26T17:52:38.356769] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-26T17:52:38.383183] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T17:52:39.004580] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T17:52:39.156735] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-26T17:52:39.956733] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-26T17:52:40.069691] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T17:52:40.712716] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T17:52:40.756765] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-26T17:52:41.556734] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-26T17:52:41.884420] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:52:42.356734] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-26T17:52:42.842765] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:52:43.120539] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T17:52:43.156690] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-26T17:52:43.408522] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:43.408869] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-26T17:52:43.956769] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-26T17:52:44.756875] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-26T17:52:45.063404] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:45.063762] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-26T17:52:45.063913] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-26T17:52:45.064000] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-26T17:52:45.064637] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:52:45.064740] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:52:45.064804] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:52:45.064872] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-26T17:52:45.064937] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-26T17:52:45.064976] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-26T17:52:45.065030] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-26T17:52:45.065112] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 18.3s. Estimated remaining: 4h 18m 54s. Rate: 7.6 symbols/min [2025-09-26T17:52:45.250181] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:45.284265] [DEBUG] [LOCAL ] CBT: Loaded 31329 existing records from primary storage. [2025-09-26T17:52:45.284430] [INFO ] [MAIN ] CBT: Loaded 31329 existing records. [2025-09-26T17:52:45.486965] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:45.487320] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-26T17:52:45.487373] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-26T17:52:45.487727] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-26T17:52:45.487789] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-26T17:52:45.561279] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-26T17:52:45.917990] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:45.951234] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T17:52:45.975049] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T17:52:46.356739] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-26T17:52:47.156693] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-26T17:52:47.307408] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T17:52:47.516296] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T17:52:47.956724] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-26T17:52:48.520025] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T17:52:48.756774] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-26T17:52:49.556704] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-26T17:52:49.865969] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T17:52:49.987616] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T17:52:49.988742] [INFO ] [REMOTE ] CBNA: Full fetch complete (4644 records). [2025-09-26T17:52:49.988815] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-26T17:52:50.362069] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-26T17:52:50.415124] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-26T17:52:50.415246] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-26T17:52:50.415586] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-26T17:52:50.415720] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-26T17:52:50.416940] [DEBUG] [LOCAL ] CBNA: Trimmed 4644 records to 2923 (keeping 200 days of data) [2025-09-26T17:52:50.438307] [DEBUG] [LOCAL ] CBNA: Primary data saved (2923 records). [2025-09-26T17:52:50.438396] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-26T17:52:50.438600] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBNA took 23.6s. Estimated remaining: 4h 18m 34s. Rate: 7.6 symbols/min [2025-09-26T17:52:50.616065] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:50.653317] [DEBUG] [LOCAL ] CBU: Loaded 23004 existing records from primary storage. [2025-09-26T17:52:50.653516] [INFO ] [MAIN ] CBU: Loaded 23004 existing records. [2025-09-26T17:52:50.831933] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:52:50.832260] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-26T17:52:50.832313] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-26T17:52:50.833320] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-26T17:52:50.833394] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-26T17:52:51.162929] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-26T17:52:51.210792] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:51.890804] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T17:52:51.956757] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-26T17:52:52.316153] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T17:52:52.756739] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-26T17:52:53.556709] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-26T17:52:53.730502] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T17:52:53.778029] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:52:54.320271] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T17:52:54.356730] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-26T17:52:55.156752] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-26T17:52:55.709105] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T17:52:55.839504] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T17:52:55.956746] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-26T17:52:56.756735] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-26T17:52:56.916324] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:52:56.919799] [INFO ] [REMOTE ] CBL: Full fetch complete (25506 records). [2025-09-26T17:52:56.919887] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-26T17:52:57.319686] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-26T17:52:57.319797] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-26T17:52:57.320188] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-26T17:52:57.320230] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-26T17:52:57.321547] [DEBUG] [LOCAL ] CBL: Trimmed 25506 records to 16862 (keeping 200 days of data) [2025-09-26T17:52:57.434385] [DEBUG] [LOCAL ] CBL: Primary data saved (16862 records). [2025-09-26T17:52:57.434537] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-26T17:52:57.434673] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBL took 30.6s. Estimated remaining: 4h 18m 22s. Rate: 7.6 symbols/min [2025-09-26T17:52:57.561833] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-26T17:52:57.619769] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:52:57.619932] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-26T17:52:57.619988] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-26T17:52:57.620147] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-26T17:52:57.620193] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-26T17:52:57.620238] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-26T17:52:57.620273] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-26T17:52:58.073360] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:52:58.088847] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T17:52:58.356740] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-26T17:52:59.156691] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-26T17:52:59.228793] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T17:52:59.368702] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:52:59.370423] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T17:52:59.370861] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-26T17:52:59.956726] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-26T17:53:00.756713] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-26T17:53:00.960345] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T17:53:01.556744] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-26T17:53:02.356684] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-26T17:53:02.575865] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:02.590967] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-26T17:53:02.597138] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T17:53:02.761860] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T17:53:03.156788] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-26T17:53:03.399847] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:03.400335] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-26T17:53:03.956730] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-26T17:53:04.756732] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-26T17:53:05.567727] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-26T17:53:05.574374] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T17:53:05.735360] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T17:53:05.794023] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:05.794379] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-26T17:53:06.356769] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-26T17:53:07.156762] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-26T17:53:07.411417] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:07.411769] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-26T17:53:07.913489] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:53:07.956757] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-26T17:53:08.756803] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-26T17:53:08.993718] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T17:53:09.445396] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T17:53:09.556712] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-26T17:53:10.356762] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-26T17:53:10.908316] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:53:11.156756] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-26T17:53:11.775017] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T17:53:11.956772] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-26T17:53:12.028403] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T17:53:12.756792] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-26T17:53:12.960007] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-26T17:53:13.556733] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-26T17:53:13.809428] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-26T17:53:14.086698] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:53:14.356779] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-26T17:53:15.156726] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-26T17:53:15.721052] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T17:53:15.727860] [INFO ] [REMOTE ] CBT: Full fetch complete (45886 records). [2025-09-26T17:53:15.728033] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-26T17:53:15.967362] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-26T17:53:16.140227] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-26T17:53:16.140321] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-26T17:53:16.140937] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-26T17:53:16.141003] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-26T17:53:16.142591] [DEBUG] [LOCAL ] CBT: Trimmed 45886 records to 31567 (keeping 200 days of data) [2025-09-26T17:53:16.250885] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-26T17:53:16.357552] [DEBUG] [LOCAL ] CBT: Primary data saved (31567 records). [2025-09-26T17:53:16.357731] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-26T17:53:16.357835] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBT took 31.3s. Estimated remaining: 4h 19m 8s. Rate: 7.6 symbols/min [2025-09-26T17:53:16.543804] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:16.581216] [DEBUG] [LOCAL ] CBZ: Loaded 33818 existing records from primary storage. [2025-09-26T17:53:16.581410] [INFO ] [MAIN ] CBZ: Loaded 33818 existing records. [2025-09-26T17:53:16.769687] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-26T17:53:16.786113] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:16.786704] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-26T17:53:16.786870] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-26T17:53:16.810439] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-26T17:53:16.813350] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-26T17:53:16.822729] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T17:53:16.933364] [INFO ] [REMOTE ] CBRE: Full fetch complete (73955 records). [2025-09-26T17:53:16.936587] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-26T17:53:17.593748] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:17.586317] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-26T17:53:17.700229] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-26T17:53:17.700432] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-26T17:53:17.701262] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-26T17:53:17.701328] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-26T17:53:17.702907] [DEBUG] [LOCAL ] CBRE: Trimmed 73955 records to 51366 (keeping 200 days of data) [2025-09-26T17:53:17.892804] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:17.902500] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-26T17:53:17.950582] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T17:53:18.050689] [DEBUG] [LOCAL ] CBRE: Primary data saved (51366 records). [2025-09-26T17:53:18.050851] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-26T17:53:18.050961] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBRE took 51.3s. Estimated remaining: 4h 18m 29s. Rate: 7.6 symbols/min [2025-09-26T17:53:18.235778] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:18.293812] [DEBUG] [LOCAL ] CC: Loaded 53416 existing records from primary storage. [2025-09-26T17:53:18.293983] [INFO ] [MAIN ] CC: Loaded 53416 existing records. [2025-09-26T17:53:18.361836] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-26T17:53:18.490957] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:18.491211] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-26T17:53:18.491261] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-26T17:53:18.492598] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-26T17:53:18.492685] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-26T17:53:18.883268] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:19.156754] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-26T17:53:19.631937] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T17:53:19.956758] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-26T17:53:20.151870] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T17:53:20.756743] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-26T17:53:20.888627] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:53:21.556722] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-26T17:53:21.875801] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:53:21.876132] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-26T17:53:21.876254] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-26T17:53:21.876327] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-26T17:53:21.876964] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:53:21.877044] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:53:21.877136] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:53:21.877208] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-26T17:53:21.877274] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-26T17:53:21.877343] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-26T17:53:21.877435] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-26T17:53:21.877502] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBX took 24.4s. Estimated remaining: 4h 18m 2s. Rate: 7.6 symbols/min [2025-09-26T17:53:22.062136] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:22.132911] [DEBUG] [LOCAL ] CCI: Loaded 53536 existing records from primary storage. [2025-09-26T17:53:22.133159] [INFO ] [MAIN ] CCI: Loaded 53536 existing records. [2025-09-26T17:53:22.334182] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:22.334490] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-26T17:53:22.334570] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-26T17:53:22.345637] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-26T17:53:22.358993] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-26T17:53:22.361954] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-26T17:53:22.402892] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T17:53:22.769841] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:23.156765] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-26T17:53:23.530017] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T17:53:23.535546] [INFO ] [REMOTE ] CBU: Full fetch complete (32232 records). [2025-09-26T17:53:23.535691] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-26T17:53:23.953888] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-26T17:53:23.953981] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-26T17:53:23.954633] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-26T17:53:23.954720] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-26T17:53:23.955691] [DEBUG] [LOCAL ] CBU: Trimmed 32232 records to 23130 (keeping 200 days of data) [2025-09-26T17:53:23.956759] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-26T17:53:24.111431] [DEBUG] [LOCAL ] CBU: Primary data saved (23130 records). [2025-09-26T17:53:24.111587] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-26T17:53:24.111710] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBU took 33.7s. Estimated remaining: 4h 17m 27s. Rate: 7.6 symbols/min [2025-09-26T17:53:24.302713] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:24.303149] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-26T17:53:24.303292] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-26T17:53:24.303607] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-26T17:53:24.303712] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-26T17:53:24.303835] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-26T17:53:24.304085] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-26T17:53:24.662637] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:53:24.768691] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-26T17:53:24.775457] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:24.791117] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T17:53:25.556731] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-26T17:53:26.265453] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T17:53:26.356733] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-26T17:53:27.049920] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T17:53:27.156772] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-26T17:53:27.521037] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-26T17:53:27.694027] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T17:53:27.956758] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-26T17:53:28.756733] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-26T17:53:29.011737] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T17:53:29.253636] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T17:53:29.556734] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-26T17:53:30.356738] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-26T17:53:31.156774] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-26T17:53:31.430560] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-26T17:53:31.444295] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-26T17:53:31.956711] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-26T17:53:32.220388] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-09-26T17:53:32.316817] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T17:53:32.756744] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-26T17:53:33.556738] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-26T17:53:34.356738] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-26T17:53:34.410816] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T17:53:34.497540] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T17:53:35.156779] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-26T17:53:35.869549] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T17:53:35.956682] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-26T17:53:36.595334] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T17:53:36.756742] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-26T17:53:37.306010] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T17:53:37.556792] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-26T17:53:38.321416] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T17:53:38.356684] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-26T17:53:38.986476] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:53:39.156739] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-26T17:53:39.619128] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T17:53:39.649456] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T17:53:39.956750] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-26T17:53:40.295552] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-26T17:53:40.756754] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-26T17:53:41.556767] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-26T17:53:42.272158] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T17:53:42.356752] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-26T17:53:43.161847] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-26T17:53:43.180431] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T17:53:43.468750] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-26T17:53:43.579697] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T17:53:43.956753] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-26T17:53:44.330091] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T17:53:44.756730] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-26T17:53:45.556732] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-26T17:53:45.839357] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-26T17:53:46.356755] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-26T17:53:46.540229] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T17:53:46.922006] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T17:53:46.923007] [INFO ] [REMOTE ] CCIA: Full fetch complete (2044 records). [2025-09-26T17:53:46.923082] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-26T17:53:47.133954] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T17:53:47.134211] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:53:47.134288] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:53:47.134364] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-26T17:53:47.134432] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-26T17:53:47.134472] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-26T17:53:47.134530] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-26T17:53:47.134627] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CCIA took 23.0s. Estimated remaining: 4h 18m 32s. Rate: 7.6 symbols/min [2025-09-26T17:53:47.165298] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-26T17:53:47.323802] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:47.340686] [DEBUG] [LOCAL ] CCIF: Loaded 15490 existing records from primary storage. [2025-09-26T17:53:47.340826] [INFO ] [MAIN ] CCIF: Loaded 15490 existing records. [2025-09-26T17:53:47.527761] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:47.528038] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-26T17:53:47.528092] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-26T17:53:47.528724] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-26T17:53:47.528785] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-26T17:53:47.927057] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:47.956717] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-26T17:53:48.756793] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-26T17:53:48.855396] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:53:49.055176] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T17:53:49.556758] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-26T17:53:49.771226] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T17:53:50.069000] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T17:53:50.356759] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-26T17:53:51.156819] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-26T17:53:51.771064] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T17:53:51.810882] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T17:53:51.956730] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-26T17:53:52.475468] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-26T17:53:52.756757] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-26T17:53:53.556738] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-26T17:53:54.356782] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-26T17:53:54.532333] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T17:53:54.578463] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T17:53:54.590751] [INFO ] [REMOTE ] CCI: Full fetch complete (76999 records). [2025-09-26T17:53:54.590981] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-26T17:53:55.014725] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-26T17:53:55.014843] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-26T17:53:55.015889] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-26T17:53:55.015958] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-26T17:53:55.019357] [DEBUG] [LOCAL ] CCI: Trimmed 76999 records to 53922 (keeping 200 days of data) [2025-09-26T17:53:55.156787] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-26T17:53:55.378506] [DEBUG] [LOCAL ] CCI: Primary data saved (53922 records). [2025-09-26T17:53:55.378689] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-26T17:53:55.378792] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CCI took 33.5s. Estimated remaining: 4h 18m 26s. Rate: 7.6 symbols/min [2025-09-26T17:53:55.550732] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:55.603836] [DEBUG] [LOCAL ] CCJ: Loaded 54065 existing records from primary storage. [2025-09-26T17:53:55.604001] [INFO ] [MAIN ] CCJ: Loaded 54065 existing records. [2025-09-26T17:53:55.803381] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:55.803750] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-26T17:53:55.803810] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-26T17:53:55.805611] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-26T17:53:55.805708] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-26T17:53:55.961976] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-26T17:53:56.210959] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:56.329677] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:53:56.407213] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T17:53:56.418112] [INFO ] [REMOTE ] CC: Full fetch complete (75565 records). [2025-09-26T17:53:56.418287] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-26T17:53:56.758683] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-26T17:53:56.854638] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T17:53:56.855062] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-26T17:53:56.859313] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-26T17:53:56.861224] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-26T17:53:56.861335] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-26T17:53:56.864439] [DEBUG] [LOCAL ] CC: Trimmed 75565 records to 53801 (keeping 200 days of data) [2025-09-26T17:53:57.212146] [DEBUG] [LOCAL ] CC: Primary data saved (53801 records). [2025-09-26T17:53:57.212341] [INFO ] [MAIN ] CC: Full history saved. [2025-09-26T17:53:57.212459] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 39.2s. Estimated remaining: 4h 17m 49s. Rate: 7.6 symbols/min [2025-09-26T17:53:57.407730] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:53:57.460745] [DEBUG] [LOCAL ] CCK: Loaded 46723 existing records from primary storage. [2025-09-26T17:53:57.460933] [INFO ] [MAIN ] CCK: Loaded 46723 existing records. [2025-09-26T17:53:57.561798] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-26T17:53:57.652321] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:53:57.652582] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-26T17:53:57.652630] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-26T17:53:57.653990] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-26T17:53:57.654050] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-26T17:53:58.036683] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:53:58.159066] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T17:53:58.356774] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-26T17:53:58.531193] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:53:59.156779] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-26T17:53:59.479099] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T17:53:59.487596] [INFO ] [REMOTE ] CBZ: Full fetch complete (45094 records). [2025-09-26T17:53:59.487780] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-26T17:53:59.896905] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-26T17:53:59.897221] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-26T17:53:59.898080] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-26T17:53:59.903352] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-26T17:53:59.910133] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T17:53:59.915609] [DEBUG] [LOCAL ] CBZ: Trimmed 45094 records to 34130 (keeping 200 days of data) [2025-09-26T17:53:59.967403] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-26T17:54:00.131449] [DEBUG] [LOCAL ] CBZ: Primary data saved (34130 records). [2025-09-26T17:54:00.131737] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-26T17:54:00.131873] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CBZ took 43.8s. Estimated remaining: 4h 17m 17s. Rate: 7.6 symbols/min [2025-09-26T17:54:00.318420] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:00.378443] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-09-26T17:54:00.378694] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-09-26T17:54:00.569078] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:00.569470] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-26T17:54:00.569536] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-26T17:54:00.571065] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-26T17:54:00.571131] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-26T17:54:00.757053] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-26T17:54:00.898685] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T17:54:00.987044] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:01.556755] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-26T17:54:02.356713] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-26T17:54:02.802378] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T17:54:02.825939] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:54:02.829995] [INFO ] [REMOTE ] CCIF: Full fetch complete (21675 records). [2025-09-26T17:54:02.830078] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-26T17:54:03.161866] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-26T17:54:03.236230] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-26T17:54:03.236339] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-26T17:54:03.236817] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-26T17:54:03.236893] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-26T17:54:03.237710] [DEBUG] [LOCAL ] CCIF: Trimmed 21675 records to 15698 (keeping 200 days of data) [2025-09-26T17:54:03.329533] [DEBUG] [LOCAL ] CCIF: Primary data saved (15698 records). [2025-09-26T17:54:03.329731] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-26T17:54:03.329839] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCIF took 16.2s. Estimated remaining: 4h 16m 47s. Rate: 7.6 symbols/min [2025-09-26T17:54:03.569185] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:03.622205] [DEBUG] [LOCAL ] CCO: Loaded 48012 existing records from primary storage. [2025-09-26T17:54:03.622365] [INFO ] [MAIN ] CCO: Loaded 48012 existing records. [2025-09-26T17:54:03.815684] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:03.816022] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-26T17:54:03.816114] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-26T17:54:03.817232] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-26T17:54:03.817294] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-26T17:54:03.961835] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-26T17:54:04.186665] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:04.765765] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-26T17:54:04.776031] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-26T17:54:05.027318] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T17:54:05.556802] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-26T17:54:06.066360] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:54:06.108110] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T17:54:06.356793] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-26T17:54:07.156748] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-26T17:54:07.679104] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T17:54:07.956778] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-26T17:54:08.239365] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-26T17:54:08.312577] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-26T17:54:08.756786] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-26T17:54:09.556791] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-26T17:54:10.050125] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-26T17:54:10.122742] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T17:54:10.356780] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-26T17:54:11.156751] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-26T17:54:11.196885] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:54:11.956833] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-26T17:54:12.374947] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T17:54:12.499110] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-26T17:54:12.756755] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-26T17:54:13.204398] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T17:54:13.556761] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-26T17:54:14.346441] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T17:54:14.356946] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-26T17:54:15.156762] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-26T17:54:15.367200] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T17:54:15.956719] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-26T17:54:16.083844] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T17:54:16.536571] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:54:16.756804] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-26T17:54:17.229192] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T17:54:17.556743] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-26T17:54:18.145460] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T17:54:18.356747] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-26T17:54:18.937833] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T17:54:19.156756] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-26T17:54:19.589709] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T17:54:19.956762] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-26T17:54:20.756762] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-26T17:54:21.556744] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-26T17:54:21.601033] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-26T17:54:21.670311] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T17:54:22.033829] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T17:54:22.356760] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-26T17:54:23.156771] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-26T17:54:23.336110] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T17:54:23.566694] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T17:54:23.956781] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-26T17:54:24.756784] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-26T17:54:25.353307] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-26T17:54:25.556795] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-26T17:54:25.651673] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T17:54:26.025363] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T17:54:26.035333] [INFO ] [REMOTE ] CCO: Full fetch complete (66325 records). [2025-09-26T17:54:26.035514] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-26T17:54:26.361726] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-26T17:54:26.462259] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-26T17:54:26.462379] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-26T17:54:26.463219] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-26T17:54:26.463292] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-26T17:54:26.464871] [DEBUG] [LOCAL ] CCO: Trimmed 66325 records to 48387 (keeping 200 days of data) [2025-09-26T17:54:26.763475] [DEBUG] [LOCAL ] CCO: Primary data saved (48387 records). [2025-09-26T17:54:26.763639] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-26T17:54:26.765430] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCO took 23.4s. Estimated remaining: 4h 17m 53s. Rate: 7.6 symbols/min [2025-09-26T17:54:26.948399] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:26.964321] [DEBUG] [LOCAL ] CCRD: Loaded 9067 existing records from primary storage. [2025-09-26T17:54:26.964475] [INFO ] [MAIN ] CCRD: Loaded 9067 existing records. [2025-09-26T17:54:27.158544] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-26T17:54:27.162732] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:27.164162] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-26T17:54:27.164232] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-26T17:54:27.164730] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-26T17:54:27.164795] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-26T17:54:27.570104] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:27.913980] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-26T17:54:27.956715] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-26T17:54:28.152145] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T17:54:28.756736] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-26T17:54:29.556697] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-26T17:54:29.603262] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-26T17:54:30.277910] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T17:54:30.346247] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T17:54:30.361883] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-26T17:54:30.384850] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-26T17:54:31.109412] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T17:54:31.156754] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-26T17:54:31.956791] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-26T17:54:32.756768] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-26T17:54:32.887197] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T17:54:32.896891] [INFO ] [REMOTE ] CCK: Full fetch complete (67739 records). [2025-09-26T17:54:32.897124] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-26T17:54:33.300062] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-26T17:54:33.300161] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-26T17:54:33.300923] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-26T17:54:33.300989] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-26T17:54:33.302448] [DEBUG] [LOCAL ] CCK: Trimmed 67739 records to 47083 (keeping 200 days of data) [2025-09-26T17:54:33.556986] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-26T17:54:33.613355] [DEBUG] [LOCAL ] CCK: Primary data saved (47083 records). [2025-09-26T17:54:33.613541] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-26T17:54:33.613712] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCK took 36.4s. Estimated remaining: 4h 17m 40s. Rate: 7.6 symbols/min [2025-09-26T17:54:33.797790] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:33.830410] [DEBUG] [LOCAL ] CCS: Loaded 30944 existing records from primary storage. [2025-09-26T17:54:33.830577] [INFO ] [MAIN ] CCS: Loaded 30944 existing records. [2025-09-26T17:54:34.032689] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T17:54:34.032908] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:34.035965] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-26T17:54:34.036487] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-26T17:54:34.037701] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-26T17:54:34.037766] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-26T17:54:34.360952] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-26T17:54:34.443918] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:34.487135] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-26T17:54:34.831541] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-26T17:54:34.879880] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-26T17:54:35.156788] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-26T17:54:35.956786] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-26T17:54:36.756740] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-26T17:54:37.329549] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-26T17:54:37.341066] [INFO ] [REMOTE ] CCJ: Full fetch complete (77683 records). [2025-09-26T17:54:37.341248] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-26T17:54:37.483819] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:54:37.562119] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-26T17:54:37.817443] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-26T17:54:37.817539] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-26T17:54:37.818428] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-26T17:54:37.818501] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-26T17:54:37.820104] [DEBUG] [LOCAL ] CCJ: Trimmed 77683 records to 54453 (keeping 200 days of data) [2025-09-26T17:54:38.145614] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T17:54:38.165431] [DEBUG] [LOCAL ] CCJ: Primary data saved (54453 records). [2025-09-26T17:54:38.165592] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-26T17:54:38.165711] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCJ took 42.8s. Estimated remaining: 4h 17m 16s. Rate: 7.6 symbols/min [2025-09-26T17:54:38.348209] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:38.360974] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-26T17:54:38.372749] [DEBUG] [LOCAL ] CCU: Loaded 23712 existing records from primary storage. [2025-09-26T17:54:38.372898] [INFO ] [MAIN ] CCU: Loaded 23712 existing records. [2025-09-26T17:54:38.567582] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:38.568347] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-26T17:54:38.568461] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-26T17:54:38.599422] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-26T17:54:38.599608] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-26T17:54:38.665593] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-26T17:54:38.729871] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-26T17:54:38.730073] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-26T17:54:39.162263] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-26T17:54:39.336831] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:39.380414] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T17:54:39.483793] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-26T17:54:39.483875] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-26T17:54:39.484747] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-26T17:54:39.484814] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-26T17:54:39.486346] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54580 (keeping 200 days of data) [2025-09-26T17:54:39.828158] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-09-26T17:54:39.828327] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-26T17:54:39.828452] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCL took 39.7s. Estimated remaining: 4h 16m 39s. Rate: 7.6 symbols/min [2025-09-26T17:54:39.961873] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-26T17:54:40.009519] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:40.009756] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-26T17:54:40.009860] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-26T17:54:40.009988] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-26T17:54:40.010031] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-26T17:54:40.010073] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-26T17:54:40.010110] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-26T17:54:40.402368] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:40.590748] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T17:54:40.756741] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-26T17:54:41.176947] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T17:54:41.255267] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T17:54:41.556752] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-26T17:54:42.356765] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-26T17:54:42.489686] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T17:54:42.623134] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-09-26T17:54:43.156730] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-26T17:54:43.956727] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-26T17:54:44.226006] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T17:54:44.756716] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-26T17:54:45.045430] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T17:54:45.077706] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T17:54:45.556729] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-26T17:54:46.268384] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T17:54:46.356708] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-26T17:54:47.156724] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-26T17:54:47.779041] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T17:54:47.792613] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T17:54:47.794881] [INFO ] [REMOTE ] CCRD: Full fetch complete (11816 records). [2025-09-26T17:54:47.795061] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-26T17:54:47.795597] [FATAL] [VALIDATOR ] CCRD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:54:47.795746] [FATAL] [MAIN ] CCRD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:54:47.795793] [WARN ] [MAIN ] CCRD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:54:47.795835] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-26T17:54:47.795895] [DEBUG] [LOCAL ] CCRD: No primary data file found to delete. [2025-09-26T17:54:47.795949] [INFO ] [LOCAL ] CCRD: Starting deletion of derivative data. [2025-09-26T17:54:47.796488] [DEBUG] [LOCAL ] CCRD: Deleted derivative data file. [2025-09-26T17:54:47.796621] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCRD took 21.0s. Estimated remaining: 4h 16m 32s. Rate: 7.6 symbols/min [2025-09-26T17:54:47.965315] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-26T17:54:48.013355] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:54:48.102875] [DEBUG] [LOCAL ] CDE: Loaded 54031 existing records from primary storage. [2025-09-26T17:54:48.103078] [INFO ] [MAIN ] CDE: Loaded 54031 existing records. [2025-09-26T17:54:48.302469] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:54:48.302897] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-26T17:54:48.302961] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-26T17:54:48.304361] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-26T17:54:48.304436] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-26T17:54:48.444735] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-26T17:54:48.705556] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:54:48.756722] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-26T17:54:49.556720] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-26T17:54:50.080499] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T17:54:50.356758] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-26T17:54:51.156737] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-26T17:54:51.376151] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T17:54:51.432878] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T17:54:51.499994] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-26T17:54:51.956756] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-26T17:54:52.756762] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-26T17:54:53.556743] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-26T17:54:53.747496] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T17:54:53.828277] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-26T17:54:54.356725] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-26T17:54:54.605755] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:54:54.606072] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-26T17:54:54.632594] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T17:54:55.156722] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-26T17:54:55.956725] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-26T17:54:56.381195] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T17:54:56.756728] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-26T17:54:56.917342] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T17:54:57.556738] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-26T17:54:58.261947] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T17:54:58.356699] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-26T17:54:58.662196] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T17:54:59.156758] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-26T17:54:59.956715] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-26T17:55:00.323099] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T17:55:00.353073] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T17:55:00.756698] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-26T17:55:01.000837] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T17:55:01.039497] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-26T17:55:01.556731] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-26T17:55:02.356783] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-26T17:55:02.798505] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-26T17:55:02.799378] [INFO ] [REMOTE ] CCZ: Full fetch complete (95 records). [2025-09-26T17:55:02.799460] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-26T17:55:02.799989] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T17:55:02.800080] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:55:02.800136] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:55:02.800224] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-26T17:55:02.800308] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-26T17:55:02.800348] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-26T17:55:02.800406] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-26T17:55:02.800544] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCZ took 23.0s. Estimated remaining: 4h 16m 57s. Rate: 7.6 symbols/min [2025-09-26T17:55:02.998805] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:03.016784] [DEBUG] [LOCAL ] CDLR: Loaded 9877 existing records from primary storage. [2025-09-26T17:55:03.016926] [INFO ] [MAIN ] CDLR: Loaded 9877 existing records. [2025-09-26T17:55:03.167525] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-26T17:55:03.220244] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:03.220552] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-26T17:55:03.220622] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-26T17:55:03.221358] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-26T17:55:03.221438] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-26T17:55:03.616458] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:03.956727] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-26T17:55:04.005760] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-26T17:55:04.486875] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T17:55:04.756744] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-26T17:55:05.046556] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T17:55:05.556716] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-26T17:55:06.054850] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:55:06.356730] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-26T17:55:06.988715] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T17:55:07.156784] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-26T17:55:07.667267] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T17:55:07.956740] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-26T17:55:08.368106] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T17:55:08.454540] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T17:55:08.756789] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-26T17:55:09.556769] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-26T17:55:09.748577] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T17:55:10.356743] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-26T17:55:10.642813] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T17:55:10.647257] [INFO ] [REMOTE ] CCU: Full fetch complete (33166 records). [2025-09-26T17:55:10.647591] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-26T17:55:11.072982] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-26T17:55:11.073077] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-26T17:55:11.073581] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-26T17:55:11.073701] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-26T17:55:11.074857] [DEBUG] [LOCAL ] CCU: Trimmed 33166 records to 23800 (keeping 200 days of data) [2025-09-26T17:55:11.172135] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-26T17:55:11.237833] [DEBUG] [LOCAL ] CCU: Primary data saved (23800 records). [2025-09-26T17:55:11.237992] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-26T17:55:11.238109] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCU took 33.1s. Estimated remaining: 4h 16m 52s. Rate: 7.6 symbols/min [2025-09-26T17:55:11.428258] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:11.479932] [DEBUG] [LOCAL ] CDP: Loaded 43032 existing records from primary storage. [2025-09-26T17:55:11.480085] [INFO ] [MAIN ] CDP: Loaded 43032 existing records. [2025-09-26T17:55:11.674585] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:11.674873] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-26T17:55:11.674944] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-26T17:55:11.676204] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-26T17:55:11.676273] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-26T17:55:11.959956] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-26T17:55:12.101703] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:12.157162] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T17:55:12.216315] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T17:55:12.546568] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T17:55:12.756761] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-26T17:55:13.556727] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-26T17:55:13.612741] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T17:55:14.356735] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-26T17:55:14.680428] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T17:55:14.896184] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T17:55:15.156753] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-26T17:55:15.956747] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-26T17:55:16.756778] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-26T17:55:17.174690] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T17:55:17.257772] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:55:17.352485] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:55:17.556721] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-26T17:55:18.356758] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-26T17:55:19.020881] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T17:55:19.034087] [INFO ] [REMOTE ] CCS: Full fetch complete (44951 records). [2025-09-26T17:55:19.034391] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-26T17:55:19.034564] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-26T17:55:19.161839] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-26T17:55:19.452979] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-26T17:55:19.453102] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-26T17:55:19.453733] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-26T17:55:19.453802] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-26T17:55:19.455196] [DEBUG] [LOCAL ] CCS: Trimmed 44951 records to 31155 (keeping 200 days of data) [2025-09-26T17:55:19.667187] [DEBUG] [LOCAL ] CCS: Primary data saved (31155 records). [2025-09-26T17:55:19.667334] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-26T17:55:19.667448] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCS took 46.1s. Estimated remaining: 4h 16m 46s. Rate: 7.6 symbols/min [2025-09-26T17:55:19.854472] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:19.882418] [DEBUG] [LOCAL ] CDRE: Loaded 25608 existing records from primary storage. [2025-09-26T17:55:19.882607] [INFO ] [MAIN ] CDRE: Loaded 25608 existing records. [2025-09-26T17:55:19.966213] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-26T17:55:20.087600] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:20.087879] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-26T17:55:20.087930] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-26T17:55:20.088862] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-26T17:55:20.088927] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-26T17:55:20.497418] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:20.756693] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-26T17:55:20.797435] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T17:55:20.802279] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:55:20.800987] [INFO ] [REMOTE ] CDLR: Full fetch complete (13090 records). [2025-09-26T17:55:20.811092] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-26T17:55:21.247371] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-26T17:55:21.247476] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-26T17:55:21.247824] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-26T17:55:21.247888] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-26T17:55:21.248494] [DEBUG] [LOCAL ] CDLR: Trimmed 13090 records to 9966 (keeping 200 days of data) [2025-09-26T17:55:21.314020] [DEBUG] [LOCAL ] CDLR: Primary data saved (9966 records). [2025-09-26T17:55:21.314172] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-26T17:55:21.314265] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CDLR took 18.5s. Estimated remaining: 4h 16m 10s. Rate: 7.6 symbols/min [2025-09-26T17:55:21.492169] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:21.555241] [DEBUG] [LOCAL ] CE: Loaded 51931 existing records from primary storage. [2025-09-26T17:55:21.555419] [INFO ] [MAIN ] CE: Loaded 51931 existing records. [2025-09-26T17:55:21.561827] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-26T17:55:21.762893] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:21.763522] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-26T17:55:21.763694] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-26T17:55:21.770746] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-26T17:55:21.781721] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-26T17:55:21.782803] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T17:55:22.195572] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:22.356782] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-26T17:55:23.156746] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-26T17:55:23.761920] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T17:55:23.956725] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-26T17:55:24.177283] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T17:55:24.232045] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T17:55:24.756828] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-26T17:55:25.375592] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T17:55:25.556758] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-26T17:55:26.356782] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-26T17:55:26.494209] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T17:55:27.156776] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-26T17:55:27.579745] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T17:55:27.591603] [INFO ] [REMOTE ] CDE: Full fetch complete (77581 records). [2025-09-26T17:55:27.591866] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-26T17:55:27.900695] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:55:27.957082] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-26T17:55:28.082753] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-26T17:55:28.082873] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-26T17:55:28.084157] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-26T17:55:28.084231] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-26T17:55:28.086612] [DEBUG] [LOCAL ] CDE: Trimmed 77581 records to 54421 (keeping 200 days of data) [2025-09-26T17:55:28.440231] [DEBUG] [LOCAL ] CDE: Primary data saved (54421 records). [2025-09-26T17:55:28.440445] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-26T17:55:28.441826] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDE took 40.6s. Estimated remaining: 4h 15m 58s. Rate: 7.6 symbols/min [2025-09-26T17:55:28.618329] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:28.630927] [DEBUG] [LOCAL ] CEE: Loaded 6682 existing records from primary storage. [2025-09-26T17:55:28.631108] [INFO ] [MAIN ] CEE: Loaded 6682 existing records. [2025-09-26T17:55:28.761427] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-26T17:55:28.827251] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:28.828158] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-26T17:55:28.828338] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-26T17:55:28.835851] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-26T17:55:28.847404] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-26T17:55:28.899161] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T17:55:29.236218] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:29.267414] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-26T17:55:29.556774] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-26T17:55:30.246632] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T17:55:30.356710] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-26T17:55:30.713272] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T17:55:31.156798] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-26T17:55:31.556319] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T17:55:31.963707] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-26T17:55:31.988424] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:55:32.756705] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-26T17:55:33.140318] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T17:55:33.556764] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-26T17:55:34.361820] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-26T17:55:34.378856] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T17:55:34.431002] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T17:55:35.156765] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-26T17:55:35.835917] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T17:55:35.956728] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-26T17:55:36.545909] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T17:55:36.756771] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-26T17:55:37.103161] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T17:55:37.556802] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-26T17:55:38.057779] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T17:55:38.356770] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-26T17:55:38.613224] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T17:55:39.156788] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-26T17:55:39.329960] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T17:55:39.956770] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-26T17:55:40.756755] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-26T17:55:40.824021] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T17:55:41.097942] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:55:41.486777] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T17:55:41.556708] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-26T17:55:42.356747] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-26T17:55:42.871738] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T17:55:43.156794] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-26T17:55:43.845048] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:55:43.956753] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-26T17:55:44.380324] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T17:55:44.756734] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-26T17:55:45.199443] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T17:55:45.556740] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-26T17:55:46.270044] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T17:55:46.356703] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-26T17:55:46.584149] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T17:55:46.596195] [INFO ] [REMOTE ] CE: Full fetch complete (74886 records). [2025-09-26T17:55:46.596506] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-26T17:55:47.035675] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-26T17:55:47.035802] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-26T17:55:47.036755] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-26T17:55:47.036841] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-26T17:55:47.038528] [DEBUG] [LOCAL ] CE: Trimmed 74886 records to 52316 (keeping 200 days of data) [2025-09-26T17:55:47.156939] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-26T17:55:47.384121] [DEBUG] [LOCAL ] CE: Primary data saved (52316 records). [2025-09-26T17:55:47.384271] [INFO ] [MAIN ] CE: Full history saved. [2025-09-26T17:55:47.384414] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CE took 26.1s. Estimated remaining: 4h 16m 41s. Rate: 7.6 symbols/min [2025-09-26T17:55:47.567136] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:47.592598] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T17:55:47.622269] [DEBUG] [LOCAL ] CEPU: Loaded 26270 existing records from primary storage. [2025-09-26T17:55:47.622410] [INFO ] [MAIN ] CEPU: Loaded 26270 existing records. [2025-09-26T17:55:47.807383] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:47.807705] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-26T17:55:47.807764] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-26T17:55:47.808561] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-26T17:55:47.808626] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-26T17:55:47.961879] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-26T17:55:48.214984] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:48.642081] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T17:55:48.759735] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-26T17:55:48.761012] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T17:55:48.767058] [INFO ] [REMOTE ] CDRE: Full fetch complete (35341 records). [2025-09-26T17:55:48.767319] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-26T17:55:49.184775] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-26T17:55:49.184875] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-26T17:55:49.185363] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-26T17:55:49.185408] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-26T17:55:49.186554] [DEBUG] [LOCAL ] CDRE: Trimmed 35341 records to 25747 (keeping 200 days of data) [2025-09-26T17:55:49.352542] [DEBUG] [LOCAL ] CDRE: Primary data saved (25747 records). [2025-09-26T17:55:49.352779] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-26T17:55:49.352967] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDRE took 29.7s. Estimated remaining: 4h 16m 6s. Rate: 7.6 symbols/min [2025-09-26T17:55:49.552524] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:49.556762] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-26T17:55:49.632610] [DEBUG] [LOCAL ] CF: Loaded 52619 existing records from primary storage. [2025-09-26T17:55:49.632810] [INFO ] [MAIN ] CF: Loaded 52619 existing records. [2025-09-26T17:55:49.901148] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:49.901419] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-26T17:55:49.901476] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-26T17:55:49.903325] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-26T17:55:49.903399] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-26T17:55:50.301714] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T17:55:50.358349] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-26T17:55:50.431835] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:50.459669] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T17:55:50.468731] [INFO ] [REMOTE ] CDP: Full fetch complete (61871 records). [2025-09-26T17:55:50.468888] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-26T17:55:50.915077] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-26T17:55:50.915207] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-26T17:55:50.916168] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-26T17:55:50.916252] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-26T17:55:50.917903] [DEBUG] [LOCAL ] CDP: Trimmed 61871 records to 43357 (keeping 200 days of data) [2025-09-26T17:55:51.159223] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-26T17:55:51.197945] [DEBUG] [LOCAL ] CDP: Primary data saved (43357 records). [2025-09-26T17:55:51.198107] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-26T17:55:51.198226] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CDP took 40.0s. Estimated remaining: 4h 15m 30s. Rate: 7.6 symbols/min [2025-09-26T17:55:51.383069] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:51.440258] [DEBUG] [LOCAL ] CFG: Loaded 54014 existing records from primary storage. [2025-09-26T17:55:51.440431] [INFO ] [MAIN ] CFG: Loaded 54014 existing records. [2025-09-26T17:55:51.654276] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:55:51.655001] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-26T17:55:51.655071] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-26T17:55:51.656897] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-26T17:55:51.656962] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-26T17:55:51.961832] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-26T17:55:51.980634] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T17:55:52.092462] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:52.094379] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T17:55:52.756730] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-26T17:55:53.556723] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-26T17:55:53.824519] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T17:55:54.356779] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-26T17:55:54.613981] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T17:55:54.676146] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T17:55:55.156753] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-26T17:55:55.529934] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T17:55:55.956774] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-26T17:55:56.038959] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T17:55:56.676140] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T17:55:56.756726] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-26T17:55:57.184787] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T17:55:57.186216] [INFO ] [REMOTE ] CEE: Full fetch complete (10195 records). [2025-09-26T17:55:57.186287] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-26T17:55:57.565773] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-26T17:55:57.576473] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-26T17:55:57.576556] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-26T17:55:57.576988] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-26T17:55:57.577055] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-26T17:55:57.577847] [DEBUG] [LOCAL ] CEE: Trimmed 10195 records to 6697 (keeping 200 days of data) [2025-09-26T17:55:57.622298] [DEBUG] [LOCAL ] CEE: Primary data saved (6697 records). [2025-09-26T17:55:57.622447] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-26T17:55:57.622551] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CEE took 29.2s. Estimated remaining: 4h 15m 16s. Rate: 7.6 symbols/min [2025-09-26T17:55:57.809363] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:55:57.809605] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-26T17:55:57.809681] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-26T17:55:57.809836] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-26T17:55:57.809911] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-26T17:55:57.810008] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-26T17:55:57.810084] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-26T17:55:58.199192] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:55:58.356754] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-26T17:55:58.551908] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:55:58.552319] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-26T17:55:59.156732] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-26T17:55:59.208809] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:55:59.956746] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-26T17:56:00.162446] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:00.162829] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-26T17:56:00.756768] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-26T17:56:00.963853] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T17:56:01.556740] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-26T17:56:01.788322] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T17:56:02.356793] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-26T17:56:02.889618] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T17:56:03.117886] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T17:56:03.156767] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-26T17:56:03.371237] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:03.371603] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-26T17:56:03.956758] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-26T17:56:04.756762] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-26T17:56:05.556740] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-26T17:56:05.836829] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:05.837321] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-26T17:56:05.876401] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T17:56:06.356792] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-26T17:56:06.794071] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T17:56:07.156772] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-26T17:56:07.740628] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T17:56:07.956726] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-26T17:56:08.279797] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T17:56:08.756736] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-26T17:56:09.556719] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-26T17:56:09.740217] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T17:56:09.777278] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:09.777755] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-26T17:56:10.131781] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T17:56:10.356744] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-26T17:56:11.156816] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-26T17:56:11.955687] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T17:56:11.966071] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-26T17:56:12.190991] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:12.191376] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-26T17:56:12.500508] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T17:56:12.756779] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-26T17:56:12.975940] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:12.976367] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-26T17:56:13.556753] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-26T17:56:13.763359] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:56:13.763794] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-26T17:56:14.356785] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-26T17:56:15.156825] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-26T17:56:15.800793] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T17:56:15.956717] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-26T17:56:16.595945] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T17:56:16.756832] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-26T17:56:16.814054] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T17:56:17.556703] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-26T17:56:17.738147] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T17:56:18.356750] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-26T17:56:19.138325] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T17:56:19.156676] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-26T17:56:19.956742] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-26T17:56:20.248162] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T17:56:20.671117] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T17:56:20.686629] [INFO ] [REMOTE ] CF: Full fetch complete (75167 records). [2025-09-26T17:56:20.686907] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-26T17:56:20.764414] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-26T17:56:21.076195] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T17:56:21.184204] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-26T17:56:21.184321] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-26T17:56:21.185253] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-26T17:56:21.185336] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-26T17:56:21.187213] [DEBUG] [LOCAL ] CF: Trimmed 75167 records to 52983 (keeping 200 days of data) [2025-09-26T17:56:21.543465] [DEBUG] [LOCAL ] CF: Primary data saved (52983 records). [2025-09-26T17:56:21.543728] [INFO ] [MAIN ] CF: Full history saved. [2025-09-26T17:56:21.543923] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CF took 32.2s. Estimated remaining: 4h 16m 21s. Rate: 7.6 symbols/min [2025-09-26T17:56:21.561952] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-26T17:56:21.750040] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:21.790578] [DEBUG] [LOCAL ] CFR: Loaded 33773 existing records from primary storage. [2025-09-26T17:56:21.790857] [INFO ] [MAIN ] CFR: Loaded 33773 existing records. [2025-09-26T17:56:22.000971] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:22.001531] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-26T17:56:22.001761] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-26T17:56:22.003129] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-26T17:56:22.003211] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-26T17:56:22.358288] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-26T17:56:22.408147] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:22.442620] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T17:56:22.474048] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T17:56:23.117049] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T17:56:23.119142] [INFO ] [REMOTE ] CFND: Full fetch complete (2576 records). [2025-09-26T17:56:23.119218] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-26T17:56:23.161970] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-26T17:56:23.323398] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 36 unique days, need 200 days [2025-09-26T17:56:23.323636] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:56:23.323735] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:56:23.323808] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-26T17:56:23.323880] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-26T17:56:23.324092] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-26T17:56:23.324548] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-26T17:56:23.324828] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CFND took 25.7s. Estimated remaining: 4h 15m 45s. Rate: 7.6 symbols/min [2025-09-26T17:56:23.540043] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:23.595259] [DEBUG] [LOCAL ] CGAU: Loaded 43062 existing records from primary storage. [2025-09-26T17:56:23.595424] [INFO ] [MAIN ] CGAU: Loaded 43062 existing records. [2025-09-26T17:56:23.786111] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:23.786397] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-26T17:56:23.786461] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-26T17:56:23.787808] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-26T17:56:23.787879] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-26T17:56:23.963890] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-26T17:56:24.204362] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:24.756760] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-26T17:56:24.851687] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T17:56:25.261832] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T17:56:25.556725] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-26T17:56:25.938626] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T17:56:25.945882] [INFO ] [REMOTE ] CEPU: Full fetch complete (39644 records). [2025-09-26T17:56:25.946113] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-26T17:56:26.361978] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-26T17:56:26.378639] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-26T17:56:26.378794] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-26T17:56:26.379365] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-26T17:56:26.379437] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-26T17:56:26.380546] [DEBUG] [LOCAL ] CEPU: Trimmed 39644 records to 26454 (keeping 200 days of data) [2025-09-26T17:56:26.540632] [DEBUG] [LOCAL ] CEPU: Primary data saved (26454 records). [2025-09-26T17:56:26.540974] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-26T17:56:26.541112] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CEPU took 39.2s. Estimated remaining: 4h 15m 16s. Rate: 7.6 symbols/min [2025-09-26T17:56:26.752866] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:26.755722] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T17:56:26.768410] [DEBUG] [LOCAL ] CGV: Loaded 1421 existing records from primary storage. [2025-09-26T17:56:26.768529] [INFO ] [MAIN ] CGV: Loaded 1421 existing records. [2025-09-26T17:56:26.958792] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:26.959053] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-26T17:56:26.959102] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-26T17:56:26.959361] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-26T17:56:26.959422] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-26T17:56:27.168570] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-26T17:56:27.363879] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:27.956826] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-26T17:56:28.067565] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T17:56:28.078574] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-26T17:56:28.078767] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-26T17:56:28.563122] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-26T17:56:28.563312] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-26T17:56:28.565044] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-26T17:56:28.565171] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-26T17:56:28.593571] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T17:56:28.602852] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54404 (keeping 200 days of data) [2025-09-26T17:56:28.800380] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-26T17:56:28.886119] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T17:56:29.005293] [DEBUG] [LOCAL ] CFG: Primary data saved (54404 records). [2025-09-26T17:56:29.005466] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-26T17:56:29.005585] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFG took 37.8s. Estimated remaining: 4h 14m 44s. Rate: 7.6 symbols/min [2025-09-26T17:56:29.216484] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:29.243368] [DEBUG] [LOCAL ] CHCT: Loaded 24167 existing records from primary storage. [2025-09-26T17:56:29.243523] [INFO ] [MAIN ] CHCT: Loaded 24167 existing records. [2025-09-26T17:56:29.434159] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:29.434481] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-26T17:56:29.434531] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-26T17:56:29.435744] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-26T17:56:29.435856] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-26T17:56:29.561889] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-26T17:56:29.837263] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:30.143086] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:56:30.356801] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-26T17:56:30.647573] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T17:56:30.945752] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T17:56:31.156725] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-26T17:56:31.614743] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T17:56:31.956730] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-26T17:56:32.434742] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T17:56:32.756736] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-26T17:56:33.556737] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-26T17:56:33.885809] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T17:56:34.356733] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-26T17:56:34.783736] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T17:56:35.156742] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-26T17:56:35.632707] [DEBUG] [REMOTE ] CGV: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-26T17:56:35.633036] [WARN ] [REMOTE ] CGV: No data returned for month 2025-03 [2025-09-26T17:56:35.658840] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:56:35.956727] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-26T17:56:36.756720] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-26T17:56:37.495103] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T17:56:37.556723] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-26T17:56:38.356710] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-26T17:56:38.405965] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T17:56:39.156719] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-26T17:56:39.325614] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:56:39.375917] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T17:56:39.956737] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-26T17:56:39.976816] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T17:56:40.756735] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-26T17:56:41.083677] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T17:56:41.556751] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-26T17:56:42.089057] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T17:56:42.260280] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:56:42.356728] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-26T17:56:43.156727] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-26T17:56:43.527015] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T17:56:43.538317] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-26T17:56:43.956756] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-26T17:56:44.308384] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-26T17:56:44.756726] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-26T17:56:45.191029] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-26T17:56:45.556736] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-26T17:56:46.356724] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-26T17:56:46.830699] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:56:47.156735] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-26T17:56:47.255201] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T17:56:47.956730] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-26T17:56:48.249003] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T17:56:48.620495] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T17:56:48.756716] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-26T17:56:49.556721] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-26T17:56:49.988425] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T17:56:50.008110] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T17:56:50.356741] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-26T17:56:51.156775] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-26T17:56:51.824490] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T17:56:51.956737] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-26T17:56:51.975874] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T17:56:52.756752] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-26T17:56:53.565870] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-26T17:56:53.569238] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:56:53.577279] [INFO ] [REMOTE ] CFR: Full fetch complete (48534 records). [2025-09-26T17:56:53.577498] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-26T17:56:53.984969] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-26T17:56:53.985299] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-26T17:56:53.986093] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-26T17:56:53.986233] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-26T17:56:53.997750] [DEBUG] [LOCAL ] CFR: Trimmed 48534 records to 33971 (keeping 200 days of data) [2025-09-26T17:56:54.015864] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:56:54.256733] [DEBUG] [LOCAL ] CFR: Primary data saved (33971 records). [2025-09-26T17:56:54.257194] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-26T17:56:54.257422] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFR took 32.7s. Estimated remaining: 4h 15m 54s. Rate: 7.6 symbols/min [2025-09-26T17:56:54.362949] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-26T17:56:54.513176] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:54.535171] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T17:56:54.543073] [INFO ] [REMOTE ] CHCT: Full fetch complete (35008 records). [2025-09-26T17:56:54.543274] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-26T17:56:54.901135] [DEBUG] [LOCAL ] CHD: Loaded 52397 existing records from primary storage. [2025-09-26T17:56:54.918942] [INFO ] [MAIN ] CHD: Loaded 52397 existing records. [2025-09-26T17:56:54.918826] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T17:56:55.157363] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-26T17:56:55.405620] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:55.405825] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-26T17:56:55.405988] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-26T17:56:55.406673] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-26T17:56:55.406860] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-26T17:56:55.406946] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-26T17:56:55.407017] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-26T17:56:55.408045] [DEBUG] [LOCAL ] CHCT: Trimmed 35008 records to 24309 (keeping 200 days of data) [2025-09-26T17:56:55.409094] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-26T17:56:55.409161] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-26T17:56:55.822297] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-26T17:56:55.871240] [INFO ] [REMOTE ] CGV: Full fetch complete (2059 records). [2025-09-26T17:56:55.882174] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-26T17:56:55.960132] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-26T17:56:56.056422] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:56.218326] [DEBUG] [LOCAL ] CHCT: Primary data saved (24309 records). [2025-09-26T17:56:56.218452] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-26T17:56:56.218579] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CHCT took 27.2s. Estimated remaining: 4h 15m 20s. Rate: 7.6 symbols/min [2025-09-26T17:56:56.213196] [WARN ] [VALIDATOR ] CGV: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T17:56:56.219007] [FATAL] [MAIN ] CGV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:56:56.224225] [WARN ] [MAIN ] CGV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:56:56.255090] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-26T17:56:56.305317] [DEBUG] [LOCAL ] CGV: No primary data file found to delete. [2025-09-26T17:56:56.324342] [INFO ] [LOCAL ] CGV: Starting deletion of derivative data. [2025-09-26T17:56:56.342533] [DEBUG] [LOCAL ] CGV: Deleted derivative data file. [2025-09-26T17:56:56.352913] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CGV took 29.8s. Estimated remaining: 4h 14m 37s. Rate: 7.6 symbols/min [2025-09-26T17:56:56.515784] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:56.592306] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:56:56.605673] [DEBUG] [LOCAL ] CHE: Loaded 14915 existing records from primary storage. [2025-09-26T17:56:56.605860] [INFO ] [MAIN ] CHE: Loaded 14915 existing records. [2025-09-26T17:56:56.760760] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-26T17:56:56.823897] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:56.824205] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-26T17:56:56.824261] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-26T17:56:56.824845] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-26T17:56:56.824911] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-26T17:56:56.987497] [DEBUG] [LOCAL ] CHGG: Loaded 48072 existing records from primary storage. [2025-09-26T17:56:57.011359] [INFO ] [MAIN ] CHGG: Loaded 48072 existing records. [2025-09-26T17:56:57.462606] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:57.468628] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:56:57.469429] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-26T17:56:57.469601] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-26T17:56:57.470854] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-26T17:56:57.470917] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-26T17:56:57.566337] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-26T17:56:57.905101] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:56:57.907133] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T17:56:58.180694] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T17:56:58.356710] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-26T17:56:58.558318] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T17:56:59.156708] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-26T17:56:59.229812] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T17:56:59.956725] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-26T17:57:00.756726] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-26T17:57:00.794686] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T17:57:00.814147] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T17:57:01.556725] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-26T17:57:02.356724] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-26T17:57:02.761802] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-26T17:57:02.825434] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T17:57:03.156748] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-26T17:57:03.956697] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-26T17:57:04.097991] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T17:57:04.169942] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:57:04.180348] [INFO ] [REMOTE ] CGAU: Full fetch complete (60681 records). [2025-09-26T17:57:04.180534] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-26T17:57:04.652449] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-26T17:57:04.652553] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-26T17:57:04.653274] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-26T17:57:04.653341] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-26T17:57:04.654813] [DEBUG] [LOCAL ] CGAU: Trimmed 60681 records to 43406 (keeping 200 days of data) [2025-09-26T17:57:04.763474] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-26T17:57:04.942224] [DEBUG] [LOCAL ] CGAU: Primary data saved (43406 records). [2025-09-26T17:57:04.942430] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-26T17:57:04.943936] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CGAU took 41.6s. Estimated remaining: 4h 14m 32s. Rate: 7.6 symbols/min [2025-09-26T17:57:05.125739] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:05.173905] [DEBUG] [LOCAL ] CHH: Loaded 32491 existing records from primary storage. [2025-09-26T17:57:05.174076] [INFO ] [MAIN ] CHH: Loaded 32491 existing records. [2025-09-26T17:57:05.369365] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:05.369929] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-26T17:57:05.370043] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-26T17:57:05.371301] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-26T17:57:05.371379] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-26T17:57:05.562852] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-26T17:57:05.794536] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T17:57:05.825897] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:05.852864] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T17:57:06.356777] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-26T17:57:07.156755] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-26T17:57:07.357742] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-26T17:57:07.453405] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T17:57:07.956735] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-26T17:57:08.411992] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T17:57:08.756693] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-26T17:57:09.071941] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T17:57:09.556748] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-26T17:57:10.356701] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-26T17:57:10.685082] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T17:57:10.750533] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T17:57:11.156784] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-26T17:57:11.956740] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-26T17:57:12.359966] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T17:57:12.441934] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T17:57:12.756717] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-26T17:57:13.194441] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T17:57:13.563144] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-26T17:57:13.566838] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T17:57:14.356760] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-26T17:57:15.156713] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-26T17:57:15.325955] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T17:57:15.400066] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:57:15.956738] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-26T17:57:16.756959] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-26T17:57:16.759938] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:57:17.266983] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T17:57:17.556734] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-26T17:57:18.296237] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T17:57:18.356732] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-26T17:57:18.905001] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T17:57:19.156734] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-26T17:57:19.956766] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-26T17:57:20.209961] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T17:57:20.756750] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-26T17:57:20.983706] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T17:57:21.181061] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T17:57:21.556741] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-26T17:57:21.621260] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T17:57:21.625583] [INFO ] [REMOTE ] CHE: Full fetch complete (19747 records). [2025-09-26T17:57:21.625753] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-26T17:57:22.034732] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-26T17:57:22.034875] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-26T17:57:22.035310] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-26T17:57:22.035360] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-26T17:57:22.036492] [DEBUG] [LOCAL ] CHE: Trimmed 19747 records to 14983 (keeping 200 days of data) [2025-09-26T17:57:22.139165] [DEBUG] [LOCAL ] CHE: Primary data saved (14983 records). [2025-09-26T17:57:22.139344] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-26T17:57:22.139444] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHE took 25.9s. Estimated remaining: 4h 15m 6s. Rate: 7.6 symbols/min [2025-09-26T17:57:22.321805] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:22.344493] [DEBUG] [LOCAL ] CHMI: Loaded 22183 existing records from primary storage. [2025-09-26T17:57:22.344703] [INFO ] [MAIN ] CHMI: Loaded 22183 existing records. [2025-09-26T17:57:22.366070] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-26T17:57:22.539206] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:22.539494] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-26T17:57:22.539544] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-26T17:57:22.540274] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-26T17:57:22.540338] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-26T17:57:22.903874] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:23.156743] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-26T17:57:23.323503] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T17:57:23.597686] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T17:57:23.956735] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-26T17:57:24.110711] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T17:57:24.756724] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-26T17:57:25.094303] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T17:57:25.556732] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-26T17:57:26.117878] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T17:57:26.356725] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-26T17:57:27.159123] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-26T17:57:27.164837] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T17:57:27.175594] [INFO ] [REMOTE ] CHD: Full fetch complete (74372 records). [2025-09-26T17:57:27.175790] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-26T17:57:27.586111] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-26T17:57:27.586220] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-26T17:57:27.587150] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-26T17:57:27.587222] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-26T17:57:27.588836] [DEBUG] [LOCAL ] CHD: Trimmed 74372 records to 52767 (keeping 200 days of data) [2025-09-26T17:57:27.929971] [DEBUG] [LOCAL ] CHD: Primary data saved (52767 records). [2025-09-26T17:57:27.930247] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-26T17:57:27.930408] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHD took 33.7s. Estimated remaining: 4h 14m 49s. Rate: 7.6 symbols/min [2025-09-26T17:57:27.965695] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-26T17:57:28.125033] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:28.168118] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T17:57:28.172561] [DEBUG] [LOCAL ] CHN: Loaded 4885 existing records from primary storage. [2025-09-26T17:57:28.183604] [INFO ] [MAIN ] CHN: Loaded 4885 existing records. [2025-09-26T17:57:28.214119] [INFO ] [REMOTE ] CHGG: Full fetch complete (70626 records). [2025-09-26T17:57:28.258427] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-26T17:57:28.545262] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:28.572228] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-26T17:57:28.585909] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-26T17:57:28.603858] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-26T17:57:28.608174] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-26T17:57:29.039271] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-26T17:57:29.040920] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-26T17:57:29.068124] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-26T17:57:29.068421] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-26T17:57:29.183867] [DEBUG] [LOCAL ] CHGG: Trimmed 70626 records to 48434 (keeping 200 days of data) [2025-09-26T17:57:29.331734] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:29.366106] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-26T17:57:29.394947] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T17:57:29.524451] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-26T17:57:29.557670] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-26T17:57:29.618347] [DEBUG] [LOCAL ] CHGG: Primary data saved (48434 records). [2025-09-26T17:57:29.618505] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-26T17:57:29.620444] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHGG took 33.3s. Estimated remaining: 4h 14m 13s. Rate: 7.6 symbols/min [2025-09-26T17:57:29.917427] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-26T17:57:30.356741] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-26T17:57:30.519249] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T17:57:31.156732] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-26T17:57:31.638475] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T17:57:31.956725] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-26T17:57:32.596215] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T17:57:32.756726] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-26T17:57:32.832746] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T17:57:33.556723] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-26T17:57:33.754102] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T17:57:33.760536] [INFO ] [REMOTE ] CHH: Full fetch complete (46449 records). [2025-09-26T17:57:33.760682] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-26T17:57:34.163064] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-26T17:57:34.163171] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-26T17:57:34.163862] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-26T17:57:34.163926] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-26T17:57:34.165146] [DEBUG] [LOCAL ] CHH: Trimmed 46449 records to 32744 (keeping 200 days of data) [2025-09-26T17:57:34.356937] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-26T17:57:34.377812] [DEBUG] [LOCAL ] CHH: Primary data saved (32744 records). [2025-09-26T17:57:34.377972] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-26T17:57:34.379805] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHH took 29.4s. Estimated remaining: 4h 13m 51s. Rate: 7.6 symbols/min [2025-09-26T17:57:34.659189] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T17:57:34.786902] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T17:57:35.156754] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-26T17:57:35.559437] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-26T17:57:35.956722] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-26T17:57:36.756725] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-26T17:57:37.159109] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-26T17:57:37.322837] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T17:57:37.556729] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-26T17:57:38.356748] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-26T17:57:38.527267] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T17:57:38.768613] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-26T17:57:39.156735] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-26T17:57:39.762984] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T17:57:39.956727] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-26T17:57:40.592607] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T17:57:40.756723] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-26T17:57:41.321816] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T17:57:41.556734] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-26T17:57:42.273867] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T17:57:42.356717] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-26T17:57:43.058089] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T17:57:43.059747] [INFO ] [REMOTE ] CHN: Full fetch complete (7628 records). [2025-09-26T17:57:43.059821] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-26T17:57:43.163607] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-26T17:57:43.463976] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-26T17:57:43.464063] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-26T17:57:43.464263] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-26T17:57:43.464303] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-26T17:57:43.464868] [DEBUG] [LOCAL ] CHN: Trimmed 7628 records to 4900 (keeping 200 days of data) [2025-09-26T17:57:43.496477] [DEBUG] [LOCAL ] CHN: Primary data saved (4900 records). [2025-09-26T17:57:43.496639] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-26T17:57:43.496780] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHN took 15.6s. Estimated remaining: 4h 13m 49s. Rate: 7.6 symbols/min [2025-09-26T17:57:44.236892] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T17:57:44.241990] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-26T17:57:45.109671] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T17:57:45.114623] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-26T17:57:46.195619] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T17:57:46.200470] [INFO ] [REMOTE ] CHMI: Full fetch complete (31680 records). [2025-09-26T17:57:46.200578] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-26T17:57:46.599097] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-26T17:57:46.599221] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-26T17:57:46.599735] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-26T17:57:46.599800] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-26T17:57:46.600737] [DEBUG] [LOCAL ] CHMI: Trimmed 31680 records to 22359 (keeping 200 days of data) [2025-09-26T17:57:46.737526] [DEBUG] [LOCAL ] CHMI: Primary data saved (22359 records). [2025-09-26T17:57:46.737716] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-26T17:57:46.737823] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 24.6s. Estimated remaining: 4h 13m 21s. Rate: 7.6 symbols/min [2025-09-26T17:57:47.353282] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:47.524825] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:47.530134] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:47.551814] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:57:47.580866] [DEBUG] [LOCAL ] CHT: Loaded 19677 existing records from primary storage. [2025-09-26T17:57:47.581095] [INFO ] [MAIN ] CHT: Loaded 19677 existing records. [2025-09-26T17:57:47.870385] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:47.866479] [DEBUG] [LOCAL ] CHPT: Loaded 49531 existing records from primary storage. [2025-09-26T17:57:47.871225] [INFO ] [MAIN ] CHPT: Loaded 49531 existing records. [2025-09-26T17:57:47.872369] [DEBUG] [LOCAL ] CHWY: Loaded 54044 existing records from primary storage. [2025-09-26T17:57:47.895903] [INFO ] [MAIN ] CHWY: Loaded 54044 existing records. [2025-09-26T17:57:47.871524] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-26T17:57:47.897168] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-26T17:57:47.958503] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-26T17:57:47.974145] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-26T17:57:47.974052] [DEBUG] [LOCAL ] CI: Loaded 50220 existing records from primary storage. [2025-09-26T17:57:48.030043] [INFO ] [MAIN ] CI: Loaded 50220 existing records. [2025-09-26T17:57:48.515801] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:48.546778] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:48.578626] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-26T17:57:48.579013] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-26T17:57:48.603048] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-26T17:57:48.649236] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-26T17:57:48.653380] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-26T17:57:48.653747] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-26T17:57:48.653909] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:57:48.659199] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-26T17:57:48.724031] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-26T17:57:48.738832] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-26T17:57:48.755012] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-26T17:57:48.795105] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-26T17:57:48.869010] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-26T17:57:49.298628] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:49.404313] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-26T17:57:49.900237] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:49.925078] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-26T17:57:49.992966] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:50.009734] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-26T17:57:50.039421] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:57:50.040007] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-26T17:57:50.307054] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T17:57:50.311329] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-26T17:57:50.988611] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-26T17:57:50.992578] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-26T17:57:51.667402] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T17:57:51.672124] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-26T17:57:51.704402] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T17:57:51.717130] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-26T17:57:51.925700] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T17:57:51.956695] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-26T17:57:52.050425] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-26T17:57:52.398568] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T17:57:52.756786] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-26T17:57:53.054959] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T17:57:53.556742] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-26T17:57:54.153732] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-26T17:57:54.224886] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T17:57:54.356747] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-26T17:57:54.828263] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T17:57:55.156781] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-26T17:57:55.956763] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-26T17:57:56.471690] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T17:57:56.511113] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-26T17:57:56.756738] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-26T17:57:57.255961] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:57:57.445043] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T17:57:57.556691] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-26T17:57:58.356705] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-26T17:57:58.557538] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T17:57:59.156734] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-26T17:57:59.961856] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-26T17:57:59.988567] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:58:00.756690] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-26T17:58:00.827435] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T17:58:00.989846] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T17:58:01.556728] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-26T17:58:02.356730] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-26T17:58:02.477459] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T17:58:02.690504] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T17:58:03.156730] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-26T17:58:03.956731] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-26T17:58:04.119302] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T17:58:04.742412] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T17:58:04.756678] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-26T17:58:05.450455] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T17:58:05.556739] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-26T17:58:06.355414] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T17:58:06.363271] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-26T17:58:06.382205] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T17:58:06.387194] [INFO ] [REMOTE ] CHT: Full fetch complete (27299 records). [2025-09-26T17:58:06.387396] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-26T17:58:06.924508] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-26T17:58:06.924813] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-26T17:58:06.925520] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-26T17:58:06.925618] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-26T17:58:06.927019] [DEBUG] [LOCAL ] CHT: Trimmed 27299 records to 19816 (keeping 200 days of data) [2025-09-26T17:58:07.081473] [DEBUG] [LOCAL ] CHT: Primary data saved (19816 records). [2025-09-26T17:58:07.081681] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-26T17:58:07.081860] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHT took 20.3s. Estimated remaining: 4h 14m 7s. Rate: 7.6 symbols/min [2025-09-26T17:58:07.161959] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-26T17:58:07.367596] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:07.388686] [DEBUG] [LOCAL ] CIA: Loaded 17101 existing records from primary storage. [2025-09-26T17:58:07.388850] [INFO ] [MAIN ] CIA: Loaded 17101 existing records. [2025-09-26T17:58:07.604781] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:07.605150] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-26T17:58:07.605223] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-26T17:58:07.606107] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-26T17:58:07.606180] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-26T17:58:07.961821] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-26T17:58:08.006968] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:08.684927] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-26T17:58:08.756781] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-26T17:58:09.171118] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T17:58:09.379114] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T17:58:09.398149] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T17:58:09.556718] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-26T17:58:10.356752] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-26T17:58:10.416463] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T17:58:11.156775] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-26T17:58:11.956734] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-26T17:58:12.309889] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T17:58:12.470668] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T17:58:12.756734] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-26T17:58:12.939830] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T17:58:13.556756] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-26T17:58:14.252540] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T17:58:14.356754] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-26T17:58:14.728444] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T17:58:14.997213] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T17:58:15.156734] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-26T17:58:15.805077] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T17:58:15.956742] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-26T17:58:16.756722] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-26T17:58:17.556744] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-26T17:58:17.996547] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T17:58:18.023820] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T17:58:18.356766] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-26T17:58:19.081965] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T17:58:19.156742] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-26T17:58:19.682738] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T17:58:19.956735] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-26T17:58:20.420876] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T17:58:20.756733] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-26T17:58:21.477348] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T17:58:21.556718] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-26T17:58:21.673913] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T17:58:21.684413] [INFO ] [REMOTE ] CI: Full fetch complete (72510 records). [2025-09-26T17:58:21.684570] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-26T17:58:22.109209] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-26T17:58:22.109323] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-26T17:58:22.110552] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-26T17:58:22.110671] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-26T17:58:22.113079] [DEBUG] [LOCAL ] CI: Trimmed 72510 records to 50561 (keeping 200 days of data) [2025-09-26T17:58:22.219916] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-26T17:58:22.224793] [INFO ] [REMOTE ] CIA: Full fetch complete (23452 records). [2025-09-26T17:58:22.225401] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-26T17:58:22.360462] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-26T17:58:22.645843] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-26T17:58:22.646184] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-26T17:58:22.646920] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-26T17:58:22.648826] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-26T17:58:22.651555] [DEBUG] [LOCAL ] CIA: Trimmed 23452 records to 17213 (keeping 200 days of data) [2025-09-26T17:58:22.851482] [DEBUG] [LOCAL ] CIA: Primary data saved (17213 records). [2025-09-26T17:58:22.852237] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-26T17:58:22.853161] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CIA took 15.8s. Estimated remaining: 4h 14m 34s. Rate: 7.6 symbols/min [2025-09-26T17:58:23.051313] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:23.105274] [DEBUG] [LOCAL ] CIB: Loaded 31225 existing records from primary storage. [2025-09-26T17:58:23.133236] [INFO ] [MAIN ] CIB: Loaded 31225 existing records. [2025-09-26T17:58:23.157745] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-26T17:58:23.346860] [DEBUG] [LOCAL ] CI: Primary data saved (50561 records). [2025-09-26T17:58:23.359217] [INFO ] [MAIN ] CI: Full history saved. [2025-09-26T17:58:23.380382] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CI took 36.6s. Estimated remaining: 4h 13m 54s. Rate: 7.6 symbols/min [2025-09-26T17:58:23.380518] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:23.380819] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-26T17:58:23.381224] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-26T17:58:23.455493] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-26T17:58:23.466978] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-26T17:58:23.699833] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:23.719118] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-26T17:58:23.730233] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-26T17:58:23.773962] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-26T17:58:23.820544] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-26T17:58:23.842308] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-26T17:58:23.859411] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-26T17:58:24.075616] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:24.096892] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-26T17:58:24.351366] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:24.376406] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-26T17:58:24.756758] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-26T17:58:25.289270] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T17:58:25.446378] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T17:58:25.556724] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-26T17:58:26.356730] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-26T17:58:26.610600] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T17:58:26.619946] [INFO ] [REMOTE ] CHPT: Full fetch complete (73097 records). [2025-09-26T17:58:26.620204] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-26T17:58:26.969078] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T17:58:27.077326] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-26T17:58:27.077428] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-26T17:58:27.078235] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-26T17:58:27.078314] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-26T17:58:27.079898] [DEBUG] [LOCAL ] CHPT: Trimmed 73097 records to 49765 (keeping 200 days of data) [2025-09-26T17:58:27.166461] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-26T17:58:27.378713] [DEBUG] [LOCAL ] CHPT: Primary data saved (49765 records). [2025-09-26T17:58:27.378864] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-26T17:58:27.378987] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHPT took 40.6s. Estimated remaining: 4h 13m 29s. Rate: 7.6 symbols/min [2025-09-26T17:58:27.557451] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:27.592336] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T17:58:27.612930] [DEBUG] [LOCAL ] CIEN: Loaded 52465 existing records from primary storage. [2025-09-26T17:58:27.613088] [INFO ] [MAIN ] CIEN: Loaded 52465 existing records. [2025-09-26T17:58:27.799416] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:27.799723] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-26T17:58:27.799782] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-26T17:58:27.801238] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-26T17:58:27.801303] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-26T17:58:27.966783] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-26T17:58:28.195607] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:28.324626] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T17:58:28.339551] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-26T17:58:28.339736] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-26T17:58:28.341389] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-26T17:58:28.751170] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-26T17:58:28.751256] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-26T17:58:28.752169] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-26T17:58:28.752258] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-26T17:58:28.753874] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 54434 (keeping 200 days of data) [2025-09-26T17:58:28.803033] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-26T17:58:29.076199] [DEBUG] [LOCAL ] CHWY: Primary data saved (54434 records). [2025-09-26T17:58:29.076360] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-26T17:58:29.076458] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CHWY took 42.3s. Estimated remaining: 4h 12m 54s. Rate: 7.6 symbols/min [2025-09-26T17:58:29.180960] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T17:58:29.266401] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:29.272591] [DEBUG] [LOCAL ] CIF: Loaded 4369 existing records from primary storage. [2025-09-26T17:58:29.272726] [INFO ] [MAIN ] CIF: Loaded 4369 existing records. [2025-09-26T17:58:29.457848] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:29.458129] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-26T17:58:29.458178] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-26T17:58:29.458553] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-26T17:58:29.458614] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-26T17:58:29.564255] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-26T17:58:29.836816] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:29.886320] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-26T17:58:30.356750] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-26T17:58:30.959442] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T17:58:31.156786] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-26T17:58:31.606502] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T17:58:31.956738] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-26T17:58:32.756733] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-26T17:58:33.556733] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-26T17:58:33.741779] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T17:58:33.798554] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T17:58:33.878877] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-26T17:58:34.356725] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-26T17:58:34.666272] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-26T17:58:35.156757] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-26T17:58:35.596011] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T17:58:35.956742] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-26T17:58:36.650107] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T17:58:36.756728] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-26T17:58:37.025295] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-26T17:58:37.556730] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-26T17:58:38.356756] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-26T17:58:38.788725] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T17:58:39.156710] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-26T17:58:39.187450] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T17:58:39.652997] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T17:58:39.654213] [INFO ] [REMOTE ] CICB: Full fetch complete (2111 records). [2025-09-26T17:58:39.654314] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-26T17:58:39.860524] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T17:58:39.860767] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:58:39.860841] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:58:39.860915] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-26T17:58:39.860996] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-26T17:58:39.861067] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-26T17:58:39.861152] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-26T17:58:39.861288] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CICB took 16.5s. Estimated remaining: 4h 12m 59s. Rate: 7.6 symbols/min [2025-09-26T17:58:39.961887] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-26T17:58:40.046416] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:40.094988] [DEBUG] [LOCAL ] CIG: Loaded 44114 existing records from primary storage. [2025-09-26T17:58:40.095136] [INFO ] [MAIN ] CIG: Loaded 44114 existing records. [2025-09-26T17:58:40.288055] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:40.288393] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-26T17:58:40.288471] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-26T17:58:40.289908] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-26T17:58:40.289972] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-26T17:58:40.706221] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:40.756729] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-26T17:58:41.556716] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-26T17:58:41.818661] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T17:58:41.893279] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T17:58:42.103221] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T17:58:42.356729] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-26T17:58:43.156746] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-26T17:58:43.715502] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T17:58:43.717307] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T17:58:43.956725] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-26T17:58:44.756707] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-26T17:58:45.366498] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T17:58:45.556725] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-26T17:58:45.638106] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T17:58:46.356737] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-26T17:58:46.541742] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T17:58:47.156763] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-26T17:58:47.546615] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-26T17:58:47.928110] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T17:58:47.956712] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-26T17:58:48.756757] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-26T17:58:49.556732] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-26T17:58:49.765883] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T17:58:50.292860] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T17:58:50.356769] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-26T17:58:50.848055] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T17:58:50.953667] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T17:58:51.156747] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-26T17:58:51.956758] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-26T17:58:52.427861] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T17:58:52.756735] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-26T17:58:53.359436] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T17:58:53.363662] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T17:58:53.556722] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-26T17:58:54.356726] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-26T17:58:54.705756] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T17:58:54.712551] [INFO ] [REMOTE ] CIB: Full fetch complete (44421 records). [2025-09-26T17:58:54.712726] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-26T17:58:54.832378] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-26T17:58:54.849883] [INFO ] [REMOTE ] CIF: Full fetch complete (6604 records). [2025-09-26T17:58:54.868795] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-26T17:58:55.165348] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-26T17:58:55.462620] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-26T17:58:55.503199] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-26T17:58:55.532566] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-26T17:58:55.538806] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-26T17:58:55.538537] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-26T17:58:55.539197] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-26T17:58:55.539379] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-26T17:58:55.539880] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-26T17:58:55.541148] [DEBUG] [LOCAL ] CIF: Trimmed 6604 records to 4396 (keeping 200 days of data) [2025-09-26T17:58:55.552496] [DEBUG] [LOCAL ] CIB: Trimmed 44421 records to 31435 (keeping 200 days of data) [2025-09-26T17:58:55.628002] [DEBUG] [LOCAL ] CIF: Primary data saved (4396 records). [2025-09-26T17:58:55.653916] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-26T17:58:55.657776] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIF took 26.6s. Estimated remaining: 4h 13m 25s. Rate: 7.6 symbols/min [2025-09-26T17:58:55.936801] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:55.946917] [DEBUG] [LOCAL ] CIB: Primary data saved (31435 records). [2025-09-26T17:58:55.947082] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-26T17:58:55.947222] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIB took 33.1s. Estimated remaining: 4h 12m 45s. Rate: 7.6 symbols/min [2025-09-26T17:58:55.961857] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-26T17:58:56.070866] [DEBUG] [LOCAL ] CII: Loaded 15570 existing records from primary storage. [2025-09-26T17:58:56.086713] [INFO ] [MAIN ] CII: Loaded 15570 existing records. [2025-09-26T17:58:56.250184] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:58:56.341150] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:56.341731] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-26T17:58:56.341800] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-26T17:58:56.342782] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-26T17:58:56.342849] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-26T17:58:56.523965] [DEBUG] [LOCAL ] CIM: Loaded 37567 existing records from primary storage. [2025-09-26T17:58:56.532999] [INFO ] [MAIN ] CIM: Loaded 37567 existing records. [2025-09-26T17:58:56.946848] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:58:56.969951] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:56.970459] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-26T17:58:56.971570] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-26T17:58:56.971794] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-26T17:58:56.973407] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-26T17:58:56.973498] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-26T17:58:57.401324] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:58:57.403882] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-26T17:58:57.437388] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T17:58:57.556722] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-26T17:58:58.175923] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T17:58:58.356760] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-26T17:58:58.986757] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T17:58:59.156753] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-26T17:58:59.367146] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T17:58:59.956797] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-26T17:59:00.756770] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-26T17:59:01.050512] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T17:59:01.261616] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T17:59:01.556723] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-26T17:59:01.928527] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T17:59:02.356762] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-26T17:59:02.742939] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T17:59:03.156756] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-26T17:59:03.879489] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T17:59:03.956688] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-26T17:59:04.084249] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T17:59:04.094882] [INFO ] [REMOTE ] CIEN: Full fetch complete (75579 records). [2025-09-26T17:59:04.095047] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-26T17:59:04.551036] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-26T17:59:04.551223] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-26T17:59:04.552281] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-26T17:59:04.552394] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-26T17:59:04.559016] [DEBUG] [LOCAL ] CIEN: Trimmed 75579 records to 52854 (keeping 200 days of data) [2025-09-26T17:59:04.770451] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-26T17:59:04.770317] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T17:59:04.931586] [DEBUG] [LOCAL ] CIEN: Primary data saved (52854 records). [2025-09-26T17:59:04.931798] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-26T17:59:04.932024] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIEN took 37.6s. Estimated remaining: 4h 12m 41s. Rate: 7.6 symbols/min [2025-09-26T17:59:05.110620] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:05.116954] [DEBUG] [LOCAL ] CIMN: Loaded 2678 existing records from primary storage. [2025-09-26T17:59:05.117069] [INFO ] [MAIN ] CIMN: Loaded 2678 existing records. [2025-09-26T17:59:05.309572] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:59:05.309921] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-26T17:59:05.309987] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-26T17:59:05.310349] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-26T17:59:05.310426] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-26T17:59:05.562339] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-26T17:59:05.688622] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:05.900553] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T17:59:06.351516] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-26T17:59:06.356864] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-26T17:59:07.156737] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-26T17:59:07.883393] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T17:59:07.927369] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T17:59:07.956723] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-26T17:59:08.756744] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-26T17:59:08.822823] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T17:59:09.123061] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-26T17:59:09.556736] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-26T17:59:10.071809] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T17:59:10.356781] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-26T17:59:11.156752] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-26T17:59:11.902036] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T17:59:11.932415] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T17:59:11.956675] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-26T17:59:12.756716] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-26T17:59:13.491166] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T17:59:13.542405] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T17:59:13.556672] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-26T17:59:14.356729] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-26T17:59:14.626402] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T17:59:14.630334] [INFO ] [REMOTE ] CII: Full fetch complete (23068 records). [2025-09-26T17:59:14.630457] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-26T17:59:15.015195] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-26T17:59:15.015284] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-26T17:59:15.015694] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-26T17:59:15.015758] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-26T17:59:15.016498] [DEBUG] [LOCAL ] CII: Trimmed 23068 records to 15638 (keeping 200 days of data) [2025-09-26T17:59:15.126311] [DEBUG] [LOCAL ] CII: Primary data saved (15638 records). [2025-09-26T17:59:15.126467] [INFO ] [MAIN ] CII: Full history saved. [2025-09-26T17:59:15.126582] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CII took 19.5s. Estimated remaining: 4h 12m 43s. Rate: 7.6 symbols/min [2025-09-26T17:59:15.163722] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-26T17:59:15.312022] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:15.312241] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-26T17:59:15.312284] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-26T17:59:15.312551] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-26T17:59:15.312625] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-26T17:59:15.312724] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-26T17:59:15.312786] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-26T17:59:15.689525] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:15.783607] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T17:59:15.818449] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T17:59:15.956724] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-26T17:59:16.405245] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T17:59:16.756715] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-26T17:59:17.310556] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T17:59:17.556729] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-26T17:59:18.356736] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-26T17:59:18.756622] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T17:59:19.121999] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T17:59:19.156752] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-26T17:59:19.751313] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T17:59:19.956736] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-26T17:59:20.507851] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T17:59:20.756747] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-26T17:59:21.193983] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-26T17:59:21.556738] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-26T17:59:21.989917] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T17:59:22.356739] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-26T17:59:23.156728] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-26T17:59:23.616500] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-26T17:59:23.618095] [INFO ] [REMOTE ] CIMN: Full fetch complete (3903 records). [2025-09-26T17:59:23.618191] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-26T17:59:23.961690] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-26T17:59:24.028614] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-26T17:59:24.028929] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-26T17:59:24.029120] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-26T17:59:24.044284] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-26T17:59:24.058603] [DEBUG] [LOCAL ] CIMN: Trimmed 3903 records to 2697 (keeping 200 days of data) [2025-09-26T17:59:24.060160] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T17:59:24.088771] [DEBUG] [LOCAL ] CIMN: Primary data saved (2697 records). [2025-09-26T17:59:24.088929] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-26T17:59:24.089028] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CIMN took 19.2s. Estimated remaining: 4h 12m 40s. Rate: 7.6 symbols/min [2025-09-26T17:59:24.263429] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:24.263667] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-26T17:59:24.263725] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-26T17:59:24.263874] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-26T17:59:24.263922] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-26T17:59:24.263965] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-26T17:59:24.263999] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-26T17:59:24.649882] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:24.756739] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-26T17:59:24.950393] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:24.950781] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-26T17:59:25.556732] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-26T17:59:25.603981] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T17:59:25.751891] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:25.752208] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-26T17:59:26.356725] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-26T17:59:26.822106] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T17:59:27.156726] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-26T17:59:27.681834] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T17:59:27.956728] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-26T17:59:28.756714] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-26T17:59:29.556681] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-26T17:59:29.559497] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T17:59:29.570618] [INFO ] [REMOTE ] CIG: Full fetch complete (61041 records). [2025-09-26T17:59:29.570782] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-26T17:59:29.984757] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-26T17:59:29.984881] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-26T17:59:29.985702] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-26T17:59:29.985770] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-26T17:59:29.987290] [DEBUG] [LOCAL ] CIG: Trimmed 61041 records to 44447 (keeping 200 days of data) [2025-09-26T17:59:30.202209] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T17:59:30.253670] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T17:59:30.307068] [DEBUG] [LOCAL ] CIG: Primary data saved (44447 records). [2025-09-26T17:59:30.307286] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-26T17:59:30.307447] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIG took 50.4s. Estimated remaining: 4h 12m 25s. Rate: 7.6 symbols/min [2025-09-26T17:59:30.364286] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-26T17:59:30.488394] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:30.507889] [DEBUG] [LOCAL ] CINT: Loaded 18698 existing records from primary storage. [2025-09-26T17:59:30.508046] [INFO ] [MAIN ] CINT: Loaded 18698 existing records. [2025-09-26T17:59:30.617675] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:30.628964] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-26T17:59:30.700564] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:59:30.700884] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-26T17:59:30.700949] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-26T17:59:30.701585] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-26T17:59:30.701682] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-26T17:59:31.082580] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:31.156752] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-26T17:59:31.956738] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-26T17:59:32.526613] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:32.526990] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-26T17:59:32.553761] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T17:59:32.756733] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-26T17:59:32.951380] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:32.951775] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-26T17:59:33.556748] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-26T17:59:33.754118] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:33.754522] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-26T17:59:34.356724] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-26T17:59:34.550975] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:34.551319] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-26T17:59:35.156727] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-26T17:59:35.360817] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:35.361175] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-26T17:59:35.956721] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-26T17:59:36.756721] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-26T17:59:37.463121] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T17:59:37.464043] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T17:59:37.556735] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-26T17:59:38.356748] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-26T17:59:38.699696] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T17:59:38.707987] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-26T17:59:38.725739] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T17:59:39.156738] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-26T17:59:39.956712] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-26T17:59:40.080487] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T17:59:40.756732] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-26T17:59:41.524703] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T17:59:41.556679] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-26T17:59:41.715109] [INFO ] [REMOTE ] CIMP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T17:59:41.716979] [INFO ] [REMOTE ] CIMP: Full fetch complete (992 records). [2025-09-26T17:59:41.717046] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-26T17:59:41.904439] [WARN ] [VALIDATOR ] CIMP: Validation failed - insufficient historical data. Have 7 unique days, need 200 days [2025-09-26T17:59:41.904735] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T17:59:41.904847] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T17:59:41.904925] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-26T17:59:41.904994] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-26T17:59:41.905031] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-26T17:59:41.905089] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-26T17:59:41.905185] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMP took 17.8s. Estimated remaining: 4h 12m 33s. Rate: 7.6 symbols/min [2025-09-26T17:59:42.084587] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:42.110400] [DEBUG] [LOCAL ] CIO: Loaded 20205 existing records from primary storage. [2025-09-26T17:59:42.110562] [INFO ] [MAIN ] CIO: Loaded 20205 existing records. [2025-09-26T17:59:42.308369] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:59:42.308692] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-26T17:59:42.308762] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-26T17:59:42.309405] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-26T17:59:42.309478] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-26T17:59:42.360238] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-26T17:59:42.529247] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T17:59:42.716297] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:43.156738] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-26T17:59:43.485687] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T17:59:43.493404] [INFO ] [REMOTE ] CIM: Full fetch complete (54664 records). [2025-09-26T17:59:43.493600] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-26T17:59:43.889452] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-26T17:59:43.889539] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-26T17:59:43.890246] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-26T17:59:43.890315] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-26T17:59:43.891565] [DEBUG] [LOCAL ] CIM: Trimmed 54664 records to 37858 (keeping 200 days of data) [2025-09-26T17:59:43.963016] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-26T17:59:44.191710] [DEBUG] [LOCAL ] CIM: Primary data saved (37858 records). [2025-09-26T17:59:44.191861] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-26T17:59:44.191963] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIM took 48.2s. Estimated remaining: 4h 12m 1s. Rate: 7.6 symbols/min [2025-09-26T17:59:44.382264] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T17:59:44.409478] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T17:59:44.448197] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T17:59:44.451579] [DEBUG] [LOCAL ] CION: Loaded 29526 existing records from primary storage. [2025-09-26T17:59:44.451759] [INFO ] [MAIN ] CION: Loaded 29526 existing records. [2025-09-26T17:59:44.638868] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T17:59:44.639135] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-26T17:59:44.639186] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-26T17:59:44.640042] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-26T17:59:44.640104] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-26T17:59:44.761853] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-26T17:59:45.018552] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T17:59:45.556707] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-26T17:59:45.782681] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T17:59:46.277559] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T17:59:46.356766] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-26T17:59:47.156757] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-26T17:59:47.394148] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T17:59:47.688533] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T17:59:47.956755] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-26T17:59:48.756695] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-26T17:59:48.866354] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T17:59:49.323837] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T17:59:49.556739] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-26T17:59:50.356697] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-26T17:59:50.707354] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-26T17:59:50.723605] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T17:59:51.156749] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-26T17:59:51.650181] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-26T17:59:51.956759] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-26T17:59:52.756744] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-26T17:59:53.006540] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T17:59:53.109794] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T17:59:53.556740] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-26T17:59:54.356774] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-26T17:59:54.709067] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T17:59:55.156762] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-26T17:59:55.503947] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T17:59:55.956727] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-26T17:59:56.531119] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T17:59:56.547795] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T17:59:56.756719] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-26T17:59:57.556726] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-26T17:59:57.720911] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T17:59:58.347304] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T17:59:58.356675] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-26T17:59:59.156695] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-26T17:59:59.287285] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T17:59:59.956746] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-26T18:00:00.151093] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T18:00:00.152907] [INFO ] [REMOTE ] CIMO: Full fetch complete (5472 records). [2025-09-26T18:00:00.152982] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-26T18:00:00.345832] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T18:00:00.346058] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:00:00.346141] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:00:00.346217] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-26T18:00:00.346285] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-26T18:00:00.346325] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-26T18:00:00.346384] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-26T18:00:00.346511] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIMO took 45.2s. Estimated remaining: 4h 12m 28s. Rate: 7.6 symbols/min [2025-09-26T18:00:00.529371] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:00.529683] [DEBUG] [LOCAL ] CIVI: No existing data file found in primary storage. [2025-09-26T18:00:00.529742] [WARN ] [MAIN ] CIVI: No existing data found, performing full refresh instead. [2025-09-26T18:00:00.529894] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-26T18:00:00.529941] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-26T18:00:00.529987] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-09-26T18:00:00.530021] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-26T18:00:00.674896] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:00:00.764521] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-26T18:00:00.950704] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:01.556742] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-26T18:00:02.086488] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T18:00:02.356753] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-26T18:00:03.156780] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-26T18:00:03.453368] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T18:00:03.514281] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T18:00:03.519607] [INFO ] [REMOTE ] CINT: Full fetch complete (26042 records). [2025-09-26T18:00:03.519868] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-26T18:00:03.520544] [FATAL] [VALIDATOR ] CINT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:00:03.520638] [FATAL] [MAIN ] CINT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:00:03.520769] [WARN ] [MAIN ] CINT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:00:03.520832] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-26T18:00:03.520899] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-09-26T18:00:03.520937] [INFO ] [LOCAL ] CINT: Starting deletion of derivative data. [2025-09-26T18:00:03.521431] [DEBUG] [LOCAL ] CINT: Deleted derivative data file. [2025-09-26T18:00:03.521573] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CINT took 33.2s. Estimated remaining: 4h 12m 0s. Rate: 7.6 symbols/min [2025-09-26T18:00:03.713496] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:03.781716] [DEBUG] [LOCAL ] CL: Loaded 54034 existing records from primary storage. [2025-09-26T18:00:03.781902] [INFO ] [MAIN ] CL: Loaded 54034 existing records. [2025-09-26T18:00:03.976286] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-26T18:00:03.989514] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:03.989986] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-26T18:00:03.990058] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-26T18:00:04.000371] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-26T18:00:04.012442] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-26T18:00:04.096772] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T18:00:04.420229] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:04.756724] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-26T18:00:05.556717] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-26T18:00:05.653930] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T18:00:05.685514] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:00:06.356750] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-26T18:00:06.444886] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T18:00:07.156771] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-26T18:00:07.213339] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T18:00:07.218870] [INFO ] [REMOTE ] CIO: Full fetch complete (28734 records). [2025-09-26T18:00:07.218962] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-26T18:00:07.219487] [FATAL] [VALIDATOR ] CIO: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:00:07.219576] [FATAL] [MAIN ] CIO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:00:07.219620] [WARN ] [MAIN ] CIO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:00:07.219796] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-26T18:00:07.219877] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-09-26T18:00:07.219915] [INFO ] [LOCAL ] CIO: Starting deletion of derivative data. [2025-09-26T18:00:07.220255] [DEBUG] [LOCAL ] CIO: Deleted derivative data file. [2025-09-26T18:00:07.220371] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CIO took 25.3s. Estimated remaining: 4h 11m 35s. Rate: 7.6 symbols/min [2025-09-26T18:00:07.402817] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:07.402999] [DEBUG] [LOCAL ] CLB: No existing data file found in primary storage. [2025-09-26T18:00:07.403038] [WARN ] [MAIN ] CLB: No existing data found, performing full refresh instead. [2025-09-26T18:00:07.403185] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-26T18:00:07.403229] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-26T18:00:07.403270] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-09-26T18:00:07.403302] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-26T18:00:07.772257] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:07.956806] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-26T18:00:08.756749] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-26T18:00:08.986892] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T18:00:09.333220] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T18:00:09.556734] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-26T18:00:10.325734] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:00:10.356742] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-26T18:00:10.463302] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:00:11.156770] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-26T18:00:11.274239] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T18:00:11.956772] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-26T18:00:12.425082] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:00:12.756765] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-26T18:00:13.303592] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T18:00:13.556738] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-26T18:00:14.016219] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T18:00:14.356748] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-26T18:00:14.898531] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T18:00:15.156761] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-26T18:00:15.528539] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T18:00:15.956765] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-26T18:00:16.756733] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-26T18:00:17.038098] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T18:00:17.069527] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:00:17.075397] [INFO ] [REMOTE ] CION: Full fetch complete (41180 records). [2025-09-26T18:00:17.075555] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-26T18:00:17.500570] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-26T18:00:17.500695] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-26T18:00:17.501308] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-26T18:00:17.501366] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-26T18:00:17.502597] [DEBUG] [LOCAL ] CION: Trimmed 41180 records to 29661 (keeping 200 days of data) [2025-09-26T18:00:17.558395] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-26T18:00:17.697500] [DEBUG] [LOCAL ] CION: Primary data saved (29661 records). [2025-09-26T18:00:17.697685] [INFO ] [MAIN ] CION: Full history saved. [2025-09-26T18:00:17.699611] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CION took 33.5s. Estimated remaining: 4h 11m 38s. Rate: 7.6 symbols/min [2025-09-26T18:00:17.893140] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:17.935181] [DEBUG] [LOCAL ] CLCO: Loaded 13067 existing records from primary storage. [2025-09-26T18:00:17.936134] [INFO ] [MAIN ] CLCO: Loaded 13067 existing records. [2025-09-26T18:00:17.937357] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:00:18.146021] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:18.146408] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-26T18:00:18.146465] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-26T18:00:18.146900] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-26T18:00:18.146960] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-26T18:00:18.365020] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-26T18:00:18.602099] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:19.100170] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:00:19.156715] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-26T18:00:19.607048] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T18:00:19.956744] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-26T18:00:20.756729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-26T18:00:20.897079] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:00:20.926911] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:00:21.556721] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-26T18:00:21.977222] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:00:22.356750] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-26T18:00:23.156754] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-26T18:00:23.213692] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:00:23.401562] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:00:23.956739] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-26T18:00:24.756726] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-26T18:00:24.824339] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T18:00:25.307850] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T18:00:25.556756] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-26T18:00:26.356739] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-26T18:00:26.474103] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T18:00:26.510714] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T18:00:27.156736] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-26T18:00:27.851456] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T18:00:27.859072] [INFO ] [REMOTE ] CLB: Full fetch complete (46502 records). [2025-09-26T18:00:27.859210] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-26T18:00:27.963917] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-26T18:00:28.279524] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-26T18:00:28.279617] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-26T18:00:28.280234] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-26T18:00:28.280318] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-26T18:00:28.281353] [DEBUG] [LOCAL ] CLB: Trimmed 46502 records to 33475 (keeping 200 days of data) [2025-09-26T18:00:28.494046] [DEBUG] [LOCAL ] CLB: Primary data saved (33475 records). [2025-09-26T18:00:28.494289] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-26T18:00:28.494438] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CLB took 21.3s. Estimated remaining: 4h 11m 42s. Rate: 7.6 symbols/min [2025-09-26T18:00:28.687103] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:28.741898] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:00:28.761827] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-26T18:00:28.763248] [DEBUG] [LOCAL ] CLDT: Loaded 25900 existing records from primary storage. [2025-09-26T18:00:28.764606] [INFO ] [MAIN ] CLDT: Loaded 25900 existing records. [2025-09-26T18:00:28.951895] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:28.952171] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-26T18:00:28.952219] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-26T18:00:28.953061] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-26T18:00:28.953124] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-26T18:00:29.339344] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:29.556716] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-26T18:00:29.609563] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T18:00:30.177772] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-26T18:00:30.356726] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-26T18:00:30.479701] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T18:00:31.156743] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-26T18:00:31.339447] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T18:00:31.956770] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-26T18:00:32.250822] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:00:32.726979] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T18:00:32.756695] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-26T18:00:33.255059] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:00:33.556753] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-26T18:00:34.356746] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-26T18:00:35.156765] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-26T18:00:35.463090] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T18:00:35.500300] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:00:35.956744] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-26T18:00:36.635512] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T18:00:36.756734] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-26T18:00:36.900049] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T18:00:37.556721] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-26T18:00:38.041315] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T18:00:38.356744] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-26T18:00:38.544640] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T18:00:39.156744] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-26T18:00:39.857492] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:00:39.931523] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T18:00:39.956723] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-26T18:00:40.756731] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-26T18:00:41.365134] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:00:41.387702] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T18:00:41.556729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-26T18:00:42.192368] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:00:42.356762] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-26T18:00:43.156714] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-26T18:00:43.287488] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:00:43.956782] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-26T18:00:44.756782] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-26T18:00:44.807878] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:00:45.556743] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-26T18:00:45.784912] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T18:00:45.789158] [INFO ] [REMOTE ] CLCO: Full fetch complete (22890 records). [2025-09-26T18:00:45.789353] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-26T18:00:46.375771] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-26T18:00:46.390291] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-26T18:00:46.390583] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-26T18:00:46.391043] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-26T18:00:46.391132] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-26T18:00:46.422599] [DEBUG] [LOCAL ] CLCO: Trimmed 22890 records to 13189 (keeping 200 days of data) [2025-09-26T18:00:46.426301] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-26T18:00:46.492369] [INFO ] [REMOTE ] CIVI: Full fetch complete (75571 records). [2025-09-26T18:00:46.495406] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-26T18:00:46.770567] [DEBUG] [LOCAL ] CLCO: Primary data saved (13189 records). [2025-09-26T18:00:46.798300] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-26T18:00:46.813767] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLCO took 29.1s. Estimated remaining: 4h 12m 17s. Rate: 7.6 symbols/min [2025-09-26T18:00:47.137288] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-26T18:00:47.137630] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-26T18:00:47.140358] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-26T18:00:47.140465] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-26T18:00:47.161525] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:47.162338] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-09-26T18:00:47.162552] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-09-26T18:00:47.163087] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-26T18:00:47.163162] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-26T18:00:47.163234] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-09-26T18:00:47.163272] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-26T18:00:47.175617] [DEBUG] [LOCAL ] CIVI: Trimmed 75571 records to 53363 (keeping 200 days of data) [2025-09-26T18:00:47.724237] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:47.728838] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T18:00:47.730115] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-26T18:00:47.770470] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T18:00:47.785946] [INFO ] [REMOTE ] CL: Full fetch complete (77616 records). [2025-09-26T18:00:47.786783] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-26T18:00:47.974599] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-26T18:00:48.338331] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-26T18:00:48.338762] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-26T18:00:48.339866] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-26T18:00:48.340207] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-26T18:00:48.348304] [DEBUG] [LOCAL ] CL: Trimmed 77616 records to 54424 (keeping 200 days of data) [2025-09-26T18:00:48.681516] [DEBUG] [LOCAL ] CIVI: Primary data saved (53363 records). [2025-09-26T18:00:48.682137] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-26T18:00:48.682543] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CIVI took 48.3s. Estimated remaining: 4h 11m 44s. Rate: 7.6 symbols/min [2025-09-26T18:00:48.891447] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:48.915151] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T18:00:48.922462] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-26T18:00:49.029209] [DEBUG] [LOCAL ] CLH: Loaded 28304 existing records from primary storage. [2025-09-26T18:00:49.030257] [INFO ] [MAIN ] CLH: Loaded 28304 existing records. [2025-09-26T18:00:49.165725] [DEBUG] [LOCAL ] CL: Primary data saved (54424 records). [2025-09-26T18:00:49.176211] [INFO ] [MAIN ] CL: Full history saved. [2025-09-26T18:00:49.181512] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CL took 45.7s. Estimated remaining: 4h 11m 6s. Rate: 7.6 symbols/min [2025-09-26T18:00:49.253857] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:49.254431] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-26T18:00:49.254588] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-26T18:00:49.267107] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-26T18:00:49.267499] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-26T18:00:49.613070] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:49.773850] [DEBUG] [LOCAL ] CLPR: Loaded 11575 existing records from primary storage. [2025-09-26T18:00:49.774216] [INFO ] [MAIN ] CLPR: Loaded 11575 existing records. [2025-09-26T18:00:50.003152] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:50.026843] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-26T18:00:50.042633] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-26T18:00:50.055498] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:00:50.129506] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:50.134001] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-26T18:00:50.134081] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-26T18:00:50.134569] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-26T18:00:50.134639] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-26T18:00:50.361800] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-26T18:00:50.517101] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:51.156737] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-26T18:00:51.672472] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T18:00:51.887448] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T18:00:51.940343] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-26T18:00:51.956675] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-26T18:00:52.756753] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-26T18:00:52.878845] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T18:00:53.556726] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-26T18:00:54.356750] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-26T18:00:54.396538] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T18:00:54.930840] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-26T18:00:55.156768] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-26T18:00:55.275527] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T18:00:55.281421] [INFO ] [REMOTE ] CLDT: Full fetch complete (36971 records). [2025-09-26T18:00:55.281549] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-26T18:00:55.692500] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-26T18:00:55.692583] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-26T18:00:55.693103] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-26T18:00:55.693185] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-26T18:00:55.694142] [DEBUG] [LOCAL ] CLDT: Trimmed 36971 records to 26082 (keeping 200 days of data) [2025-09-26T18:00:55.840867] [DEBUG] [LOCAL ] CLDT: Primary data saved (26082 records). [2025-09-26T18:00:55.841061] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-26T18:00:55.841182] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLDT took 27.3s. Estimated remaining: 4h 10m 53s. Rate: 7.6 symbols/min [2025-09-26T18:00:55.961803] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-26T18:00:56.029209] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:00:56.085017] [DEBUG] [LOCAL ] CLS: Loaded 54024 existing records from primary storage. [2025-09-26T18:00:56.085271] [INFO ] [MAIN ] CLS: Loaded 54024 existing records. [2025-09-26T18:00:56.282024] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:00:56.282306] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-26T18:00:56.282354] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-26T18:00:56.283924] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-26T18:00:56.283991] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-26T18:00:56.664524] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:00:56.756742] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-26T18:00:57.124175] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T18:00:57.173419] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T18:00:57.416289] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T18:00:57.556757] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-26T18:00:58.356730] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-26T18:00:59.156730] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-26T18:00:59.815024] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-26T18:00:59.956757] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-26T18:01:00.165986] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T18:01:00.378433] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T18:01:00.756732] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-26T18:01:01.485312] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T18:01:01.556726] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-26T18:01:01.877148] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T18:01:02.356758] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-26T18:01:03.156719] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-26T18:01:03.184821] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T18:01:03.948463] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T18:01:03.962465] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-26T18:01:03.967889] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:01:04.756816] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-26T18:01:05.556775] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-26T18:01:06.268351] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-26T18:01:06.344584] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:01:06.356673] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-26T18:01:07.156767] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-26T18:01:07.273245] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T18:01:07.522908] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T18:01:07.956801] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-26T18:01:08.756758] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-26T18:01:09.556710] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-26T18:01:09.697901] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-26T18:01:09.837159] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T18:01:09.961637] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T18:01:10.356737] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-26T18:01:10.416454] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T18:01:11.156775] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-26T18:01:11.956757] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-26T18:01:12.521997] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T18:01:12.657704] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T18:01:12.756739] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-26T18:01:13.556769] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-26T18:01:13.575813] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T18:01:13.758520] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T18:01:13.769815] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-09-26T18:01:13.770006] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-26T18:01:14.199205] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-26T18:01:14.199319] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-26T18:01:14.200207] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-26T18:01:14.200280] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-26T18:01:14.202048] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 54521 (keeping 200 days of data) [2025-09-26T18:01:14.376600] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-26T18:01:14.546713] [DEBUG] [LOCAL ] CLF: Primary data saved (54521 records). [2025-09-26T18:01:14.547083] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-26T18:01:14.547228] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLF took 27.7s. Estimated remaining: 4h 11m 29s. Rate: 7.6 symbols/min [2025-09-26T18:01:14.748302] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:14.801294] [DEBUG] [LOCAL ] CLVT: Loaded 52329 existing records from primary storage. [2025-09-26T18:01:14.801457] [INFO ] [MAIN ] CLVT: Loaded 52329 existing records. [2025-09-26T18:01:15.029481] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:15.031802] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:01:15.037910] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-26T18:01:15.038611] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-26T18:01:15.040392] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-26T18:01:15.040471] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-26T18:01:15.157563] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-26T18:01:15.367253] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-26T18:01:15.455681] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:15.956770] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-26T18:01:16.756772] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-26T18:01:17.250255] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:01:17.255676] [INFO ] [REMOTE ] CLH: Full fetch complete (41686 records). [2025-09-26T18:01:17.255828] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-26T18:01:17.256571] [FATAL] [VALIDATOR ] CLH: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:01:17.256702] [FATAL] [MAIN ] CLH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:01:17.256758] [WARN ] [MAIN ] CLH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:01:17.256805] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-26T18:01:17.256866] [DEBUG] [LOCAL ] CLH: No primary data file found to delete. [2025-09-26T18:01:17.256921] [INFO ] [LOCAL ] CLH: Starting deletion of derivative data. [2025-09-26T18:01:17.257385] [DEBUG] [LOCAL ] CLH: Deleted derivative data file. [2025-09-26T18:01:17.257491] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLH took 28.6s. Estimated remaining: 4h 11m 0s. Rate: 7.6 symbols/min [2025-09-26T18:01:17.447462] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:17.472939] [DEBUG] [LOCAL ] CLW: Loaded 22067 existing records from primary storage. [2025-09-26T18:01:17.473143] [INFO ] [MAIN ] CLW: Loaded 22067 existing records. [2025-09-26T18:01:17.560297] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-26T18:01:17.667924] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:17.668246] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-26T18:01:17.668367] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-26T18:01:17.669113] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-26T18:01:17.669175] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-26T18:01:18.086382] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-26T18:01:18.090591] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:18.356750] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-26T18:01:18.390163] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T18:01:18.392091] [INFO ] [REMOTE ] CLPR: Full fetch complete (17666 records). [2025-09-26T18:01:18.392164] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-26T18:01:18.807986] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-26T18:01:18.808107] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-26T18:01:18.808535] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-26T18:01:18.808935] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-26T18:01:18.839250] [DEBUG] [LOCAL ] CLPR: Trimmed 17666 records to 11615 (keeping 200 days of data) [2025-09-26T18:01:18.841235] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T18:01:18.929998] [DEBUG] [LOCAL ] CLPR: Primary data saved (11615 records). [2025-09-26T18:01:18.930183] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-26T18:01:18.930292] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLPR took 29.7s. Estimated remaining: 4h 10m 27s. Rate: 7.6 symbols/min [2025-09-26T18:01:19.133322] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:19.133576] [DEBUG] [LOCAL ] CLX: No existing data file found in primary storage. [2025-09-26T18:01:19.133632] [WARN ] [MAIN ] CLX: No existing data found, performing full refresh instead. [2025-09-26T18:01:19.133848] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-26T18:01:19.134141] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-26T18:01:19.134197] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-09-26T18:01:19.134251] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-26T18:01:19.161989] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-26T18:01:19.557219] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:19.956841] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-26T18:01:20.768429] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-26T18:01:20.795997] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-26T18:01:20.993992] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T18:01:21.251848] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T18:01:21.556742] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-26T18:01:21.867468] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T18:01:22.356737] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-26T18:01:22.698857] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:01:23.156756] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-26T18:01:23.956714] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-26T18:01:24.325354] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T18:01:24.437614] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T18:01:24.756794] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-26T18:01:24.898918] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T18:01:25.556805] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-26T18:01:26.356748] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-26T18:01:26.720888] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T18:01:26.871039] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T18:01:27.156756] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-26T18:01:27.956782] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-26T18:01:28.756708] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-26T18:01:28.848191] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-26T18:01:29.013020] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T18:01:29.075084] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:01:29.556739] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-26T18:01:30.358049] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-26T18:01:30.364214] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:01:31.156727] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-26T18:01:31.956760] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-26T18:01:32.126190] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-26T18:01:32.373779] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T18:01:32.542717] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-26T18:01:32.756729] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-26T18:01:33.544047] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:01:33.556680] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-26T18:01:33.587101] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T18:01:34.356731] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-26T18:01:35.156758] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-26T18:01:35.845409] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-26T18:01:35.908227] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T18:01:35.956787] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-26T18:01:36.162149] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T18:01:36.756812] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-26T18:01:37.556729] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-26T18:01:37.671203] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T18:01:38.078485] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T18:01:38.356768] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-26T18:01:39.156754] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-26T18:01:39.437735] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T18:01:39.956722] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-26T18:01:40.316890] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-26T18:01:40.329766] [INFO ] [REMOTE ] CLS: Full fetch complete (77448 records). [2025-09-26T18:01:40.330040] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-26T18:01:40.759779] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-26T18:01:40.850800] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-26T18:01:40.850924] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-26T18:01:40.851911] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-26T18:01:40.852046] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-26T18:01:40.887697] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T18:01:40.886594] [DEBUG] [LOCAL ] CLS: Trimmed 77448 records to 54412 (keeping 200 days of data) [2025-09-26T18:01:41.282848] [DEBUG] [LOCAL ] CLS: Primary data saved (54412 records). [2025-09-26T18:01:41.283279] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-26T18:01:41.283491] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLS took 45.4s. Estimated remaining: 4h 11m 18s. Rate: 7.6 symbols/min [2025-09-26T18:01:41.434457] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T18:01:41.502506] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:41.502778] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-09-26T18:01:41.502836] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-09-26T18:01:41.503076] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-26T18:01:41.503121] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-26T18:01:41.503171] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-26T18:01:41.503307] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-26T18:01:41.566296] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-26T18:01:41.908167] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:42.356741] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-26T18:01:43.068121] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-26T18:01:43.083352] [INFO ] [REMOTE ] CLVT: Full fetch complete (75225 records). [2025-09-26T18:01:43.083787] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-26T18:01:43.170370] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-26T18:01:43.399608] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T18:01:43.603832] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T18:01:43.658552] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-26T18:01:43.658839] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-26T18:01:43.659804] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-26T18:01:43.660309] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-26T18:01:43.662080] [DEBUG] [LOCAL ] CLVT: Trimmed 75225 records to 52713 (keeping 200 days of data) [2025-09-26T18:01:43.960245] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-26T18:01:44.011456] [DEBUG] [LOCAL ] CLVT: Primary data saved (52713 records). [2025-09-26T18:01:44.011618] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-26T18:01:44.013055] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLVT took 29.5s. Estimated remaining: 4h 10m 49s. Rate: 7.6 symbols/min [2025-09-26T18:01:44.193571] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:44.253899] [DEBUG] [LOCAL ] CMA: Loaded 50401 existing records from primary storage. [2025-09-26T18:01:44.254048] [INFO ] [MAIN ] CMA: Loaded 50401 existing records. [2025-09-26T18:01:44.457954] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:44.458352] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-26T18:01:44.458436] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-26T18:01:44.458965] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-26T18:01:44.459134] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-26T18:01:44.761904] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-26T18:01:44.795029] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T18:01:44.970788] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:45.556733] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-26T18:01:45.722616] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T18:01:45.758952] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T18:01:45.766206] [INFO ] [REMOTE ] CLW: Full fetch complete (35253 records). [2025-09-26T18:01:45.766367] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-26T18:01:46.187949] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-26T18:01:46.188040] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-26T18:01:46.188523] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-26T18:01:46.188565] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-26T18:01:46.189639] [DEBUG] [LOCAL ] CLW: Trimmed 35253 records to 22226 (keeping 200 days of data) [2025-09-26T18:01:46.346798] [DEBUG] [LOCAL ] CLW: Primary data saved (22226 records). [2025-09-26T18:01:46.346969] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-26T18:01:46.347095] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLW took 29.1s. Estimated remaining: 4h 10m 18s. Rate: 7.6 symbols/min [2025-09-26T18:01:46.361855] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-26T18:01:46.552230] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:46.577011] [DEBUG] [LOCAL ] CMBT: Loaded 22580 existing records from primary storage. [2025-09-26T18:01:46.577200] [INFO ] [MAIN ] CMBT: Loaded 22580 existing records. [2025-09-26T18:01:46.778835] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:46.779106] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-26T18:01:46.779169] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-26T18:01:46.779449] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-26T18:01:46.779508] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-26T18:01:47.165051] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-26T18:01:47.212429] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:47.290428] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T18:01:47.956739] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-26T18:01:48.082163] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T18:01:48.756741] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-26T18:01:49.121397] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:01:49.132085] [INFO ] [REMOTE ] CLX: Full fetch complete (72980 records). [2025-09-26T18:01:49.132248] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-26T18:01:49.559741] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-26T18:01:49.586955] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-26T18:01:49.587573] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-26T18:01:49.588702] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-26T18:01:49.589096] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-26T18:01:49.591232] [DEBUG] [LOCAL ] CLX: Trimmed 72980 records to 52189 (keeping 200 days of data) [2025-09-26T18:01:49.731920] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:01:49.929451] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T18:01:50.022250] [DEBUG] [LOCAL ] CLX: Primary data saved (52189 records). [2025-09-26T18:01:50.022419] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-26T18:01:50.022503] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLX took 31.1s. Estimated remaining: 4h 9m 53s. Rate: 7.6 symbols/min [2025-09-26T18:01:50.220376] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:01:50.270888] [DEBUG] [LOCAL ] CMC: Loaded 45990 existing records from primary storage. [2025-09-26T18:01:50.271045] [INFO ] [MAIN ] CMC: Loaded 45990 existing records. [2025-09-26T18:01:50.361869] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-26T18:01:50.482385] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:01:50.482699] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-26T18:01:50.482787] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-26T18:01:50.483143] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-26T18:01:50.483202] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-26T18:01:50.896968] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:01:51.021888] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:01:51.156770] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-26T18:01:51.956733] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-26T18:01:52.073081] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T18:01:52.756764] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-26T18:01:52.818204] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T18:01:52.839810] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T18:01:53.556760] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-26T18:01:54.356765] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-26T18:01:54.530699] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T18:01:54.783899] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-26T18:01:55.156741] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-26T18:01:55.956698] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-26T18:01:56.320134] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T18:01:56.756782] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-26T18:01:56.999715] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T18:01:57.015714] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T18:01:57.556750] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-26T18:01:58.284116] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T18:01:58.356782] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-26T18:01:58.798946] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:01:59.041896] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T18:01:59.156785] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-26T18:01:59.956774] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-26T18:02:00.567822] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T18:02:00.756743] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-26T18:02:01.302584] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:02:01.504737] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T18:02:01.556761] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-26T18:02:02.356753] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-26T18:02:03.156794] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-26T18:02:03.429158] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T18:02:03.582470] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T18:02:03.956768] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-26T18:02:04.318910] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:02:04.756805] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-26T18:02:05.486150] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T18:02:05.531198] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T18:02:05.556711] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-26T18:02:06.356742] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-26T18:02:06.843810] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T18:02:07.156761] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-26T18:02:07.913361] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T18:02:07.956783] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-26T18:02:08.137165] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T18:02:08.756791] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-26T18:02:09.462943] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:02:09.556747] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-26T18:02:10.329503] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T18:02:10.340739] [INFO ] [REMOTE ] CMBT: Full fetch complete (29676 records). [2025-09-26T18:02:10.340910] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-26T18:02:10.364127] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-26T18:02:10.793022] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-26T18:02:10.793321] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-26T18:02:10.794044] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-26T18:02:10.794203] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-26T18:02:10.795619] [DEBUG] [LOCAL ] CMBT: Trimmed 29676 records to 22911 (keeping 200 days of data) [2025-09-26T18:02:10.935587] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T18:02:10.998982] [DEBUG] [LOCAL ] CMBT: Primary data saved (22911 records). [2025-09-26T18:02:10.999133] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-26T18:02:10.999414] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CMBT took 24.7s. Estimated remaining: 4h 10m 38s. Rate: 7.6 symbols/min [2025-09-26T18:02:11.161931] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-26T18:02:11.189238] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:11.198372] [DEBUG] [LOCAL ] CMCM: Loaded 4788 existing records from primary storage. [2025-09-26T18:02:11.198519] [INFO ] [MAIN ] CMCM: Loaded 4788 existing records. [2025-09-26T18:02:11.401445] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:02:11.401742] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-26T18:02:11.401801] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-26T18:02:11.402033] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-26T18:02:11.402092] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-26T18:02:11.798832] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:11.956712] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-26T18:02:12.144368] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:02:12.673960] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T18:02:12.756752] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-26T18:02:13.518081] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T18:02:13.556714] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-26T18:02:13.859743] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-26T18:02:14.033927] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T18:02:14.356738] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-26T18:02:15.156800] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-26T18:02:15.956716] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-26T18:02:16.141097] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T18:02:16.150786] [INFO ] [REMOTE ] CMA: Full fetch complete (72875 records). [2025-09-26T18:02:16.150966] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-26T18:02:16.152240] [FATAL] [VALIDATOR ] CMA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:02:16.152364] [FATAL] [MAIN ] CMA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:02:16.152408] [WARN ] [MAIN ] CMA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:02:16.152457] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-26T18:02:16.152549] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-09-26T18:02:16.152623] [INFO ] [LOCAL ] CMA: Starting deletion of derivative data. [2025-09-26T18:02:16.153049] [DEBUG] [LOCAL ] CMA: Deleted derivative data file. [2025-09-26T18:02:16.153845] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMA took 32.1s. Estimated remaining: 4h 10m 19s. Rate: 7.6 symbols/min [2025-09-26T18:02:16.345816] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:16.346106] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-26T18:02:16.346317] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-26T18:02:16.346575] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-26T18:02:16.346745] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-26T18:02:16.346922] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-26T18:02:16.347080] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-26T18:02:16.472637] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-26T18:02:16.738312] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:02:16.759144] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-26T18:02:16.827276] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:17.556730] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-26T18:02:17.955627] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-26T18:02:18.122345] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T18:02:18.356742] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-26T18:02:19.156756] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-26T18:02:19.502690] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-26T18:02:19.956779] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-26T18:02:20.251060] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:20.251607] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-26T18:02:20.310573] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T18:02:20.321206] [INFO ] [REMOTE ] CM: Full fetch complete (69358 records). [2025-09-26T18:02:20.321399] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-26T18:02:20.762977] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-26T18:02:20.789412] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-26T18:02:20.789546] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-26T18:02:20.790431] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-26T18:02:20.790518] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-26T18:02:20.792433] [DEBUG] [LOCAL ] CM: Trimmed 69358 records to 49317 (keeping 200 days of data) [2025-09-26T18:02:21.044080] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:21.045795] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-26T18:02:21.131185] [DEBUG] [LOCAL ] CM: Primary data saved (49317 records). [2025-09-26T18:02:21.131343] [INFO ] [MAIN ] CM: Full history saved. [2025-09-26T18:02:21.131622] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CM took 39.8s. Estimated remaining: 4h 9m 60s. Rate: 7.6 symbols/min [2025-09-26T18:02:21.348474] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:21.348682] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-09-26T18:02:21.348741] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-09-26T18:02:21.348894] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-26T18:02:21.348940] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-26T18:02:21.348987] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-09-26T18:02:21.349022] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-26T18:02:21.561986] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-26T18:02:21.772038] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:22.127778] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T18:02:22.356725] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-26T18:02:23.156729] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-26T18:02:23.515541] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:23.515991] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-26T18:02:23.956749] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-26T18:02:24.587401] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-26T18:02:24.756734] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-26T18:02:25.120076] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T18:02:25.434122] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T18:02:25.556733] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-26T18:02:26.212223] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T18:02:26.356725] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-26T18:02:27.156738] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-26T18:02:27.364711] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:27.365148] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-26T18:02:27.956784] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-26T18:02:28.185585] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:02:28.186153] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-26T18:02:28.395695] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-26T18:02:28.756720] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-26T18:02:29.367413] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:02:29.556736] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-26T18:02:30.356773] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-26T18:02:30.652091] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T18:02:31.156761] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-26T18:02:31.780354] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:02:31.956747] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-26T18:02:32.089730] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T18:02:32.756734] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-26T18:02:33.443437] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T18:02:33.446263] [INFO ] [REMOTE ] CMCM: Full fetch complete (7039 records). [2025-09-26T18:02:33.446377] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-26T18:02:33.561921] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-26T18:02:33.910084] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-26T18:02:33.911159] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-26T18:02:33.914080] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-26T18:02:33.913430] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:02:33.914328] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-26T18:02:33.926210] [DEBUG] [LOCAL ] CMCM: Trimmed 7039 records to 4834 (keeping 200 days of data) [2025-09-26T18:02:33.926848] [INFO ] [REMOTE ] CMC: Full fetch complete (66959 records). [2025-09-26T18:02:33.927327] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-26T18:02:34.170953] [DEBUG] [LOCAL ] CMCM: Primary data saved (4834 records). [2025-09-26T18:02:34.188975] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-26T18:02:34.193473] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMCM took 23.2s. Estimated remaining: 4h 10m 12s. Rate: 7.6 symbols/min [2025-09-26T18:02:34.370832] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-26T18:02:34.572487] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:34.665005] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-26T18:02:34.670505] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-26T18:02:34.678152] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-26T18:02:34.680784] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-26T18:02:34.683090] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T18:02:34.690593] [DEBUG] [LOCAL ] CMC: Trimmed 66959 records to 46311 (keeping 200 days of data) [2025-09-26T18:02:34.782273] [DEBUG] [LOCAL ] CMI: Loaded 42204 existing records from primary storage. [2025-09-26T18:02:34.809165] [INFO ] [MAIN ] CMI: Loaded 42204 existing records. [2025-09-26T18:02:35.009996] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:02:35.012684] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-26T18:02:35.013084] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-26T18:02:35.015352] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-26T18:02:35.015449] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-26T18:02:35.158563] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-26T18:02:35.550722] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:35.630688] [DEBUG] [LOCAL ] CMC: Primary data saved (46311 records). [2025-09-26T18:02:35.631066] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-26T18:02:35.631202] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMC took 45.6s. Estimated remaining: 4h 9m 39s. Rate: 7.6 symbols/min [2025-09-26T18:02:35.832529] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:35.872096] [DEBUG] [LOCAL ] CMP: Loaded 36661 existing records from primary storage. [2025-09-26T18:02:35.872279] [INFO ] [MAIN ] CMP: Loaded 36661 existing records. [2025-09-26T18:02:35.970892] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-26T18:02:36.075762] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:02:36.076387] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-26T18:02:36.085453] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-26T18:02:36.086463] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:02:36.089601] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-26T18:02:36.090494] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-26T18:02:36.497218] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:36.545040] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T18:02:36.756742] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-26T18:02:37.486041] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:02:37.556731] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-26T18:02:37.991637] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:02:38.356748] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-26T18:02:39.010638] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T18:02:39.013989] [INFO ] [REMOTE ] CMDB: Full fetch complete (10923 records). [2025-09-26T18:02:39.014117] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-26T18:02:39.161950] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-26T18:02:39.243460] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 99 unique days, need 200 days [2025-09-26T18:02:39.243760] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:02:39.243833] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:02:39.243917] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-26T18:02:39.244000] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-26T18:02:39.244039] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-26T18:02:39.244104] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-26T18:02:39.244209] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMDB took 23.1s. Estimated remaining: 4h 9m 14s. Rate: 7.6 symbols/min [2025-09-26T18:02:39.444745] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:02:39.485797] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T18:02:39.542707] [DEBUG] [LOCAL ] CMPO: Loaded 39856 existing records from primary storage. [2025-09-26T18:02:39.542889] [INFO ] [MAIN ] CMPO: Loaded 39856 existing records. [2025-09-26T18:02:39.746092] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:02:39.746364] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-09-26T18:02:39.746414] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-26T18:02:39.746804] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-09-26T18:02:39.746866] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-09-26T18:02:39.961848] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-26T18:02:40.158339] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:02:40.190793] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:02:40.756774] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-09-26T18:02:41.556744] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-26T18:02:41.953241] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T18:02:42.047050] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-26T18:02:42.356743] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-26T18:02:43.156781] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-09-26T18:02:43.267254] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T18:02:43.956746] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-26T18:02:44.219250] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T18:02:44.294959] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T18:02:44.756748] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-09-26T18:02:45.071285] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:02:45.556751] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-26T18:02:46.356802] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-26T18:02:46.584326] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T18:02:47.156767] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-26T18:02:47.898541] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T18:02:47.956700] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-26T18:02:48.179989] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-26T18:02:48.527860] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:02:48.756763] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-26T18:02:49.182809] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T18:02:49.556759] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-26T18:02:50.046283] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T18:02:50.356792] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-26T18:02:51.156784] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-26T18:02:51.572059] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T18:02:51.690520] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T18:02:51.956733] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-09-26T18:02:52.756704] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-26T18:02:52.836111] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:02:53.532724] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:02:53.556680] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-09-26T18:02:54.356764] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-26T18:02:54.619952] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T18:02:54.894984] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:02:54.906840] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-09-26T18:02:54.907013] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-26T18:02:55.163743] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-09-26T18:02:55.366962] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-26T18:02:55.367079] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-26T18:02:55.367972] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-26T18:02:55.368053] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-26T18:02:55.369723] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 54501 (keeping 200 days of data) [2025-09-26T18:02:55.521730] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T18:02:55.756542] [DEBUG] [LOCAL ] CMG: Primary data saved (54501 records). [2025-09-26T18:02:55.756726] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-26T18:02:55.756833] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMG took 34.6s. Estimated remaining: 4h 9m 40s. Rate: 7.6 symbols/min [2025-09-26T18:02:55.956753] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-26T18:02:56.761185] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-26T18:02:56.766949] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T18:02:56.834709] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T18:02:57.556752] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-26T18:02:58.316769] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T18:02:58.356771] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-26T18:02:59.156793] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-09-26T18:03:00.027455] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T18:03:00.036891] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-26T18:03:00.252531] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T18:03:00.756777] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-09-26T18:03:01.348339] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T18:03:01.556751] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-26T18:03:02.239036] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (4.68 seconds). [2025-09-26T18:03:02.245010] [INFO ] [REMOTE ] CMP: Full fetch complete (52692 records). [2025-09-26T18:03:02.245221] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-26T18:03:02.246101] [FATAL] [VALIDATOR ] CMP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:03:02.246195] [FATAL] [MAIN ] CMP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:03:02.246243] [WARN ] [MAIN ] CMP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:03:02.246285] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-26T18:03:02.246349] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-26T18:03:02.246453] [INFO ] [LOCAL ] CMP: Starting deletion of derivative data. [2025-09-26T18:03:02.246954] [DEBUG] [LOCAL ] CMP: Deleted derivative data file. [2025-09-26T18:03:02.247076] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMP took 26.6s. Estimated remaining: 4h 9m 26s. Rate: 7.6 symbols/min [2025-09-26T18:03:02.453092] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T18:03:02.462795] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-09-26T18:03:03.515510] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-26T18:03:03.525835] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-26T18:03:04.439278] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T18:03:04.450317] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-09-26T18:03:04.793175] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T18:03:04.803728] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-26T18:03:05.701692] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:03:05.713512] [INFO ] [REMOTE ] CMPO: Full fetch complete (58943 records). [2025-09-26T18:03:05.713777] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-09-26T18:03:06.143272] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-09-26T18:03:06.143376] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-09-26T18:03:06.144132] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-09-26T18:03:06.144201] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-09-26T18:03:06.145618] [DEBUG] [LOCAL ] CMPO: Trimmed 58943 records to 40071 (keeping 200 days of data) [2025-09-26T18:03:06.397672] [DEBUG] [LOCAL ] CMPO: Primary data saved (40071 records). [2025-09-26T18:03:06.397818] [INFO ] [MAIN ] CMPO: Full history saved. [2025-09-26T18:03:06.400812] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMPO took 27.2s. Estimated remaining: 4h 9m 4s. Rate: 7.6 symbols/min [2025-09-26T18:03:06.521087] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T18:03:06.529841] [INFO ] [REMOTE ] CMI: Full fetch complete (59962 records). [2025-09-26T18:03:06.530015] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-26T18:03:06.955351] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-26T18:03:06.955451] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-26T18:03:06.956163] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-26T18:03:06.956236] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-26T18:03:06.958563] [DEBUG] [LOCAL ] CMI: Trimmed 59962 records to 42484 (keeping 200 days of data) [2025-09-26T18:03:07.239550] [DEBUG] [LOCAL ] CMI: Primary data saved (42484 records). [2025-09-26T18:03:07.239724] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-26T18:03:07.239837] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMI took 33.0s. Estimated remaining: 4h 8m 28s. Rate: 7.6 symbols/min [2025-09-26T18:03:07.944379] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:08.008634] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:08.006789] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:08.042566] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:08.047873] [DEBUG] [LOCAL ] CMSA: Loaded 3406 existing records from primary storage. [2025-09-26T18:03:08.049636] [INFO ] [MAIN ] CMSA: Loaded 3406 existing records. [2025-09-26T18:03:08.124515] [DEBUG] [LOCAL ] CMSC: Loaded 5103 existing records from primary storage. [2025-09-26T18:03:08.159379] [INFO ] [MAIN ] CMSC: Loaded 5103 existing records. [2025-09-26T18:03:08.385312] [DEBUG] [LOCAL ] CMRE: Loaded 35796 existing records from primary storage. [2025-09-26T18:03:08.402036] [INFO ] [MAIN ] CMRE: Loaded 35796 existing records. [2025-09-26T18:03:08.567264] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:08.580167] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-26T18:03:08.585507] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-26T18:03:08.636812] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-26T18:03:08.655503] [DEBUG] [LOCAL ] CMS: Loaded 52986 existing records from primary storage. [2025-09-26T18:03:08.670868] [INFO ] [MAIN ] CMS: Loaded 52986 existing records. [2025-09-26T18:03:08.722168] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:08.676197] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-26T18:03:08.791230] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-26T18:03:08.791381] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-26T18:03:08.841087] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-26T18:03:08.926783] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-26T18:03:09.135291] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:09.181311] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-26T18:03:09.211582] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-26T18:03:09.258990] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-26T18:03:09.374000] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-26T18:03:09.447107] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:09.512854] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-26T18:03:09.613679] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-26T18:03:09.823172] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-26T18:03:09.862363] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-26T18:03:10.186212] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:10.306741] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-26T18:03:10.359519] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:10.383414] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-26T18:03:10.650105] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:10.661881] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-26T18:03:10.746252] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:10.746576] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-26T18:03:10.946292] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T18:03:10.948034] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-26T18:03:11.047184] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T18:03:11.049183] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-26T18:03:11.288816] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-26T18:03:11.290440] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-26T18:03:11.457729] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T18:03:11.460924] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-26T18:03:11.615019] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T18:03:11.635799] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T18:03:11.806708] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-26T18:03:11.956907] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-26T18:03:12.284675] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:03:12.756760] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-26T18:03:13.097370] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T18:03:13.211098] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T18:03:13.556738] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-26T18:03:14.356798] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-26T18:03:14.909096] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T18:03:15.156755] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-26T18:03:15.226512] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:03:15.578551] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-26T18:03:15.956734] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-26T18:03:16.756743] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-26T18:03:17.381390] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:03:17.556723] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-26T18:03:18.356741] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-26T18:03:18.467946] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T18:03:18.621490] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T18:03:18.733937] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-26T18:03:19.156754] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-26T18:03:19.897614] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T18:03:19.956780] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-26T18:03:20.436352] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T18:03:20.756769] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-26T18:03:21.556741] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-26T18:03:22.184199] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T18:03:22.211247] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T18:03:22.356750] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-26T18:03:23.156730] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-26T18:03:23.488300] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T18:03:23.617998] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T18:03:23.956730] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-26T18:03:24.756803] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-26T18:03:25.353414] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T18:03:25.556733] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-26T18:03:26.263742] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:03:26.356753] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-26T18:03:27.087225] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:03:27.156733] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-26T18:03:27.963189] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-26T18:03:27.970369] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:03:28.335770] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T18:03:28.344068] [INFO ] [REMOTE ] CMRE: Full fetch complete (49476 records). [2025-09-26T18:03:28.344249] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-26T18:03:28.344993] [FATAL] [VALIDATOR ] CMRE: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:03:28.345100] [FATAL] [MAIN ] CMRE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:03:28.345144] [WARN ] [MAIN ] CMRE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:03:28.345184] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-26T18:03:28.345296] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-09-26T18:03:28.345364] [INFO ] [LOCAL ] CMRE: Starting deletion of derivative data. [2025-09-26T18:03:28.345880] [DEBUG] [LOCAL ] CMRE: Deleted derivative data file. [2025-09-26T18:03:28.346005] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMRE took 21.1s. Estimated remaining: 4h 9m 12s. Rate: 7.6 symbols/min [2025-09-26T18:03:28.463547] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T18:03:28.535757] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:28.546669] [DEBUG] [LOCAL ] CMSD: Loaded 8149 existing records from primary storage. [2025-09-26T18:03:28.546812] [INFO ] [MAIN ] CMSD: Loaded 8149 existing records. [2025-09-26T18:03:28.735884] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:28.736151] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-26T18:03:28.736200] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-26T18:03:28.736465] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-26T18:03:28.736536] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-26T18:03:28.761915] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-26T18:03:29.124664] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:29.386963] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T18:03:29.388417] [INFO ] [REMOTE ] CMSA: Full fetch complete (5043 records). [2025-09-26T18:03:29.388503] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-26T18:03:29.561808] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-26T18:03:29.827321] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-26T18:03:29.827415] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-26T18:03:29.827590] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-26T18:03:29.827702] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-26T18:03:29.828228] [DEBUG] [LOCAL ] CMSA: Trimmed 5043 records to 3421 (keeping 200 days of data) [2025-09-26T18:03:29.853839] [DEBUG] [LOCAL ] CMSA: Primary data saved (3421 records). [2025-09-26T18:03:29.854066] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-26T18:03:29.854281] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSA took 22.6s. Estimated remaining: 4h 8m 39s. Rate: 7.6 symbols/min [2025-09-26T18:03:30.042391] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:30.093256] [DEBUG] [LOCAL ] CMTG: Loaded 37770 existing records from primary storage. [2025-09-26T18:03:30.093486] [INFO ] [MAIN ] CMTG: Loaded 37770 existing records. [2025-09-26T18:03:30.282767] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:30.283041] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-26T18:03:30.283089] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-26T18:03:30.283322] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-26T18:03:30.283393] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-26T18:03:30.361837] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-26T18:03:30.623851] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T18:03:30.683881] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:30.968373] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T18:03:31.156731] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-26T18:03:31.709739] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T18:03:31.956752] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-26T18:03:32.615575] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:03:32.756750] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-26T18:03:33.461409] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T18:03:33.463001] [INFO ] [REMOTE ] CMSC: Full fetch complete (7167 records). [2025-09-26T18:03:33.463086] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-26T18:03:33.561890] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-26T18:03:33.859324] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-26T18:03:33.859414] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-26T18:03:33.859629] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-26T18:03:33.859709] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-26T18:03:33.860161] [DEBUG] [LOCAL ] CMSC: Trimmed 7167 records to 5131 (keeping 200 days of data) [2025-09-26T18:03:33.892930] [DEBUG] [LOCAL ] CMSC: Primary data saved (5131 records). [2025-09-26T18:03:33.893052] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-26T18:03:33.893141] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMSC took 26.7s. Estimated remaining: 4h 8m 16s. Rate: 7.6 symbols/min [2025-09-26T18:03:34.073414] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:34.082467] [DEBUG] [LOCAL ] CMU: Loaded 7283 existing records from primary storage. [2025-09-26T18:03:34.082568] [INFO ] [MAIN ] CMU: Loaded 7283 existing records. [2025-09-26T18:03:34.270806] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:34.271048] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-26T18:03:34.271098] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-26T18:03:34.271299] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-26T18:03:34.271403] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-26T18:03:34.362555] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-26T18:03:34.616791] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T18:03:34.709982] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:35.156751] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-26T18:03:35.635002] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T18:03:35.906042] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T18:03:35.956771] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-26T18:03:36.756781] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-26T18:03:37.223107] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T18:03:37.556779] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-26T18:03:38.077279] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-26T18:03:38.356768] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-26T18:03:38.877198] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-26T18:03:39.156785] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-26T18:03:39.450007] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:03:39.653949] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T18:03:39.956739] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-26T18:03:40.756701] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-26T18:03:40.831788] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T18:03:41.556735] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-26T18:03:42.191281] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T18:03:42.356780] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-26T18:03:42.499627] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T18:03:43.034978] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T18:03:43.156799] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-26T18:03:43.818752] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T18:03:43.956809] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-26T18:03:44.756728] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-26T18:03:45.555170] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:03:45.562663] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-26T18:03:46.131718] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:03:46.356722] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-26T18:03:46.491175] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:03:47.156730] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-26T18:03:47.707622] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T18:03:47.735081] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T18:03:47.956724] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-26T18:03:48.756784] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-26T18:03:49.556711] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-26T18:03:49.592230] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T18:03:49.594228] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T18:03:50.356778] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-26T18:03:51.156777] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-26T18:03:51.457062] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T18:03:51.494775] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T18:03:51.763031] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T18:03:51.765137] [INFO ] [REMOTE ] CMSD: Full fetch complete (12466 records). [2025-09-26T18:03:51.765229] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-26T18:03:51.960065] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-26T18:03:52.195852] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-26T18:03:52.195936] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-26T18:03:52.196258] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-26T18:03:52.196298] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-26T18:03:52.196862] [DEBUG] [LOCAL ] CMSD: Trimmed 12466 records to 8184 (keeping 200 days of data) [2025-09-26T18:03:52.253356] [DEBUG] [LOCAL ] CMSD: Primary data saved (8184 records). [2025-09-26T18:03:52.253506] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-26T18:03:52.253614] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMSD took 23.9s. Estimated remaining: 4h 8m 49s. Rate: 7.6 symbols/min [2025-09-26T18:03:52.451876] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:52.503425] [DEBUG] [LOCAL ] CNA: Loaded 32996 existing records from primary storage. [2025-09-26T18:03:52.503630] [INFO ] [MAIN ] CNA: Loaded 32996 existing records. [2025-09-26T18:03:52.703329] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:52.703968] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-26T18:03:52.704030] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-26T18:03:52.704330] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-26T18:03:52.704419] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-26T18:03:52.762611] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-26T18:03:53.095989] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:53.556757] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-26T18:03:53.880058] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:03:53.897557] [INFO ] [REMOTE ] CMS: Full fetch complete (76018 records). [2025-09-26T18:03:53.897791] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-26T18:03:54.246711] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:03:54.365210] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-26T18:03:54.394025] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-26T18:03:54.394146] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-26T18:03:54.395381] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-26T18:03:54.395669] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-26T18:03:54.403410] [DEBUG] [LOCAL ] CMS: Trimmed 76018 records to 53371 (keeping 200 days of data) [2025-09-26T18:03:54.416132] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T18:03:54.764508] [DEBUG] [LOCAL ] CMS: Primary data saved (53371 records). [2025-09-26T18:03:54.764675] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-26T18:03:54.764837] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMS took 47.5s. Estimated remaining: 4h 8m 20s. Rate: 7.6 symbols/min [2025-09-26T18:03:54.952473] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:03:55.011244] [DEBUG] [LOCAL ] CNC: Loaded 54128 existing records from primary storage. [2025-09-26T18:03:55.011403] [INFO ] [MAIN ] CNC: Loaded 54128 existing records. [2025-09-26T18:03:55.152860] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-26T18:03:55.163563] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-26T18:03:55.242497] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:03:55.242880] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-26T18:03:55.242940] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-26T18:03:55.243680] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-26T18:03:55.243743] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-26T18:03:55.618770] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:03:55.956725] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-26T18:03:56.756746] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-26T18:03:56.894687] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T18:03:56.920612] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:03:57.556727] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-26T18:03:58.115683] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T18:03:58.316691] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:03:58.356730] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-26T18:03:59.156742] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-26T18:03:59.412976] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:03:59.956737] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-26T18:04:00.756735] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-26T18:04:00.818122] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T18:04:01.477259] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:04:01.484942] [INFO ] [REMOTE ] CMTG: Full fetch complete (53359 records). [2025-09-26T18:04:01.485090] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-26T18:04:01.561715] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-26T18:04:01.921730] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-26T18:04:01.921859] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-26T18:04:01.922753] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-26T18:04:01.922962] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-26T18:04:01.943667] [DEBUG] [LOCAL ] CMTG: Trimmed 53359 records to 37931 (keeping 200 days of data) [2025-09-26T18:04:01.944935] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T18:04:02.203023] [DEBUG] [LOCAL ] CMTG: Primary data saved (37931 records). [2025-09-26T18:04:02.203216] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-26T18:04:02.204127] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CMTG took 32.3s. Estimated remaining: 4h 8m 10s. Rate: 7.6 symbols/min [2025-09-26T18:04:02.361826] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-26T18:04:02.388948] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:02.389148] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-09-26T18:04:02.389194] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-09-26T18:04:02.389338] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-26T18:04:02.389396] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-26T18:04:02.389485] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-09-26T18:04:02.389523] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-26T18:04:02.777056] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:02.821281] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T18:04:03.156697] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-26T18:04:03.188361] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:04:03.766684] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T18:04:03.956735] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-26T18:04:04.756760] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-26T18:04:04.922204] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T18:04:05.556728] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-26T18:04:06.027859] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T18:04:06.358805] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-26T18:04:06.362725] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:04:07.156770] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-26T18:04:07.329532] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T18:04:07.956731] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-26T18:04:08.319876] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T18:04:08.416680] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T18:04:08.756738] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-26T18:04:09.192874] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T18:04:09.556732] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-26T18:04:10.331124] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T18:04:10.332746] [INFO ] [REMOTE ] CMU: Full fetch complete (9632 records). [2025-09-26T18:04:10.332833] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-26T18:04:10.365347] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-26T18:04:10.747036] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-26T18:04:10.747144] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-26T18:04:10.747400] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-26T18:04:10.747442] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-26T18:04:10.748403] [DEBUG] [LOCAL ] CMU: Trimmed 9632 records to 7303 (keeping 200 days of data) [2025-09-26T18:04:10.797276] [DEBUG] [LOCAL ] CMU: Primary data saved (7303 records). [2025-09-26T18:04:10.797420] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-26T18:04:10.797543] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CMU took 36.9s. Estimated remaining: 4h 8m 5s. Rate: 7.6 symbols/min [2025-09-26T18:04:10.976405] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:11.049768] [DEBUG] [LOCAL ] CNH: Loaded 53949 existing records from primary storage. [2025-09-26T18:04:11.049930] [INFO ] [MAIN ] CNH: Loaded 53949 existing records. [2025-09-26T18:04:11.161155] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-26T18:04:11.249064] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:11.256592] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-26T18:04:11.257533] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T18:04:11.257225] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-26T18:04:11.261099] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-26T18:04:11.261162] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-26T18:04:11.642035] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:11.956725] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-26T18:04:12.657752] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T18:04:12.756745] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-26T18:04:13.556738] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-26T18:04:14.356728] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-26T18:04:14.472416] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-26T18:04:14.642611] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T18:04:15.156748] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-26T18:04:15.956795] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-26T18:04:16.312978] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T18:04:16.756695] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-26T18:04:16.965441] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (3.41 seconds). [2025-09-26T18:04:17.010870] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T18:04:17.038662] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T18:04:17.553824] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:04:17.556681] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-26T18:04:18.352113] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T18:04:18.356666] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-26T18:04:19.122863] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T18:04:19.156680] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-26T18:04:19.956707] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-26T18:04:20.097867] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T18:04:20.756728] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-26T18:04:21.556729] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-26T18:04:21.831096] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T18:04:21.835319] [INFO ] [REMOTE ] CNF: Full fetch complete (12885 records). [2025-09-26T18:04:21.835442] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-26T18:04:22.244851] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-26T18:04:22.280968] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-26T18:04:22.281379] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-26T18:04:22.281764] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-26T18:04:22.281842] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-26T18:04:22.282732] [DEBUG] [LOCAL ] CNF: Trimmed 12885 records to 11166 (keeping 200 days of data) [2025-09-26T18:04:22.354592] [DEBUG] [LOCAL ] CNF: Primary data saved (11166 records). [2025-09-26T18:04:22.354784] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-26T18:04:22.354909] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CNF took 20.2s. Estimated remaining: 4h 8m 11s. Rate: 7.6 symbols/min [2025-09-26T18:04:22.367333] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-26T18:04:22.552020] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:22.617779] [DEBUG] [LOCAL ] CNI: Loaded 52046 existing records from primary storage. [2025-09-26T18:04:22.617968] [INFO ] [MAIN ] CNI: Loaded 52046 existing records. [2025-09-26T18:04:22.868186] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:22.868545] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-26T18:04:22.868603] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-26T18:04:22.868906] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-26T18:04:22.868966] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-26T18:04:23.183340] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-26T18:04:23.198445] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T18:04:23.290572] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:23.956737] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-26T18:04:24.762408] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-26T18:04:24.769154] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-26T18:04:25.253291] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-26T18:04:25.512394] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T18:04:25.556686] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-26T18:04:25.939123] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T18:04:26.356760] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-26T18:04:26.976437] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:04:27.156749] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-26T18:04:27.837939] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:04:27.956782] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-26T18:04:28.690978] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:04:28.756736] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-26T18:04:29.556738] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-26T18:04:30.121839] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T18:04:30.128344] [INFO ] [REMOTE ] CNA: Full fetch complete (45554 records). [2025-09-26T18:04:30.128477] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-26T18:04:30.361845] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-26T18:04:30.537617] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-26T18:04:30.537773] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-26T18:04:30.538406] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-26T18:04:30.538469] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-26T18:04:30.539547] [DEBUG] [LOCAL ] CNA: Trimmed 45554 records to 33235 (keeping 200 days of data) [2025-09-26T18:04:30.754317] [DEBUG] [LOCAL ] CNA: Primary data saved (33235 records). [2025-09-26T18:04:30.754470] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-26T18:04:30.754560] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNA took 38.5s. Estimated remaining: 4h 8m 5s. Rate: 7.6 symbols/min [2025-09-26T18:04:30.949704] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:31.008015] [DEBUG] [LOCAL ] CNK: Loaded 53281 existing records from primary storage. [2025-09-26T18:04:31.008259] [INFO ] [MAIN ] CNK: Loaded 53281 existing records. [2025-09-26T18:04:31.240779] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:31.258268] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-26T18:04:31.258472] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-26T18:04:31.258888] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-26T18:04:31.258979] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-26T18:04:31.358047] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (3.40 seconds). [2025-09-26T18:04:31.408214] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-26T18:04:31.686047] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:31.723895] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T18:04:31.956736] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-26T18:04:32.383340] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-26T18:04:32.756769] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-26T18:04:33.556792] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-26T18:04:33.843560] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T18:04:33.942047] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-26T18:04:33.952244] [INFO ] [REMOTE ] CNC: Full fetch complete (77283 records). [2025-09-26T18:04:33.952411] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-26T18:04:33.953226] [FATAL] [VALIDATOR ] CNC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:04:33.953320] [FATAL] [MAIN ] CNC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:04:33.953366] [WARN ] [MAIN ] CNC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:04:33.953442] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-26T18:04:33.953511] [DEBUG] [LOCAL ] CNC: No primary data file found to delete. [2025-09-26T18:04:33.953549] [INFO ] [LOCAL ] CNC: Starting deletion of derivative data. [2025-09-26T18:04:33.954078] [DEBUG] [LOCAL ] CNC: Deleted derivative data file. [2025-09-26T18:04:33.954182] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNC took 39.2s. Estimated remaining: 4h 7m 39s. Rate: 7.6 symbols/min [2025-09-26T18:04:34.144616] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:34.182759] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:04:34.237335] [DEBUG] [LOCAL ] CNM: Loaded 51358 existing records from primary storage. [2025-09-26T18:04:34.237550] [INFO ] [MAIN ] CNM: Loaded 51358 existing records. [2025-09-26T18:04:34.361000] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-26T18:04:34.468062] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:34.468376] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-26T18:04:34.468435] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-26T18:04:34.468728] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-26T18:04:34.468791] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-26T18:04:34.847035] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:35.005536] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T18:04:35.156882] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-26T18:04:35.956717] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-26T18:04:36.087016] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:04:36.695843] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:04:36.756715] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-26T18:04:37.268407] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T18:04:37.556721] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-26T18:04:38.356736] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-26T18:04:38.690600] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-26T18:04:39.037527] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T18:04:39.156782] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-26T18:04:39.752175] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:04:39.956726] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-26T18:04:40.684377] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T18:04:40.756758] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-26T18:04:41.556698] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-26T18:04:41.590074] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:04:42.086693] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:04:42.356738] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-26T18:04:43.023097] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T18:04:43.156727] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-26T18:04:43.696014] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T18:04:43.956774] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-26T18:04:44.558387] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:04:44.756742] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-26T18:04:45.414630] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T18:04:45.556728] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-26T18:04:46.235971] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T18:04:46.356724] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-26T18:04:47.156696] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-26T18:04:47.603786] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T18:04:47.956777] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-26T18:04:48.112818] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T18:04:48.634541] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:04:48.756767] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-26T18:04:49.556706] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-26T18:04:49.789545] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T18:04:50.342221] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T18:04:50.356674] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-26T18:04:51.088710] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T18:04:51.156750] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-26T18:04:51.769900] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:04:51.956754] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-26T18:04:52.674943] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T18:04:52.756747] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-26T18:04:53.265600] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T18:04:53.556734] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-26T18:04:54.298382] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T18:04:54.310873] [INFO ] [REMOTE ] CNI: Full fetch complete (74666 records). [2025-09-26T18:04:54.311101] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-26T18:04:54.361947] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-26T18:04:54.769628] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-26T18:04:54.769744] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-26T18:04:54.770543] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-26T18:04:54.770608] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-26T18:04:54.772121] [DEBUG] [LOCAL ] CNI: Trimmed 74666 records to 52419 (keeping 200 days of data) [2025-09-26T18:04:55.110900] [DEBUG] [LOCAL ] CNI: Primary data saved (52419 records). [2025-09-26T18:04:55.111047] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-26T18:04:55.111135] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNI took 32.8s. Estimated remaining: 4h 8m 22s. Rate: 7.6 symbols/min [2025-09-26T18:04:55.158913] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-26T18:04:55.298476] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:55.332842] [DEBUG] [LOCAL ] CNMD: Loaded 32633 existing records from primary storage. [2025-09-26T18:04:55.332988] [INFO ] [MAIN ] CNMD: Loaded 32633 existing records. [2025-09-26T18:04:55.528744] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:55.546307] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-26T18:04:55.561666] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-26T18:04:55.563908] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-26T18:04:55.563835] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T18:04:55.564120] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-26T18:04:55.948112] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:55.956665] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-26T18:04:56.291563] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T18:04:56.302611] [INFO ] [REMOTE ] CNM: Full fetch complete (73623 records). [2025-09-26T18:04:56.302814] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-26T18:04:56.737759] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-26T18:04:56.738020] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-26T18:04:56.738910] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-26T18:04:56.739083] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-26T18:04:56.741106] [DEBUG] [LOCAL ] CNM: Trimmed 73623 records to 51747 (keeping 200 days of data) [2025-09-26T18:04:56.800032] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-26T18:04:56.866113] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:04:56.881363] [INFO ] [REMOTE ] CNH: Full fetch complete (77531 records). [2025-09-26T18:04:56.882144] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-26T18:04:57.364487] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-26T18:04:57.365151] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-26T18:04:57.366615] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-26T18:04:57.367904] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:04:57.368285] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-26T18:04:57.378770] [DEBUG] [LOCAL ] CNH: Trimmed 77531 records to 54337 (keeping 200 days of data) [2025-09-26T18:04:57.557012] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-26T18:04:57.810357] [DEBUG] [LOCAL ] CNM: Primary data saved (51747 records). [2025-09-26T18:04:57.810921] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-26T18:04:57.811342] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNM took 23.9s. Estimated remaining: 4h 7m 54s. Rate: 7.6 symbols/min [2025-09-26T18:04:58.022189] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:58.132476] [DEBUG] [LOCAL ] CNNE: Loaded 37006 existing records from primary storage. [2025-09-26T18:04:58.133773] [INFO ] [MAIN ] CNNE: Loaded 37006 existing records. [2025-09-26T18:04:58.345266] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:58.347698] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-26T18:04:58.350671] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-26T18:04:58.350580] [DEBUG] [LOCAL ] CNH: Primary data saved (54337 records). [2025-09-26T18:04:58.350829] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-26T18:04:58.351019] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-26T18:04:58.351091] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-26T18:04:58.350997] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNH took 47.6s. Estimated remaining: 4h 7m 18s. Rate: 7.6 symbols/min [2025-09-26T18:04:58.862122] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:04:58.999264] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:59.000325] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-26T18:04:59.052401] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-26T18:04:59.076802] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T18:04:59.098003] [DEBUG] [LOCAL ] CNO: Loaded 41654 existing records from primary storage. [2025-09-26T18:04:59.098166] [INFO ] [MAIN ] CNO: Loaded 41654 existing records. [2025-09-26T18:04:59.165489] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-26T18:04:59.290995] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:04:59.291260] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-26T18:04:59.291321] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-26T18:04:59.291591] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-26T18:04:59.291687] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-26T18:04:59.680791] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:04:59.956745] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-26T18:05:00.024143] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T18:05:00.210011] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T18:05:00.756754] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-26T18:05:01.425207] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T18:05:01.556764] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-26T18:05:02.356760] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-26T18:05:02.777285] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T18:05:02.788533] [INFO ] [REMOTE ] CNK: Full fetch complete (75321 records). [2025-09-26T18:05:02.788770] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-26T18:05:02.789725] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:05:02.789832] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:05:02.789877] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:05:02.789943] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-26T18:05:02.790014] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-09-26T18:05:02.790058] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-09-26T18:05:02.790518] [DEBUG] [LOCAL ] CNK: Deleted derivative data file. [2025-09-26T18:05:02.791760] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNK took 32.0s. Estimated remaining: 4h 6m 57s. Rate: 7.6 symbols/min [2025-09-26T18:05:02.999130] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:03.058810] [DEBUG] [LOCAL ] CNP: Loaded 53859 existing records from primary storage. [2025-09-26T18:05:03.058989] [INFO ] [MAIN ] CNP: Loaded 53859 existing records. [2025-09-26T18:05:03.159663] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-26T18:05:03.288980] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:05:03.311486] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:03.312082] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-26T18:05:03.312295] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-26T18:05:03.312564] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-26T18:05:03.312625] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-26T18:05:03.692529] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:03.709777] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:05:03.956726] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-26T18:05:04.756746] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-26T18:05:04.932339] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T18:05:05.248191] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T18:05:05.556771] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-26T18:05:06.356741] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-26T18:05:06.480614] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T18:05:07.149839] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T18:05:07.158890] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-26T18:05:07.257116] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:05:07.956771] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-26T18:05:08.595748] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T18:05:08.756732] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-26T18:05:09.144920] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T18:05:09.556752] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-26T18:05:10.121060] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T18:05:10.356731] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-26T18:05:10.733211] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:05:11.156738] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-26T18:05:11.781792] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:05:11.956723] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-26T18:05:12.288389] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T18:05:12.756733] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-26T18:05:13.010618] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:05:13.556749] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-26T18:05:13.699269] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T18:05:14.356745] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-26T18:05:14.855003] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-26T18:05:15.156751] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-26T18:05:15.401132] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:05:15.956759] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-26T18:05:16.125968] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:05:16.756743] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-26T18:05:16.935689] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T18:05:17.556748] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-26T18:05:18.356726] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-26T18:05:18.444453] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:05:19.156696] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-26T18:05:19.221161] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T18:05:19.229361] [INFO ] [REMOTE ] CNMD: Full fetch complete (47167 records). [2025-09-26T18:05:19.229563] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-26T18:05:19.730144] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-26T18:05:19.730677] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-26T18:05:19.732453] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:05:19.731312] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-26T18:05:19.741392] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-26T18:05:19.743407] [DEBUG] [LOCAL ] CNMD: Trimmed 47167 records to 32884 (keeping 200 days of data) [2025-09-26T18:05:19.954536] [DEBUG] [LOCAL ] CNMD: Primary data saved (32884 records). [2025-09-26T18:05:19.954725] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-26T18:05:19.954845] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNMD took 24.8s. Estimated remaining: 4h 7m 25s. Rate: 7.6 symbols/min [2025-09-26T18:05:19.960402] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-26T18:05:20.152289] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:20.206216] [DEBUG] [LOCAL ] CNQ: Loaded 53971 existing records from primary storage. [2025-09-26T18:05:20.206413] [INFO ] [MAIN ] CNQ: Loaded 53971 existing records. [2025-09-26T18:05:20.429071] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T18:05:20.434843] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:20.443040] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-26T18:05:20.443378] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-26T18:05:20.444029] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-26T18:05:20.444094] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-26T18:05:20.761868] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-26T18:05:20.836551] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:21.556750] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-26T18:05:21.772532] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T18:05:21.951321] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T18:05:22.356768] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-26T18:05:23.156747] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-26T18:05:23.597368] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T18:05:23.956722] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-26T18:05:24.110409] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T18:05:24.501860] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T18:05:24.756771] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-26T18:05:25.419005] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T18:05:25.556734] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-26T18:05:25.976255] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T18:05:25.983913] [INFO ] [REMOTE ] CNNE: Full fetch complete (49490 records). [2025-09-26T18:05:25.984056] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-26T18:05:26.366829] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-26T18:05:26.414711] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-26T18:05:26.414804] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-26T18:05:26.415403] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-26T18:05:26.415463] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-26T18:05:26.416750] [DEBUG] [LOCAL ] CNNE: Trimmed 49490 records to 37257 (keeping 200 days of data) [2025-09-26T18:05:26.649482] [DEBUG] [LOCAL ] CNNE: Primary data saved (37257 records). [2025-09-26T18:05:26.649682] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-26T18:05:26.650008] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNNE took 28.8s. Estimated remaining: 4h 7m 12s. Rate: 7.6 symbols/min [2025-09-26T18:05:26.834893] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:26.835161] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-26T18:05:26.835263] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-26T18:05:26.835749] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-26T18:05:26.850902] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-26T18:05:26.860792] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-26T18:05:26.860893] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-26T18:05:26.927051] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T18:05:27.161944] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-26T18:05:27.276066] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:27.775596] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T18:05:27.956768] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-26T18:05:28.345846] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T18:05:28.756774] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-26T18:05:28.977234] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:05:28.977572] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-26T18:05:29.352921] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:05:29.556732] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-26T18:05:30.356748] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-26T18:05:31.157930] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-26T18:05:31.166044] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:05:31.760534] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T18:05:31.956739] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-26T18:05:32.095269] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T18:05:32.756782] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-26T18:05:33.535375] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T18:05:33.556678] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-26T18:05:34.123904] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T18:05:34.356747] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-26T18:05:34.922458] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T18:05:34.930749] [INFO ] [REMOTE ] CNO: Full fetch complete (60620 records). [2025-09-26T18:05:34.930883] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-26T18:05:35.162118] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-26T18:05:35.348599] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-26T18:05:35.348724] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-26T18:05:35.349511] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-26T18:05:35.349600] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-26T18:05:35.351069] [DEBUG] [LOCAL ] CNO: Trimmed 60620 records to 41901 (keeping 200 days of data) [2025-09-26T18:05:35.510957] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T18:05:35.668790] [DEBUG] [LOCAL ] CNO: Primary data saved (41901 records). [2025-09-26T18:05:35.668940] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-26T18:05:35.669034] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNO took 37.3s. Estimated remaining: 4h 7m 8s. Rate: 7.6 symbols/min [2025-09-26T18:05:35.857486] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:35.879838] [DEBUG] [LOCAL ] CNS: Loaded 21094 existing records from primary storage. [2025-09-26T18:05:35.879994] [INFO ] [MAIN ] CNS: Loaded 21094 existing records. [2025-09-26T18:05:35.961968] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-26T18:05:36.085288] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:36.085620] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-26T18:05:36.085720] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-26T18:05:36.085989] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-26T18:05:36.086051] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-26T18:05:36.475134] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:36.708539] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:05:36.719382] [INFO ] [REMOTE ] CNP: Full fetch complete (77366 records). [2025-09-26T18:05:36.719559] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-26T18:05:36.764858] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-26T18:05:37.192982] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-26T18:05:37.193083] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-26T18:05:37.193955] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-26T18:05:37.194033] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-26T18:05:37.195735] [DEBUG] [LOCAL ] CNP: Trimmed 77366 records to 54249 (keeping 200 days of data) [2025-09-26T18:05:37.478972] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:05:37.574804] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-26T18:05:37.612611] [DEBUG] [LOCAL ] CNP: Primary data saved (54249 records). [2025-09-26T18:05:37.612841] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-26T18:05:37.613014] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNP took 34.8s. Estimated remaining: 4h 6m 38s. Rate: 7.6 symbols/min [2025-09-26T18:05:37.807694] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:37.859016] [DEBUG] [LOCAL ] CNX: Loaded 51770 existing records from primary storage. [2025-09-26T18:05:37.859274] [INFO ] [MAIN ] CNX: Loaded 51770 existing records. [2025-09-26T18:05:38.003070] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:05:38.068590] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:38.068866] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-26T18:05:38.069022] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-26T18:05:38.069352] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-26T18:05:38.069412] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-26T18:05:38.365145] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-26T18:05:38.453938] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:39.076890] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T18:05:39.156734] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-26T18:05:39.752121] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T18:05:39.956770] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-26T18:05:40.251030] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:05:40.756755] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-26T18:05:41.556736] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-26T18:05:41.638067] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:05:42.356730] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-26T18:05:42.636606] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T18:05:43.156729] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-26T18:05:43.390667] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T18:05:43.508355] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T18:05:43.956772] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-26T18:05:44.756736] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-26T18:05:44.974376] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:05:45.554661] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T18:05:45.565364] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-26T18:05:46.000632] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:05:46.356718] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-26T18:05:47.156749] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-26T18:05:47.319604] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T18:05:47.956805] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-26T18:05:48.130002] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T18:05:48.143514] [INFO ] [REMOTE ] CNQ: Full fetch complete (77549 records). [2025-09-26T18:05:48.143790] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-26T18:05:48.653018] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-26T18:05:48.653257] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-26T18:05:48.654282] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-26T18:05:48.654459] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-26T18:05:48.671820] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:05:48.678446] [DEBUG] [LOCAL ] CNQ: Trimmed 77549 records to 54361 (keeping 200 days of data) [2025-09-26T18:05:48.766335] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-26T18:05:49.076582] [DEBUG] [LOCAL ] CNQ: Primary data saved (54361 records). [2025-09-26T18:05:49.076781] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-26T18:05:49.076882] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNQ took 29.1s. Estimated remaining: 4h 6m 43s. Rate: 7.6 symbols/min [2025-09-26T18:05:49.268136] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:49.298946] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T18:05:49.340236] [DEBUG] [LOCAL ] CODI: Loaded 40015 existing records from primary storage. [2025-09-26T18:05:49.340394] [INFO ] [MAIN ] CODI: Loaded 40015 existing records. [2025-09-26T18:05:49.541689] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:49.542020] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-26T18:05:49.542080] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-26T18:05:49.542332] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-26T18:05:49.542397] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-26T18:05:49.566502] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-26T18:05:49.988345] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:05:50.356717] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-26T18:05:50.513536] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T18:05:50.659372] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T18:05:51.156749] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-26T18:05:51.956760] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-26T18:05:52.026128] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T18:05:52.074488] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T18:05:52.613811] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T18:05:52.756769] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-26T18:05:53.556744] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-26T18:05:54.356733] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-26T18:05:54.441542] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:05:54.489362] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T18:05:55.156743] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-26T18:05:55.956735] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-26T18:05:56.036477] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:05:56.072418] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T18:05:56.712896] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:05:56.756750] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-26T18:05:57.556723] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-26T18:05:57.864705] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T18:05:58.356752] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-26T18:05:58.551736] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T18:05:58.556744] [INFO ] [REMOTE ] CNS: Full fetch complete (30045 records). [2025-09-26T18:05:58.556842] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-26T18:05:58.975793] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-26T18:05:58.975882] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-26T18:05:58.976342] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-26T18:05:58.976383] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-26T18:05:58.977244] [DEBUG] [LOCAL ] CNS: Trimmed 30045 records to 21245 (keeping 200 days of data) [2025-09-26T18:05:59.115048] [DEBUG] [LOCAL ] CNS: Primary data saved (21245 records). [2025-09-26T18:05:59.115195] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-26T18:05:59.115285] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 23.4s. Estimated remaining: 4h 6m 44s. Rate: 7.6 symbols/min [2025-09-26T18:05:59.162752] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-26T18:05:59.332849] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:05:59.414218] [DEBUG] [LOCAL ] COF: Loaded 54000 existing records from primary storage. [2025-09-26T18:05:59.414442] [INFO ] [MAIN ] COF: Loaded 54000 existing records. [2025-09-26T18:05:59.609315] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:05:59.609831] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-26T18:05:59.609893] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-26T18:05:59.610218] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-26T18:05:59.610292] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-26T18:05:59.993219] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-26T18:06:00.001276] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:00.035228] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T18:06:00.050021] [INFO ] [REMOTE ] CNR: Full fetch complete (56816 records). [2025-09-26T18:06:00.050224] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-26T18:06:00.263699] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 176 unique days, need 200 days [2025-09-26T18:06:00.264364] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:06:00.264454] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:06:00.264535] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-26T18:06:00.264612] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-26T18:06:00.264683] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-26T18:06:00.264750] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-26T18:06:00.264869] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNR took 33.6s. Estimated remaining: 4h 6m 10s. Rate: 7.6 symbols/min [2025-09-26T18:06:00.453790] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:00.518789] [DEBUG] [LOCAL ] COHR: Loaded 53754 existing records from primary storage. [2025-09-26T18:06:00.518962] [INFO ] [MAIN ] COHR: Loaded 53754 existing records. [2025-09-26T18:06:00.725862] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:00.726202] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-26T18:06:00.726286] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-26T18:06:00.726667] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-26T18:06:00.726736] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-26T18:06:00.760777] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-26T18:06:01.134259] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:01.163258] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T18:06:01.421367] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:06:01.556751] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-26T18:06:02.356728] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-26T18:06:02.425712] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T18:06:03.134792] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:06:03.156684] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-26T18:06:03.935178] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T18:06:03.956719] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-26T18:06:04.756751] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-26T18:06:05.170875] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-26T18:06:05.556768] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-26T18:06:05.631233] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T18:06:06.119960] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T18:06:06.356740] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-26T18:06:07.156697] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-26T18:06:07.217452] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T18:06:07.956737] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-26T18:06:08.028928] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:06:08.525833] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:06:08.756771] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-26T18:06:09.556738] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-26T18:06:09.696786] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:06:10.339798] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T18:06:10.356689] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-26T18:06:11.156729] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-26T18:06:11.670453] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-26T18:06:11.884934] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:06:11.956717] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-26T18:06:12.645926] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:06:12.756733] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-26T18:06:13.033444] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T18:06:13.042346] [INFO ] [REMOTE ] CODI: Full fetch complete (50669 records). [2025-09-26T18:06:13.042564] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-26T18:06:13.479736] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-26T18:06:13.479844] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-26T18:06:13.480560] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-26T18:06:13.480628] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-26T18:06:13.481988] [DEBUG] [LOCAL ] CODI: Trimmed 50669 records to 40312 (keeping 200 days of data) [2025-09-26T18:06:13.573939] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-26T18:06:13.735934] [DEBUG] [LOCAL ] CODI: Primary data saved (40312 records). [2025-09-26T18:06:13.736137] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-26T18:06:13.736286] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CODI took 24.7s. Estimated remaining: 4h 6m 23s. Rate: 7.6 symbols/min [2025-09-26T18:06:13.919442] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:13.983417] [DEBUG] [LOCAL ] COLD: Loaded 52395 existing records from primary storage. [2025-09-26T18:06:13.983574] [INFO ] [MAIN ] COLD: Loaded 52395 existing records. [2025-09-26T18:06:14.182563] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:14.183083] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-26T18:06:14.183177] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-26T18:06:14.193598] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-26T18:06:14.213538] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-26T18:06:14.280813] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T18:06:14.361830] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-26T18:06:14.642988] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:15.156734] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-26T18:06:15.576480] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T18:06:15.781910] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:06:15.956715] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-26T18:06:16.756704] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-26T18:06:16.833886] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:06:17.568502] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-26T18:06:17.575143] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T18:06:18.053605] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T18:06:18.356768] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-26T18:06:19.068166] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T18:06:19.156809] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-26T18:06:19.956781] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-26T18:06:20.002632] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T18:06:20.013169] [INFO ] [REMOTE ] CNX: Full fetch complete (74771 records). [2025-09-26T18:06:20.013357] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-26T18:06:20.441681] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-26T18:06:20.441802] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-26T18:06:20.442762] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-26T18:06:20.442966] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-26T18:06:20.445111] [DEBUG] [LOCAL ] CNX: Trimmed 74771 records to 52150 (keeping 200 days of data) [2025-09-26T18:06:20.558911] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:06:20.761951] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-26T18:06:20.802963] [DEBUG] [LOCAL ] CNX: Primary data saved (52150 records). [2025-09-26T18:06:20.803126] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-26T18:06:20.803265] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. CNX took 43.2s. Estimated remaining: 4h 6m 12s. Rate: 7.6 symbols/min [2025-09-26T18:06:20.989158] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:21.043889] [DEBUG] [LOCAL ] COMP: Loaded 53776 existing records from primary storage. [2025-09-26T18:06:21.044073] [INFO ] [MAIN ] COMP: Loaded 53776 existing records. [2025-09-26T18:06:21.242500] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:21.242798] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-26T18:06:21.242870] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-26T18:06:21.243144] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-26T18:06:21.243217] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-26T18:06:21.559310] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-26T18:06:21.637082] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:21.676157] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:06:21.954625] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T18:06:22.356769] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-26T18:06:23.156761] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-26T18:06:23.962083] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-26T18:06:23.980124] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-26T18:06:24.058264] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T18:06:24.560326] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:06:24.756737] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-26T18:06:25.556732] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-26T18:06:26.130436] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-26T18:06:26.356724] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-26T18:06:26.485115] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:06:26.993175] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T18:06:27.156764] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-26T18:06:27.956769] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-26T18:06:28.254405] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T18:06:28.406059] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T18:06:28.756746] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-26T18:06:29.556733] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-26T18:06:29.855975] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T18:06:30.356753] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-26T18:06:31.156703] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-26T18:06:31.226232] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-26T18:06:31.237156] [INFO ] [REMOTE ] COHR: Full fetch complete (77111 records). [2025-09-26T18:06:31.237329] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-26T18:06:31.701340] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-26T18:06:31.704823] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-26T18:06:31.705914] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-26T18:06:31.706294] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-26T18:06:31.709060] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-26T18:06:31.722958] [DEBUG] [LOCAL ] COHR: Trimmed 77111 records to 54144 (keeping 200 days of data) [2025-09-26T18:06:31.847817] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:06:31.980611] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-26T18:06:32.108046] [DEBUG] [LOCAL ] COHR: Primary data saved (54144 records). [2025-09-26T18:06:32.108202] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-26T18:06:32.108319] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COHR took 31.8s. Estimated remaining: 4h 6m 17s. Rate: 7.6 symbols/min [2025-09-26T18:06:32.291668] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:32.331111] [DEBUG] [LOCAL ] CON: Loaded 39000 existing records from primary storage. [2025-09-26T18:06:32.331260] [INFO ] [MAIN ] CON: Loaded 39000 existing records. [2025-09-26T18:06:32.529414] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:32.529759] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-26T18:06:32.529818] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-26T18:06:32.530044] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-26T18:06:32.530104] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-26T18:06:32.764010] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-26T18:06:32.978125] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:33.015336] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T18:06:33.556744] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-26T18:06:33.714238] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:06:34.356707] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-26T18:06:34.534733] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T18:06:35.130714] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:06:35.156746] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-26T18:06:35.947159] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T18:06:35.958331] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-26T18:06:36.596947] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T18:06:36.756766] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-26T18:06:37.085331] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T18:06:37.556732] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-26T18:06:38.182789] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:06:38.356765] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-26T18:06:38.622086] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T18:06:39.156750] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-26T18:06:39.793742] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T18:06:39.956763] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-26T18:06:40.689970] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T18:06:40.756782] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-26T18:06:41.188743] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T18:06:41.556736] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-26T18:06:42.356750] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-26T18:06:42.591069] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T18:06:42.642896] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T18:06:43.156782] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-26T18:06:43.829336] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T18:06:43.956756] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-26T18:06:44.756752] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-26T18:06:45.279554] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:06:45.290437] [INFO ] [REMOTE ] COF: Full fetch complete (77401 records). [2025-09-26T18:06:45.290601] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-26T18:06:45.564439] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-26T18:06:45.705432] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-26T18:06:45.705626] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-26T18:06:45.706507] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-26T18:06:45.706560] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-26T18:06:45.708434] [DEBUG] [LOCAL ] COF: Trimmed 77401 records to 54389 (keeping 200 days of data) [2025-09-26T18:06:46.071393] [DEBUG] [LOCAL ] COF: Primary data saved (54389 records). [2025-09-26T18:06:46.071552] [INFO ] [MAIN ] COF: Full history saved. [2025-09-26T18:06:46.071676] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COF took 47.0s. Estimated remaining: 4h 6m 31s. Rate: 7.6 symbols/min [2025-09-26T18:06:46.290540] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-26T18:06:46.301593] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:46.304524] [INFO ] [REMOTE ] COLD: Full fetch complete (74186 records). [2025-09-26T18:06:46.304769] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-26T18:06:46.396013] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T18:06:46.447835] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-26T18:06:46.565253] [DEBUG] [LOCAL ] COOK: Loaded 24686 existing records from primary storage. [2025-09-26T18:06:46.620327] [INFO ] [MAIN ] COOK: Loaded 24686 existing records. [2025-09-26T18:06:46.992297] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:46.992089] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-26T18:06:46.992753] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-26T18:06:46.992844] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-26T18:06:46.992962] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-26T18:06:46.994217] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-26T18:06:46.994370] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-26T18:06:46.994720] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-26T18:06:46.994811] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-26T18:06:47.111185] [DEBUG] [LOCAL ] COLD: Trimmed 74186 records to 52785 (keeping 200 days of data) [2025-09-26T18:06:47.483336] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:47.486887] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-26T18:06:47.552929] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T18:06:47.574312] [INFO ] [REMOTE ] COMP: Full fetch complete (77095 records). [2025-09-26T18:06:47.579058] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-26T18:06:48.054300] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T18:06:48.112513] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-26T18:06:48.167491] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-26T18:06:48.167911] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-26T18:06:48.169787] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-26T18:06:48.170865] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-26T18:06:48.178938] [DEBUG] [LOCAL ] COMP: Trimmed 77095 records to 54166 (keeping 200 days of data) [2025-09-26T18:06:48.388152] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T18:06:48.494750] [DEBUG] [LOCAL ] COLD: Primary data saved (52785 records). [2025-09-26T18:06:48.495448] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-26T18:06:48.495904] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COLD took 34.8s. Estimated remaining: 4h 6m 3s. Rate: 7.6 symbols/min [2025-09-26T18:06:48.692994] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:48.762740] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-26T18:06:48.829001] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-09-26T18:06:48.830999] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-09-26T18:06:49.044092] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:49.045456] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-26T18:06:49.045954] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-26T18:06:49.047250] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-26T18:06:49.047695] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-26T18:06:49.085986] [DEBUG] [LOCAL ] COMP: Primary data saved (54166 records). [2025-09-26T18:06:49.133851] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-26T18:06:49.162180] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. COMP took 28.4s. Estimated remaining: 4h 5m 29s. Rate: 7.6 symbols/min [2025-09-26T18:06:49.588283] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:49.687788] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:49.688428] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-26T18:06:49.715192] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T18:06:49.757526] [DEBUG] [LOCAL ] COR: Loaded 47618 existing records from primary storage. [2025-09-26T18:06:49.757826] [INFO ] [MAIN ] COR: Loaded 47618 existing records. [2025-09-26T18:06:49.968497] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T18:06:49.980017] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:49.980305] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-26T18:06:49.980364] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-26T18:06:49.980581] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-26T18:06:49.980639] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-26T18:06:50.359353] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-26T18:06:50.359223] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:51.156728] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-26T18:06:51.856267] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T18:06:51.929968] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:06:51.956713] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-26T18:06:52.547804] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:06:52.756743] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-26T18:06:53.387693] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T18:06:53.396521] [INFO ] [REMOTE ] CON: Full fetch complete (56981 records). [2025-09-26T18:06:53.396672] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-26T18:06:53.568628] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-26T18:06:53.815980] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-26T18:06:53.816068] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-26T18:06:53.816988] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-26T18:06:53.817058] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-26T18:06:53.818849] [DEBUG] [LOCAL ] CON: Trimmed 56981 records to 39289 (keeping 200 days of data) [2025-09-26T18:06:54.089770] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T18:06:54.110119] [DEBUG] [LOCAL ] CON: Primary data saved (39289 records). [2025-09-26T18:06:54.110314] [INFO ] [MAIN ] CON: Full history saved. [2025-09-26T18:06:54.110430] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. CON took 22.0s. Estimated remaining: 4h 5m 10s. Rate: 7.6 symbols/min [2025-09-26T18:06:54.277176] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T18:06:54.303827] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:06:54.361702] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-26T18:06:54.364157] [DEBUG] [LOCAL ] COTY: Loaded 53636 existing records from primary storage. [2025-09-26T18:06:54.364414] [INFO ] [MAIN ] COTY: Loaded 53636 existing records. [2025-09-26T18:06:54.580086] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:06:54.580384] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-26T18:06:54.580434] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-26T18:06:54.581303] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-26T18:06:54.581392] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-26T18:06:54.986012] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:06:55.156724] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-26T18:06:55.726550] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T18:06:55.956759] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-26T18:06:56.714031] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T18:06:56.756683] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-26T18:06:57.547481] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T18:06:57.558464] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-26T18:06:57.978892] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:06:58.356728] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-26T18:06:59.082135] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T18:06:59.156760] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-26T18:06:59.858184] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T18:06:59.956719] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-26T18:07:00.756727] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-26T18:07:01.241270] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T18:07:01.556736] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-26T18:07:01.633977] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:07:02.356750] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-26T18:07:02.682557] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T18:07:03.061375] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:07:03.156725] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-26T18:07:03.649873] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T18:07:03.956751] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-26T18:07:04.756765] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-26T18:07:04.866543] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T18:07:05.060524] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T18:07:05.556724] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-26T18:07:06.125739] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T18:07:06.356738] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-26T18:07:07.156688] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-26T18:07:07.296870] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:07:07.329373] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:07:07.956731] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-26T18:07:08.756711] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-26T18:07:09.238094] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T18:07:09.556732] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-26T18:07:09.680714] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:07:10.356744] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-26T18:07:10.677833] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-26T18:07:10.829483] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:07:11.156748] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-26T18:07:11.662076] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T18:07:11.956747] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-26T18:07:12.050726] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:07:12.756734] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-26T18:07:13.556719] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-26T18:07:13.849167] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T18:07:14.356692] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-26T18:07:14.526574] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T18:07:15.156724] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-26T18:07:15.345695] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:07:15.956739] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-26T18:07:16.050234] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:07:16.059621] [INFO ] [REMOTE ] COR: Full fetch complete (68921 records). [2025-09-26T18:07:16.059830] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-26T18:07:16.482169] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-26T18:07:16.482362] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-26T18:07:16.483134] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-26T18:07:16.483212] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-26T18:07:16.484678] [DEBUG] [LOCAL ] COR: Trimmed 68921 records to 47937 (keeping 200 days of data) [2025-09-26T18:07:16.760154] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-26T18:07:16.783444] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T18:07:16.867912] [DEBUG] [LOCAL ] COR: Primary data saved (47937 records). [2025-09-26T18:07:16.868110] [INFO ] [MAIN ] COR: Full history saved. [2025-09-26T18:07:16.868229] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COR took 27.7s. Estimated remaining: 4h 5m 56s. Rate: 7.6 symbols/min [2025-09-26T18:07:17.051294] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:17.068054] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T18:07:17.116636] [DEBUG] [LOCAL ] COUR: Loaded 49322 existing records from primary storage. [2025-09-26T18:07:17.116818] [INFO ] [MAIN ] COUR: Loaded 49322 existing records. [2025-09-26T18:07:17.298169] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:17.298498] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-26T18:07:17.298560] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-26T18:07:17.298925] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-26T18:07:17.298984] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-26T18:07:17.562353] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-26T18:07:17.673695] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:18.356752] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-26T18:07:18.537620] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:07:18.904476] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:07:19.156762] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-26T18:07:19.956726] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-26T18:07:20.531814] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-26T18:07:20.756750] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-26T18:07:21.039273] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T18:07:21.049953] [INFO ] [REMOTE ] COP: Full fetch complete (77379 records). [2025-09-26T18:07:21.055444] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-26T18:07:21.066804] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:07:21.068672] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:07:21.068754] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:07:21.068459] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:07:21.068952] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-26T18:07:21.069061] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-09-26T18:07:21.074775] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-09-26T18:07:21.075570] [INFO ] [REMOTE ] COOK: Full fetch complete (32694 records). [2025-09-26T18:07:21.075744] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-26T18:07:21.075924] [DEBUG] [LOCAL ] COP: Deleted derivative data file. [2025-09-26T18:07:21.076134] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COP took 32.6s. Estimated remaining: 4h 5m 35s. Rate: 7.6 symbols/min [2025-09-26T18:07:21.442475] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:21.560567] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-26T18:07:21.713777] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-26T18:07:21.713911] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-26T18:07:21.714516] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-26T18:07:21.714621] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-26T18:07:21.715840] [DEBUG] [LOCAL ] COOK: Trimmed 32694 records to 24850 (keeping 200 days of data) [2025-09-26T18:07:21.796146] [DEBUG] [LOCAL ] CP: Loaded 53664 existing records from primary storage. [2025-09-26T18:07:21.825409] [INFO ] [MAIN ] CP: Loaded 53664 existing records. [2025-09-26T18:07:22.067616] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:22.074918] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-26T18:07:22.075779] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-26T18:07:22.076590] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-26T18:07:22.076952] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-26T18:07:22.237230] [DEBUG] [LOCAL ] COOK: Primary data saved (24850 records). [2025-09-26T18:07:22.303295] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-26T18:07:22.355716] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COOK took 36.3s. Estimated remaining: 4h 5m 3s. Rate: 7.6 symbols/min [2025-09-26T18:07:22.670223] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T18:07:22.655963] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:22.670825] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-26T18:07:22.756363] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:22.792996] [DEBUG] [LOCAL ] CPA: Loaded 29076 existing records from primary storage. [2025-09-26T18:07:22.793144] [INFO ] [MAIN ] CPA: Loaded 29076 existing records. [2025-09-26T18:07:22.980753] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:22.980997] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-26T18:07:22.981046] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-26T18:07:22.981310] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-26T18:07:22.981369] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-26T18:07:23.171798] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-26T18:07:23.381933] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:23.411137] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:07:23.422279] [INFO ] [REMOTE ] COTY: Full fetch complete (77085 records). [2025-09-26T18:07:23.422450] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-26T18:07:23.842927] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-26T18:07:23.843029] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-26T18:07:23.843923] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-26T18:07:23.844008] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-26T18:07:23.845844] [DEBUG] [LOCAL ] COTY: Trimmed 77085 records to 54014 (keeping 200 days of data) [2025-09-26T18:07:23.956834] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-26T18:07:24.159456] [DEBUG] [LOCAL ] COTY: Primary data saved (54014 records). [2025-09-26T18:07:24.159611] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-26T18:07:24.159734] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COTY took 30.0s. Estimated remaining: 4h 4m 33s. Rate: 7.6 symbols/min [2025-09-26T18:07:24.346582] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:24.346984] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-26T18:07:24.347063] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-26T18:07:24.347283] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-26T18:07:24.347339] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-26T18:07:24.347388] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-26T18:07:24.347423] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-26T18:07:24.748226] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:24.759408] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-26T18:07:24.807258] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-26T18:07:24.820454] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T18:07:25.168247] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:07:25.379301] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T18:07:25.556730] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-26T18:07:26.356752] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-26T18:07:27.156718] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-26T18:07:27.232594] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:07:27.789610] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T18:07:27.956748] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-26T18:07:28.151395] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T18:07:28.344441] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-26T18:07:28.756738] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-26T18:07:29.134759] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T18:07:29.556725] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-26T18:07:30.356764] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-26T18:07:30.717288] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T18:07:31.143568] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:07:31.156678] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-26T18:07:31.956772] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-26T18:07:32.756705] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-26T18:07:33.019758] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T18:07:33.085088] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:07:33.556729] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-26T18:07:34.156989] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:07:34.356806] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-26T18:07:34.444789] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T18:07:35.156776] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-26T18:07:35.764182] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T18:07:35.956778] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-26T18:07:36.156238] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T18:07:36.370242] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T18:07:36.756749] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-26T18:07:37.056490] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-26T18:07:37.556727] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-26T18:07:37.893930] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-26T18:07:38.356745] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-26T18:07:38.729159] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-26T18:07:39.156735] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-26T18:07:39.956775] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-26T18:07:40.419854] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-26T18:07:40.420899] [INFO ] [REMOTE ] CPAC: Full fetch complete (1887 records). [2025-09-26T18:07:40.420972] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-26T18:07:40.607578] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T18:07:40.607815] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:07:40.607888] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:07:40.607961] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-26T18:07:40.608032] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-26T18:07:40.608075] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-26T18:07:40.608122] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-26T18:07:40.608200] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. CPAC took 16.4s. Estimated remaining: 4h 4m 56s. Rate: 7.6 symbols/min [2025-09-26T18:07:40.764105] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-26T18:07:40.802213] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:40.834013] [DEBUG] [LOCAL ] CPAY: Loaded 31115 existing records from primary storage. [2025-09-26T18:07:40.834159] [INFO ] [MAIN ] CPAY: Loaded 31115 existing records. [2025-09-26T18:07:41.035109] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:41.035521] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-26T18:07:41.035676] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-26T18:07:41.036127] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-26T18:07:41.036219] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-26T18:07:41.155471] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-26T18:07:41.464952] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:41.556731] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-26T18:07:42.069111] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:07:42.356747] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-26T18:07:43.156754] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-26T18:07:43.671768] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T18:07:43.901795] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T18:07:43.956779] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-26T18:07:44.762702] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-26T18:07:44.777238] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T18:07:45.006983] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T18:07:45.556746] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-26T18:07:46.247966] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:07:46.356753] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-26T18:07:47.077704] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T18:07:47.156723] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-26T18:07:47.383065] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:07:47.956753] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-26T18:07:48.756751] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-26T18:07:49.003114] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:07:49.039178] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T18:07:49.049460] [INFO ] [REMOTE ] COUR: Full fetch complete (70910 records). [2025-09-26T18:07:49.049662] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-26T18:07:49.463426] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-26T18:07:49.463592] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-26T18:07:49.464413] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-26T18:07:49.464503] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-26T18:07:49.466128] [DEBUG] [LOCAL ] COUR: Trimmed 70910 records to 49636 (keeping 200 days of data) [2025-09-26T18:07:49.557008] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-26T18:07:49.769480] [DEBUG] [LOCAL ] COUR: Primary data saved (49636 records). [2025-09-26T18:07:49.769665] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-26T18:07:49.769781] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. COUR took 32.9s. Estimated remaining: 4h 4m 52s. Rate: 7.6 symbols/min [2025-09-26T18:07:50.015863] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:50.034682] [DEBUG] [LOCAL ] CPF: Loaded 15549 existing records from primary storage. [2025-09-26T18:07:50.034829] [INFO ] [MAIN ] CPF: Loaded 15549 existing records. [2025-09-26T18:07:50.222942] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:50.223211] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-26T18:07:50.223259] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-26T18:07:50.223530] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-26T18:07:50.223589] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-26T18:07:50.357863] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-26T18:07:50.563994] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T18:07:50.634801] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:50.929982] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:07:51.156730] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-26T18:07:51.956720] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-26T18:07:52.079527] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:07:52.126360] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T18:07:52.756776] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-26T18:07:52.835047] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T18:07:53.556738] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-26T18:07:54.229294] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T18:07:54.316357] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:07:54.356756] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-26T18:07:55.156693] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-26T18:07:55.372535] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T18:07:55.956724] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-26T18:07:56.484977] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:07:56.609996] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T18:07:56.756733] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-26T18:07:57.556723] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-26T18:07:58.349414] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:07:58.356688] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-26T18:07:58.732977] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T18:07:58.738391] [INFO ] [REMOTE ] CPA: Full fetch complete (41950 records). [2025-09-26T18:07:58.738494] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-26T18:07:58.739105] [FATAL] [VALIDATOR ] CPA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:07:58.739194] [FATAL] [MAIN ] CPA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:07:58.739238] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:07:58.739306] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-26T18:07:58.739372] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-09-26T18:07:58.739409] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-09-26T18:07:58.739989] [DEBUG] [LOCAL ] CPA: Deleted derivative data file. [2025-09-26T18:07:58.740093] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPA took 36.3s. Estimated remaining: 4h 4m 48s. Rate: 7.6 symbols/min [2025-09-26T18:07:58.916763] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:07:58.936475] [DEBUG] [LOCAL ] CPK: Loaded 13470 existing records from primary storage. [2025-09-26T18:07:58.936621] [INFO ] [MAIN ] CPK: Loaded 13470 existing records. [2025-09-26T18:07:59.125722] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:07:59.126039] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-26T18:07:59.126117] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-26T18:07:59.126428] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-26T18:07:59.126491] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-26T18:07:59.161791] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-26T18:07:59.505230] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:07:59.926676] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:07:59.956681] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-26T18:08:00.294965] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:08:00.756752] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-26T18:08:01.556719] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-26T18:08:01.707777] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T18:08:01.969554] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-26T18:08:01.980754] [INFO ] [REMOTE ] CP: Full fetch complete (77128 records). [2025-09-26T18:08:01.980946] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-26T18:08:02.370175] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-26T18:08:02.444558] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-26T18:08:02.444681] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-26T18:08:02.445586] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-26T18:08:02.445681] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-26T18:08:02.447756] [DEBUG] [LOCAL ] CP: Trimmed 77128 records to 54051 (keeping 200 days of data) [2025-09-26T18:08:02.650511] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T18:08:02.812043] [DEBUG] [LOCAL ] CP: Primary data saved (54051 records). [2025-09-26T18:08:02.812215] [INFO ] [MAIN ] CP: Full history saved. [2025-09-26T18:08:02.812310] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CP took 41.7s. Estimated remaining: 4h 4m 27s. Rate: 7.6 symbols/min [2025-09-26T18:08:02.994773] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:03.047678] [DEBUG] [LOCAL ] CPNG: Loaded 54060 existing records from primary storage. [2025-09-26T18:08:03.047844] [INFO ] [MAIN ] CPNG: Loaded 54060 existing records. [2025-09-26T18:08:03.161192] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-26T18:08:03.249261] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:03.249519] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-26T18:08:03.249569] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-26T18:08:03.249857] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-26T18:08:03.249919] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-26T18:08:03.634465] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:03.753494] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T18:08:03.768206] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T18:08:03.956735] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-26T18:08:04.756723] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-26T18:08:05.556703] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-26T18:08:05.686499] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T18:08:06.009623] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T18:08:06.356736] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-26T18:08:06.523100] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:08:07.023007] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T18:08:07.156737] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-26T18:08:07.956726] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-26T18:08:08.515348] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T18:08:08.756726] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-26T18:08:09.013534] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:08:09.556737] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-26T18:08:09.576972] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T18:08:10.356729] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-26T18:08:10.821212] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T18:08:10.950636] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T18:08:11.156729] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-26T18:08:11.956724] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-26T18:08:12.153484] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T18:08:12.756720] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-26T18:08:12.923203] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T18:08:12.927052] [INFO ] [REMOTE ] CPF: Full fetch complete (24192 records). [2025-09-26T18:08:12.927200] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-26T18:08:13.329994] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-26T18:08:13.330161] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-26T18:08:13.330777] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-26T18:08:13.330861] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-26T18:08:13.332010] [DEBUG] [LOCAL ] CPF: Trimmed 24192 records to 15618 (keeping 200 days of data) [2025-09-26T18:08:13.341329] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T18:08:13.446968] [DEBUG] [LOCAL ] CPF: Primary data saved (15618 records). [2025-09-26T18:08:13.447176] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-26T18:08:13.447401] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPF took 23.7s. Estimated remaining: 4h 4m 28s. Rate: 7.6 symbols/min [2025-09-26T18:08:13.556721] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-26T18:08:14.356830] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-26T18:08:15.156785] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-26T18:08:15.297968] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T18:08:15.674526] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T18:08:15.956740] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-26T18:08:16.117737] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T18:08:16.756813] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-26T18:08:17.433818] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:08:17.556749] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-26T18:08:17.760046] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T18:08:18.066396] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T18:08:18.356760] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-26T18:08:19.156795] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-26T18:08:19.365907] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T18:08:19.370253] [INFO ] [REMOTE ] CPK: Full fetch complete (17651 records). [2025-09-26T18:08:19.370344] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-26T18:08:19.370938] [FATAL] [VALIDATOR ] CPK: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:08:19.371043] [FATAL] [MAIN ] CPK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:08:19.371128] [WARN ] [MAIN ] CPK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:08:19.371192] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-26T18:08:19.371279] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-09-26T18:08:19.371343] [INFO ] [LOCAL ] CPK: Starting deletion of derivative data. [2025-09-26T18:08:19.371983] [DEBUG] [LOCAL ] CPK: Deleted derivative data file. [2025-09-26T18:08:19.372105] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPK took 20.6s. Estimated remaining: 4h 4m 13s. Rate: 7.6 symbols/min [2025-09-26T18:08:19.956831] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-26T18:08:21.192227] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T18:08:21.205695] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-26T18:08:21.242338] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:08:21.248594] [INFO ] [REMOTE ] CPAY: Full fetch complete (45096 records). [2025-09-26T18:08:21.248760] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-26T18:08:21.640813] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-26T18:08:21.640909] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-26T18:08:21.641555] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-26T18:08:21.641603] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-26T18:08:21.642973] [DEBUG] [LOCAL ] CPAY: Trimmed 45096 records to 31286 (keeping 200 days of data) [2025-09-26T18:08:21.842585] [DEBUG] [LOCAL ] CPAY: Primary data saved (31286 records). [2025-09-26T18:08:21.842776] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-26T18:08:21.842878] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPAY took 41.2s. Estimated remaining: 4h 3m 46s. Rate: 7.6 symbols/min [2025-09-26T18:08:23.465493] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-26T18:08:23.477994] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-26T18:08:27.265166] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (3.79 seconds). [2025-09-26T18:08:27.281374] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-26T18:08:29.468009] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-26T18:08:29.480016] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-26T18:08:31.505704] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-26T18:08:31.518391] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-26T18:08:34.019271] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-26T18:08:34.031912] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-26T18:08:36.481388] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-26T18:08:36.492053] [INFO ] [REMOTE ] CPNG: Full fetch complete (77669 records). [2025-09-26T18:08:36.492220] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-26T18:08:36.935980] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-26T18:08:36.936104] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-26T18:08:36.938471] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-26T18:08:36.938576] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-26T18:08:36.950479] [DEBUG] [LOCAL ] CPNG: Trimmed 77669 records to 54450 (keeping 200 days of data) [2025-09-26T18:08:37.308438] [DEBUG] [LOCAL ] CPNG: Primary data saved (54450 records). [2025-09-26T18:08:37.308612] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-26T18:08:37.308871] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 34.5s. Estimated remaining: 4h 4m 5s. Rate: 7.6 symbols/min [2025-09-26T18:08:37.933623] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:38.061171] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:38.098703] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:38.102235] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:38.129374] [DEBUG] [LOCAL ] CQP: Loaded 19937 existing records from primary storage. [2025-09-26T18:08:38.129588] [INFO ] [MAIN ] CQP: Loaded 19937 existing records. [2025-09-26T18:08:38.306864] [DEBUG] [LOCAL ] CPS: Loaded 26362 existing records from primary storage. [2025-09-26T18:08:38.348408] [INFO ] [MAIN ] CPS: Loaded 26362 existing records. [2025-09-26T18:08:38.517839] [DEBUG] [LOCAL ] CPT: Loaded 44711 existing records from primary storage. [2025-09-26T18:08:38.506156] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:38.530231] [DEBUG] [LOCAL ] CPRI: Loaded 52950 existing records from primary storage. [2025-09-26T18:08:38.565484] [INFO ] [MAIN ] CPRI: Loaded 52950 existing records. [2025-09-26T18:08:38.565959] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-26T18:08:38.565817] [INFO ] [MAIN ] CPT: Loaded 44711 existing records. [2025-09-26T18:08:38.566146] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-26T18:08:38.589381] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-26T18:08:38.681909] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-26T18:08:38.900865] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:39.053853] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-26T18:08:39.138167] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-26T18:08:39.132903] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:39.169534] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-26T18:08:39.174754] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-26T18:08:39.197240] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-26T18:08:39.233422] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-26T18:08:39.250491] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:39.254052] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-26T18:08:39.332266] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-26T18:08:39.295024] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-26T18:08:39.347488] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-26T18:08:39.401152] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-26T18:08:39.491347] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-26T18:08:39.927320] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:40.089003] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-26T18:08:40.427540] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:40.464620] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-26T18:08:40.683071] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:40.696600] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-26T18:08:40.696343] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:40.697781] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-26T18:08:41.795970] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T18:08:41.801187] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-26T18:08:41.868144] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:08:41.872864] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-26T18:08:42.106514] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:08:42.115038] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-26T18:08:42.322888] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-26T18:08:42.334323] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-26T18:08:42.559128] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T18:08:42.564326] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-26T18:08:42.694582] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T18:08:42.701870] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-26T18:08:43.299626] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T18:08:43.309763] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-26T18:08:43.361793] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T18:08:43.367803] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-26T18:08:43.671579] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T18:08:43.682467] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-26T18:08:43.843752] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:08:43.849627] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-26T18:08:44.356177] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T18:08:44.362627] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-26T18:08:44.989512] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T18:08:44.994847] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-26T18:08:45.060634] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T18:08:45.070342] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-26T18:08:45.149833] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:08:45.160905] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-26T18:08:45.329633] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T18:08:45.337198] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-26T18:08:45.668437] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T18:08:45.673193] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-26T18:08:46.458909] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T18:08:46.464791] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-26T18:08:46.541483] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T18:08:46.551371] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-26T18:08:46.823249] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:08:46.830503] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-26T18:08:47.075036] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T18:08:47.086749] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-26T18:08:47.750904] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T18:08:47.757382] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-26T18:08:48.044919] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T18:08:48.050745] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-26T18:08:48.225836] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T18:08:48.240567] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-26T18:08:48.454220] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:08:48.465885] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-26T18:08:48.595777] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T18:08:48.601589] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-26T18:08:48.824423] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T18:08:48.830035] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-26T18:08:49.525028] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T18:08:49.556699] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-26T18:08:49.726578] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:08:49.751448] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T18:08:49.847670] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:08:50.356740] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-26T18:08:50.737062] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T18:08:50.740313] [INFO ] [REMOTE ] CQP: Full fetch complete (30807 records). [2025-09-26T18:08:50.740459] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-26T18:08:51.133332] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-26T18:08:51.133440] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-26T18:08:51.133969] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-26T18:08:51.134036] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-26T18:08:51.135037] [DEBUG] [LOCAL ] CQP: Trimmed 30807 records to 20033 (keeping 200 days of data) [2025-09-26T18:08:51.194236] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-26T18:08:51.278178] [DEBUG] [LOCAL ] CQP: Primary data saved (20033 records). [2025-09-26T18:08:51.278398] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-26T18:08:51.278566] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 14.0s. Estimated remaining: 4h 4m 19s. Rate: 7.6 symbols/min [2025-09-26T18:08:51.471720] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:51.490211] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T18:08:51.496376] [INFO ] [REMOTE ] CPS: Full fetch complete (36292 records). [2025-09-26T18:08:51.496597] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-26T18:08:51.637262] [DEBUG] [LOCAL ] CR: Loaded 24857 existing records from primary storage. [2025-09-26T18:08:51.648072] [INFO ] [MAIN ] CR: Loaded 24857 existing records. [2025-09-26T18:08:51.976058] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-26T18:08:52.068709] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:52.084694] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-26T18:08:52.084858] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-26T18:08:52.110631] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-26T18:08:52.132188] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-26T18:08:52.212351] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-26T18:08:52.250216] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-26T18:08:52.264361] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-26T18:08:52.282634] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-26T18:08:52.335773] [DEBUG] [LOCAL ] CPS: Trimmed 36292 records to 26476 (keeping 200 days of data) [2025-09-26T18:08:52.656710] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:52.729192] [DEBUG] [LOCAL ] CPS: Primary data saved (26476 records). [2025-09-26T18:08:52.729339] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-26T18:08:52.729481] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPS took 15.4s. Estimated remaining: 4h 3m 48s. Rate: 7.6 symbols/min [2025-09-26T18:08:52.761983] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-26T18:08:52.915349] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:08:52.944472] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:08:52.957276] [DEBUG] [LOCAL ] CRBD: Loaded 9077 existing records from primary storage. [2025-09-26T18:08:52.957741] [INFO ] [MAIN ] CRBD: Loaded 9077 existing records. [2025-09-26T18:08:53.145040] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:08:53.145291] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-26T18:08:53.145340] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-26T18:08:53.145761] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-26T18:08:53.145821] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-26T18:08:53.523756] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:08:53.556728] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-26T18:08:54.066006] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-26T18:08:54.135523] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T18:08:54.356691] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-26T18:08:54.383477] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T18:08:55.156746] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-26T18:08:55.672200] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:08:55.956740] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-26T18:08:56.509524] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T18:08:56.756738] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-26T18:08:57.098229] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:08:57.556745] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-26T18:08:58.356705] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-26T18:08:58.415853] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T18:08:58.759361] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T18:08:58.835564] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T18:08:59.156796] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-26T18:08:59.895391] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T18:08:59.956737] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-26T18:09:00.566325] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T18:09:00.756748] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-26T18:09:01.558085] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-26T18:09:01.560945] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:09:02.356742] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-26T18:09:03.150450] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T18:09:03.156668] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-26T18:09:03.426146] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T18:09:03.707550] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T18:09:03.956743] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-26T18:09:04.756732] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-26T18:09:05.556730] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-26T18:09:05.972537] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T18:09:05.982194] [INFO ] [REMOTE ] CPT: Full fetch complete (63718 records). [2025-09-26T18:09:05.982364] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-26T18:09:06.211785] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:09:06.361835] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-26T18:09:06.436558] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-26T18:09:06.436679] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-26T18:09:06.437538] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-26T18:09:06.437605] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-26T18:09:06.439238] [DEBUG] [LOCAL ] CPT: Trimmed 63718 records to 45034 (keeping 200 days of data) [2025-09-26T18:09:06.738081] [DEBUG] [LOCAL ] CPT: Primary data saved (45034 records). [2025-09-26T18:09:06.738232] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-26T18:09:06.738346] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPT took 29.4s. Estimated remaining: 4h 4m 1s. Rate: 7.6 symbols/min [2025-09-26T18:09:06.927970] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:06.987028] [DEBUG] [LOCAL ] CRBG: Loaded 52728 existing records from primary storage. [2025-09-26T18:09:06.987245] [INFO ] [MAIN ] CRBG: Loaded 52728 existing records. [2025-09-26T18:09:07.105458] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T18:09:07.163288] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-26T18:09:07.257679] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:07.258039] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-26T18:09:07.258301] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-26T18:09:07.269876] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-26T18:09:07.275676] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-26T18:09:07.363449] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T18:09:07.426612] [INFO ] [REMOTE ] CPRI: Full fetch complete (76150 records). [2025-09-26T18:09:07.437094] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-26T18:09:07.964674] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-26T18:09:07.952822] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:08.132905] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-26T18:09:08.133094] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-26T18:09:08.133901] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-26T18:09:08.133967] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-26T18:09:08.135542] [DEBUG] [LOCAL ] CPRI: Trimmed 76150 records to 53326 (keeping 200 days of data) [2025-09-26T18:09:08.238362] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:09:08.476133] [DEBUG] [LOCAL ] CPRI: Primary data saved (53326 records). [2025-09-26T18:09:08.476420] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-26T18:09:08.476636] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CPRI took 31.2s. Estimated remaining: 4h 3m 32s. Rate: 7.6 symbols/min [2025-09-26T18:09:08.658191] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:08.700556] [DEBUG] [LOCAL ] CRC: Loaded 44654 existing records from primary storage. [2025-09-26T18:09:08.700749] [INFO ] [MAIN ] CRC: Loaded 44654 existing records. [2025-09-26T18:09:08.767616] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-26T18:09:08.923734] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:08.924028] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-26T18:09:08.924081] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-26T18:09:08.925368] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-26T18:09:08.925435] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-26T18:09:09.305865] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:09.356126] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:09:09.372152] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T18:09:09.374920] [INFO ] [REMOTE ] CRBD: Full fetch complete (15378 records). [2025-09-26T18:09:09.375002] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-26T18:09:09.561858] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-26T18:09:09.801975] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-26T18:09:09.802104] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-26T18:09:09.802894] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-26T18:09:09.802963] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-26T18:09:09.803835] [DEBUG] [LOCAL ] CRBD: Trimmed 15378 records to 9131 (keeping 200 days of data) [2025-09-26T18:09:09.872964] [DEBUG] [LOCAL ] CRBD: Primary data saved (9131 records). [2025-09-26T18:09:09.873256] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-26T18:09:09.873445] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CRBD took 17.1s. Estimated remaining: 4h 3m 1s. Rate: 7.6 symbols/min [2025-09-26T18:09:10.067464] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:10.067716] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-26T18:09:10.067768] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-26T18:09:10.067994] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-26T18:09:10.068046] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-26T18:09:10.068090] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-26T18:09:10.068122] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-26T18:09:10.356814] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-26T18:09:10.449915] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:10.583410] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T18:09:11.156724] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-26T18:09:11.847311] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:09:11.956705] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-26T18:09:12.381020] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:09:12.756721] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-26T18:09:13.259870] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T18:09:13.556721] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-26T18:09:14.356719] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-26T18:09:14.411697] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T18:09:14.689092] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:14.689433] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-26T18:09:14.724202] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T18:09:15.156736] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-26T18:09:15.956728] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-26T18:09:16.661666] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:09:16.756765] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-26T18:09:17.527717] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:09:17.556672] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-26T18:09:17.948517] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T18:09:18.356742] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-26T18:09:19.106606] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:09:19.156683] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-26T18:09:19.921931] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:09:19.956701] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-26T18:09:20.155274] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:20.155830] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-26T18:09:20.756743] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-26T18:09:20.930867] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T18:09:20.985939] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:20.986309] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-26T18:09:21.556768] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-26T18:09:22.356780] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-26T18:09:23.156726] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-26T18:09:23.375278] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:23.375825] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-26T18:09:23.456573] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T18:09:23.703247] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:09:23.956746] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-26T18:09:24.756774] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-26T18:09:25.556752] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-26T18:09:25.599040] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T18:09:26.356780] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-26T18:09:26.412708] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T18:09:26.565368] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:26.565832] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-26T18:09:26.587985] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T18:09:26.593904] [INFO ] [REMOTE ] CR: Full fetch complete (35029 records). [2025-09-26T18:09:26.594019] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-26T18:09:27.001198] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-26T18:09:27.001282] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-26T18:09:27.001784] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-26T18:09:27.001849] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-26T18:09:27.002768] [DEBUG] [LOCAL ] CR: Trimmed 35029 records to 25019 (keeping 200 days of data) [2025-09-26T18:09:27.156791] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-26T18:09:27.162683] [DEBUG] [LOCAL ] CR: Primary data saved (25019 records). [2025-09-26T18:09:27.163804] [INFO ] [MAIN ] CR: Full history saved. [2025-09-26T18:09:27.163921] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CR took 35.9s. Estimated remaining: 4h 3m 26s. Rate: 7.6 symbols/min [2025-09-26T18:09:27.346616] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:27.400183] [DEBUG] [LOCAL ] CRGY: Loaded 52903 existing records from primary storage. [2025-09-26T18:09:27.400343] [INFO ] [MAIN ] CRGY: Loaded 52903 existing records. [2025-09-26T18:09:27.588408] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:27.588741] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-26T18:09:27.588800] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-26T18:09:27.590223] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-26T18:09:27.590288] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-26T18:09:27.963843] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-26T18:09:27.980422] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:28.756832] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-26T18:09:28.996565] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T18:09:29.131727] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T18:09:29.556833] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-26T18:09:30.356788] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-26T18:09:30.563687] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:09:30.564400] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-26T18:09:30.618582] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T18:09:31.107312] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T18:09:31.156734] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-26T18:09:31.956747] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-26T18:09:32.756702] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-26T18:09:32.863638] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T18:09:33.556723] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-26T18:09:33.699154] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:09:34.302781] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T18:09:34.356706] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-26T18:09:34.955630] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T18:09:35.156782] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-26T18:09:35.911106] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:09:35.920923] [INFO ] [REMOTE ] CRBG: Full fetch complete (75313 records). [2025-09-26T18:09:35.921067] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-26T18:09:35.921864] [FATAL] [VALIDATOR ] CRBG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:09:35.921957] [FATAL] [MAIN ] CRBG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:09:35.922001] [WARN ] [MAIN ] CRBG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:09:35.922064] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-26T18:09:35.922155] [DEBUG] [LOCAL ] CRBG: No primary data file found to delete. [2025-09-26T18:09:35.922211] [INFO ] [LOCAL ] CRBG: Starting deletion of derivative data. [2025-09-26T18:09:35.922723] [DEBUG] [LOCAL ] CRBG: Deleted derivative data file. [2025-09-26T18:09:35.922853] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRBG took 29.2s. Estimated remaining: 4h 3m 21s. Rate: 7.6 symbols/min [2025-09-26T18:09:35.961951] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-26T18:09:36.101908] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:36.154738] [DEBUG] [LOCAL ] CRH: Loaded 53856 existing records from primary storage. [2025-09-26T18:09:36.154918] [INFO ] [MAIN ] CRH: Loaded 53856 existing records. [2025-09-26T18:09:36.354295] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:36.354631] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-26T18:09:36.354728] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-26T18:09:36.356263] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-26T18:09:36.356326] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-26T18:09:36.736849] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:36.756702] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-26T18:09:37.245200] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:09:37.410286] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-26T18:09:37.556716] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-26T18:09:38.341069] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:09:38.356872] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-26T18:09:38.965786] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T18:09:38.975944] [INFO ] [REMOTE ] CRC: Full fetch complete (62288 records). [2025-09-26T18:09:38.976137] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-26T18:09:39.159993] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-26T18:09:39.510627] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-26T18:09:39.510840] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-26T18:09:39.512316] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-26T18:09:39.512506] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-26T18:09:39.514537] [DEBUG] [LOCAL ] CRC: Trimmed 62288 records to 44946 (keeping 200 days of data) [2025-09-26T18:09:39.927487] [DEBUG] [LOCAL ] CRC: Primary data saved (44946 records). [2025-09-26T18:09:39.927719] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-26T18:09:39.927866] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRC took 31.5s. Estimated remaining: 4h 2m 59s. Rate: 7.6 symbols/min [2025-09-26T18:09:39.967774] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-26T18:09:40.158527] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:40.244630] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T18:09:40.260071] [DEBUG] [LOCAL ] CRI: Loaded 50361 existing records from primary storage. [2025-09-26T18:09:40.260244] [INFO ] [MAIN ] CRI: Loaded 50361 existing records. [2025-09-26T18:09:40.485966] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:40.486248] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-26T18:09:40.486304] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-26T18:09:40.487739] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-26T18:09:40.487802] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-26T18:09:40.761885] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-26T18:09:40.873251] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:41.556759] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-26T18:09:41.931423] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T18:09:42.043258] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-26T18:09:42.319026] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T18:09:42.356728] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-26T18:09:43.156756] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-26T18:09:43.325623] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:09:43.956759] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-26T18:09:44.367994] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T18:09:44.756739] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-26T18:09:44.876547] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:09:45.173848] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:09:45.556741] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-26T18:09:46.281688] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:09:46.356728] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-26T18:09:46.990428] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T18:09:47.156739] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-26T18:09:47.956752] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-26T18:09:48.019681] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T18:09:48.756740] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-26T18:09:48.888700] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T18:09:49.219076] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T18:09:49.556726] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-26T18:09:50.356760] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-26T18:09:50.872375] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T18:09:51.156742] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-26T18:09:51.359549] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-26T18:09:51.956734] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-26T18:09:52.269173] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T18:09:52.756747] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-26T18:09:52.878102] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T18:09:53.556733] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-26T18:09:53.660844] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T18:09:54.356713] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-26T18:09:54.735915] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T18:09:55.052695] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:09:55.156775] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-26T18:09:55.775476] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T18:09:55.956724] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-26T18:09:56.756688] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-26T18:09:56.802988] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T18:09:56.814048] [INFO ] [REMOTE ] CRGY: Full fetch complete (75952 records). [2025-09-26T18:09:56.814220] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-26T18:09:57.225792] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-26T18:09:57.225923] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-26T18:09:57.226813] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-26T18:09:57.226897] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-26T18:09:57.229034] [DEBUG] [LOCAL ] CRGY: Trimmed 75952 records to 53290 (keeping 200 days of data) [2025-09-26T18:09:57.348904] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T18:09:57.569493] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-26T18:09:57.597176] [DEBUG] [LOCAL ] CRGY: Primary data saved (53290 records). [2025-09-26T18:09:57.597317] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-26T18:09:57.597421] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRGY took 30.4s. Estimated remaining: 4h 3m 26s. Rate: 7.6 symbols/min [2025-09-26T18:09:57.779492] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:57.831827] [DEBUG] [LOCAL ] CRK: Loaded 52506 existing records from primary storage. [2025-09-26T18:09:57.831986] [INFO ] [MAIN ] CRK: Loaded 52506 existing records. [2025-09-26T18:09:58.016965] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:09:58.017268] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-26T18:09:58.017322] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-26T18:09:58.018708] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-26T18:09:58.018810] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-26T18:09:58.361832] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-26T18:09:58.404394] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:09:59.156733] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-26T18:09:59.331092] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-26T18:09:59.342182] [INFO ] [REMOTE ] CRCL: Full fetch complete (30609 records). [2025-09-26T18:09:59.342316] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-26T18:09:59.543404] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 79 unique days, need 200 days [2025-09-26T18:09:59.543925] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:09:59.544057] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:09:59.544136] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-26T18:09:59.544376] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-26T18:09:59.544478] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-26T18:09:59.544605] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-26T18:09:59.544823] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRCL took 49.7s. Estimated remaining: 4h 2m 57s. Rate: 7.6 symbols/min [2025-09-26T18:09:59.764065] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:09:59.769924] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T18:09:59.847121] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:09:59.879265] [DEBUG] [LOCAL ] CRL: Loaded 43547 existing records from primary storage. [2025-09-26T18:09:59.879424] [INFO ] [MAIN ] CRL: Loaded 43547 existing records. [2025-09-26T18:09:59.961828] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-26T18:10:00.117183] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:00.117480] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-26T18:10:00.117535] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-26T18:10:00.118813] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-26T18:10:00.118876] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-26T18:10:00.492761] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:00.762117] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-26T18:10:00.778575] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T18:10:01.556760] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-26T18:10:02.083784] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:10:02.093985] [INFO ] [REMOTE ] CRH: Full fetch complete (76907 records). [2025-09-26T18:10:02.094709] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-26T18:10:02.095553] [FATAL] [VALIDATOR ] CRH: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:10:02.095669] [FATAL] [MAIN ] CRH: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:10:02.095731] [WARN ] [MAIN ] CRH: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:10:02.095802] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-26T18:10:02.095874] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-09-26T18:10:02.095913] [INFO ] [LOCAL ] CRH: Starting deletion of derivative data. [2025-09-26T18:10:02.096342] [DEBUG] [LOCAL ] CRH: Deleted derivative data file. [2025-09-26T18:10:02.096457] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRH took 26.2s. Estimated remaining: 4h 2m 30s. Rate: 7.6 symbols/min [2025-09-26T18:10:02.285551] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:02.310992] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T18:10:02.356726] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-26T18:10:02.378814] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-09-26T18:10:02.379029] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-09-26T18:10:02.612554] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:02.612875] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-26T18:10:02.612942] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-26T18:10:02.614779] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-26T18:10:02.614861] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-26T18:10:03.003020] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:03.156731] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-26T18:10:03.300950] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T18:10:03.956741] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-26T18:10:04.080766] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T18:10:04.756736] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-26T18:10:05.378933] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-26T18:10:05.556741] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-26T18:10:06.102309] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T18:10:06.112261] [INFO ] [REMOTE ] CRI: Full fetch complete (70635 records). [2025-09-26T18:10:06.112446] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-26T18:10:06.113730] [FATAL] [VALIDATOR ] CRI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:10:06.113856] [FATAL] [MAIN ] CRI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:10:06.114015] [WARN ] [MAIN ] CRI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:10:06.114328] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-26T18:10:06.114473] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-09-26T18:10:06.114544] [INFO ] [LOCAL ] CRI: Starting deletion of derivative data. [2025-09-26T18:10:06.115128] [DEBUG] [LOCAL ] CRI: Deleted derivative data file. [2025-09-26T18:10:06.115402] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRI took 26.2s. Estimated remaining: 4h 2m 9s. Rate: 7.6 symbols/min [2025-09-26T18:10:06.313174] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:06.313553] [DEBUG] [LOCAL ] CRS: No existing data file found in primary storage. [2025-09-26T18:10:06.313738] [WARN ] [MAIN ] CRS: No existing data found, performing full refresh instead. [2025-09-26T18:10:06.314146] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-26T18:10:06.314206] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-26T18:10:06.323424] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-09-26T18:10:06.338951] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-26T18:10:06.364093] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T18:10:06.361813] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-26T18:10:06.736334] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:07.156700] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-26T18:10:07.234461] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T18:10:07.956731] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-26T18:10:08.610510] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T18:10:08.723385] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-26T18:10:08.756709] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-26T18:10:09.414494] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:10:09.556726] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-26T18:10:10.356755] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-26T18:10:10.773111] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-26T18:10:10.888530] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T18:10:11.156743] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-26T18:10:11.922897] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T18:10:11.956695] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-26T18:10:12.756704] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-26T18:10:13.052957] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T18:10:13.556695] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-26T18:10:13.797583] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T18:10:14.356776] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-26T18:10:14.744758] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T18:10:15.021023] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:10:15.156728] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-26T18:10:15.866192] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T18:10:15.956766] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-26T18:10:16.631968] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T18:10:16.756807] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-26T18:10:17.065992] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:10:17.556770] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-26T18:10:18.198768] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:10:18.356764] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-26T18:10:19.156738] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-26T18:10:19.956758] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-26T18:10:20.055716] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-26T18:10:20.484379] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T18:10:20.756771] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-26T18:10:20.899416] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T18:10:21.425961] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T18:10:21.556743] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-26T18:10:22.237571] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:10:22.356761] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-26T18:10:23.156743] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-26T18:10:23.902087] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-26T18:10:23.956744] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-26T18:10:24.025216] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T18:10:24.580312] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:10:24.756773] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-26T18:10:25.556731] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-26T18:10:26.356765] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-26T18:10:26.561552] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-26T18:10:26.601868] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T18:10:27.140947] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T18:10:27.151428] [INFO ] [REMOTE ] CRK: Full fetch complete (75555 records). [2025-09-26T18:10:27.151631] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-26T18:10:27.164527] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-26T18:10:27.601380] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-26T18:10:27.601551] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-26T18:10:27.602468] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-26T18:10:27.602573] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-26T18:10:27.604509] [DEBUG] [LOCAL ] CRK: Trimmed 75555 records to 52891 (keeping 200 days of data) [2025-09-26T18:10:27.724449] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T18:10:27.741965] [INFO ] [REMOTE ] CRL: Full fetch complete (62762 records). [2025-09-26T18:10:27.744553] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-26T18:10:27.962791] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-26T18:10:28.300244] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-26T18:10:28.300713] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-26T18:10:28.302733] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-26T18:10:28.303161] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-26T18:10:28.308066] [DEBUG] [LOCAL ] CRL: Trimmed 62762 records to 43853 (keeping 200 days of data) [2025-09-26T18:10:28.669692] [DEBUG] [LOCAL ] CRL: Primary data saved (43853 records). [2025-09-26T18:10:28.670528] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-26T18:10:28.671009] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRL took 29.1s. Estimated remaining: 4h 2m 52s. Rate: 7.6 symbols/min [2025-09-26T18:10:28.882107] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:28.887440] [DEBUG] [LOCAL ] CRK: Primary data saved (52891 records). [2025-09-26T18:10:28.889554] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-26T18:10:28.889727] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRK took 31.3s. Estimated remaining: 4h 2m 17s. Rate: 7.6 symbols/min [2025-09-26T18:10:28.961281] [DEBUG] [LOCAL ] CRT: Loaded 4974 existing records from primary storage. [2025-09-26T18:10:28.974089] [INFO ] [MAIN ] CRT: Loaded 4974 existing records. [2025-09-26T18:10:29.221844] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:29.317637] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:29.318517] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-26T18:10:29.318592] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-26T18:10:29.319265] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-26T18:10:29.320158] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-26T18:10:29.506632] [DEBUG] [LOCAL ] CSAN: Loaded 42640 existing records from primary storage. [2025-09-26T18:10:29.527867] [INFO ] [MAIN ] CSAN: Loaded 42640 existing records. [2025-09-26T18:10:30.051153] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:30.037076] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:30.051787] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-26T18:10:30.053101] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-26T18:10:30.053231] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-26T18:10:30.054823] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-26T18:10:30.055149] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-26T18:10:30.350727] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-26T18:10:30.455771] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-26T18:10:30.483032] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-09-26T18:10:30.571047] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:30.572049] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-26T18:10:30.737221] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T18:10:31.156744] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-26T18:10:31.897680] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:10:31.956749] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-26T18:10:32.021214] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T18:10:32.756782] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-26T18:10:32.978369] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T18:10:33.307948] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T18:10:33.556730] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-26T18:10:34.079593] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T18:10:34.356777] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-26T18:10:35.156821] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-26T18:10:35.798628] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T18:10:35.891550] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-26T18:10:35.903029] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-26T18:10:35.903195] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-26T18:10:35.963514] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-26T18:10:36.330890] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-26T18:10:36.331138] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-26T18:10:36.332101] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-26T18:10:36.332232] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-26T18:10:36.334240] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54550 (keeping 200 days of data) [2025-09-26T18:10:36.360016] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-26T18:10:36.744553] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-09-26T18:10:36.744919] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-26T18:10:36.745375] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRM took 34.6s. Estimated remaining: 4h 2m 9s. Rate: 7.6 symbols/min [2025-09-26T18:10:36.761889] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-26T18:10:36.948789] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:36.949011] [DEBUG] [LOCAL ] CSL: No existing data file found in primary storage. [2025-09-26T18:10:36.949062] [WARN ] [MAIN ] CSL: No existing data found, performing full refresh instead. [2025-09-26T18:10:36.949205] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-26T18:10:36.949250] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-26T18:10:36.949291] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-09-26T18:10:36.949335] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-26T18:10:37.365505] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:37.396195] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T18:10:37.409797] [INFO ] [REMOTE ] CRS: Full fetch complete (62648 records). [2025-09-26T18:10:37.410021] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-26T18:10:37.561807] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-26T18:10:37.815546] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-26T18:10:37.815629] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-26T18:10:37.816365] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-26T18:10:37.816416] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-26T18:10:37.817755] [DEBUG] [LOCAL ] CRS: Trimmed 62648 records to 43928 (keeping 200 days of data) [2025-09-26T18:10:38.105123] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T18:10:38.177445] [DEBUG] [LOCAL ] CRS: Primary data saved (43928 records). [2025-09-26T18:10:38.177608] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-26T18:10:38.177804] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRS took 32.1s. Estimated remaining: 4h 1m 39s. Rate: 7.6 symbols/min [2025-09-26T18:10:38.325083] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:10:38.361193] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-26T18:10:38.382103] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:38.400864] [DEBUG] [LOCAL ] CSR: Loaded 12686 existing records from primary storage. [2025-09-26T18:10:38.400992] [INFO ] [MAIN ] CSR: Loaded 12686 existing records. [2025-09-26T18:10:38.594115] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:38.595697] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-26T18:10:38.595789] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-26T18:10:38.597000] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-26T18:10:38.597068] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-26T18:10:38.976004] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:39.156734] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-26T18:10:39.922005] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T18:10:39.956764] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-26T18:10:40.450386] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T18:10:40.745497] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T18:10:40.756684] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-26T18:10:41.446594] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T18:10:41.556722] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-26T18:10:42.356789] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-26T18:10:42.965702] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T18:10:42.973338] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:10:43.156747] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-26T18:10:43.956732] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-26T18:10:44.682555] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T18:10:44.711107] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T18:10:44.756765] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-26T18:10:45.556734] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-26T18:10:46.184536] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:10:46.356747] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-26T18:10:46.616520] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T18:10:47.156787] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-26T18:10:47.799762] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T18:10:47.956714] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-26T18:10:48.042250] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T18:10:48.482991] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T18:10:48.756731] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-26T18:10:49.412689] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T18:10:49.556733] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-26T18:10:50.356757] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-26T18:10:51.089333] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:10:51.156725] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-26T18:10:51.871574] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T18:10:51.956735] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-26T18:10:52.080952] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T18:10:52.581528] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:10:52.756727] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-26T18:10:53.497271] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T18:10:53.556744] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-26T18:10:54.356755] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-26T18:10:55.013524] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:10:55.039678] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:10:55.156762] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-26T18:10:55.956729] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-26T18:10:56.756744] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-26T18:10:57.050025] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T18:10:57.062128] [INFO ] [REMOTE ] CSAN: Full fetch complete (60844 records). [2025-09-26T18:10:57.062298] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-26T18:10:57.356249] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T18:10:57.447182] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T18:10:57.481465] [INFO ] [REMOTE ] CRT: Full fetch complete (7632 records). [2025-09-26T18:10:57.494748] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-26T18:10:57.580726] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-26T18:10:57.561772] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-26T18:10:57.603876] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-26T18:10:57.619970] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-26T18:10:57.620086] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-26T18:10:57.673705] [DEBUG] [LOCAL ] CSAN: Trimmed 60844 records to 42951 (keeping 200 days of data) [2025-09-26T18:10:58.069885] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-26T18:10:58.072025] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-26T18:10:58.072299] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-26T18:10:58.072402] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-26T18:10:58.082221] [DEBUG] [LOCAL ] CRT: Trimmed 7632 records to 5018 (keeping 200 days of data) [2025-09-26T18:10:58.203993] [DEBUG] [LOCAL ] CRT: Primary data saved (5018 records). [2025-09-26T18:10:58.211712] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-26T18:10:58.218027] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CRT took 29.5s. Estimated remaining: 4h 2m 12s. Rate: 7.6 symbols/min [2025-09-26T18:10:58.359042] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-26T18:10:58.417818] [DEBUG] [LOCAL ] CSAN: Primary data saved (42951 records). [2025-09-26T18:10:58.446495] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-26T18:10:58.446121] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:58.447075] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSAN took 29.6s. Estimated remaining: 4h 1m 38s. Rate: 7.6 symbols/min [2025-09-26T18:10:58.654311] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:10:58.655203] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T18:10:58.685778] [DEBUG] [LOCAL ] CSV: Loaded 13101 existing records from primary storage. [2025-09-26T18:10:58.685923] [INFO ] [MAIN ] CSV: Loaded 13101 existing records. [2025-09-26T18:10:58.810090] [DEBUG] [LOCAL ] CSTM: Loaded 48051 existing records from primary storage. [2025-09-26T18:10:58.816011] [INFO ] [MAIN ] CSTM: Loaded 48051 existing records. [2025-09-26T18:10:59.009521] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:59.026066] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-26T18:10:59.036517] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-26T18:10:59.063798] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-26T18:10:59.094217] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:10:59.094040] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-26T18:10:59.128830] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-26T18:10:59.163707] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-26T18:10:59.163579] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-26T18:10:59.182397] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-26T18:10:59.196068] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-26T18:10:59.860050] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:10:59.976982] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-26T18:11:00.006079] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:00.010742] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T18:11:00.026852] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T18:11:00.756738] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-26T18:11:01.081986] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T18:11:01.556735] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-26T18:11:02.329723] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:11:02.356734] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-26T18:11:02.383930] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T18:11:03.156728] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-26T18:11:03.956690] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-26T18:11:04.145661] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T18:11:04.146230] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T18:11:04.756730] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-26T18:11:05.556780] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-26T18:11:05.609808] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:11:06.356783] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-26T18:11:06.397889] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T18:11:07.019444] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T18:11:07.156777] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-26T18:11:07.956767] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-26T18:11:08.010178] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T18:11:08.018499] [INFO ] [REMOTE ] CSL: Full fetch complete (45334 records). [2025-09-26T18:11:08.018726] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-26T18:11:08.458286] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-26T18:11:08.458440] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-26T18:11:08.459604] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-26T18:11:08.459858] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-26T18:11:08.493025] [DEBUG] [LOCAL ] CSL: Trimmed 45334 records to 32100 (keeping 200 days of data) [2025-09-26T18:11:08.496354] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T18:11:08.628818] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T18:11:08.757621] [DEBUG] [LOCAL ] CSL: Primary data saved (32100 records). [2025-09-26T18:11:08.758337] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-26T18:11:08.757846] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-26T18:11:08.758589] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSL took 32.0s. Estimated remaining: 4h 1m 39s. Rate: 7.6 symbols/min [2025-09-26T18:11:08.944177] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:08.944458] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-26T18:11:08.944496] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-26T18:11:08.944724] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-26T18:11:08.944778] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-26T18:11:08.944823] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-26T18:11:08.944858] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-26T18:11:09.318983] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:09.556706] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-26T18:11:09.631935] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-26T18:11:10.186361] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T18:11:10.356758] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-26T18:11:11.156826] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-26T18:11:11.375083] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:11.375456] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-26T18:11:11.956758] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-26T18:11:12.033231] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:11:12.188817] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:12.189317] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-26T18:11:12.756748] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-26T18:11:13.556741] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-26T18:11:14.356719] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-26T18:11:14.565002] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T18:11:14.576742] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:14.577849] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-26T18:11:14.587508] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T18:11:15.156781] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-26T18:11:15.956760] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-26T18:11:16.224166] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:16.224501] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-26T18:11:16.718899] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T18:11:16.756716] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-26T18:11:17.556726] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-26T18:11:18.250505] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T18:11:18.356713] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-26T18:11:18.578122] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T18:11:19.156785] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-26T18:11:19.956710] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-26T18:11:20.069910] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T18:11:20.103169] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T18:11:20.756775] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-26T18:11:20.801711] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T18:11:20.805140] [INFO ] [REMOTE ] CSR: Full fetch complete (17570 records). [2025-09-26T18:11:20.805228] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-26T18:11:21.225673] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-26T18:11:21.225794] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-26T18:11:21.226259] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-26T18:11:21.226324] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-26T18:11:21.226995] [DEBUG] [LOCAL ] CSR: Trimmed 17570 records to 12808 (keeping 200 days of data) [2025-09-26T18:11:21.308095] [DEBUG] [LOCAL ] CSR: Primary data saved (12808 records). [2025-09-26T18:11:21.308262] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-26T18:11:21.308358] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSR took 43.1s. Estimated remaining: 4h 1m 46s. Rate: 7.6 symbols/min [2025-09-26T18:11:21.506955] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:21.517197] [DEBUG] [LOCAL ] CTBB: Loaded 7094 existing records from primary storage. [2025-09-26T18:11:21.517348] [INFO ] [MAIN ] CTBB: Loaded 7094 existing records. [2025-09-26T18:11:21.564089] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-26T18:11:21.650715] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T18:11:21.741373] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:11:21.741635] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-26T18:11:21.741716] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-26T18:11:21.742130] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-26T18:11:21.742218] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-26T18:11:21.860764] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:21.895818] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-26T18:11:22.149527] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:22.356735] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-26T18:11:23.156716] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-26T18:11:23.316912] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-26T18:11:23.956764] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-26T18:11:24.756809] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-26T18:11:24.831879] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:11:24.869884] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T18:11:24.873146] [INFO ] [REMOTE ] CSV: Full fetch complete (19478 records). [2025-09-26T18:11:24.873243] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-26T18:11:24.984050] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:25.006867] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-26T18:11:25.412375] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-26T18:11:25.412495] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-26T18:11:25.413248] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-26T18:11:25.413328] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-26T18:11:25.414414] [DEBUG] [LOCAL ] CSV: Trimmed 19478 records to 13198 (keeping 200 days of data) [2025-09-26T18:11:25.544252] [DEBUG] [LOCAL ] CSV: Primary data saved (13198 records). [2025-09-26T18:11:25.544515] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-26T18:11:25.544750] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSV took 27.1s. Estimated remaining: 4h 1m 26s. Rate: 7.6 symbols/min [2025-09-26T18:11:25.562316] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-26T18:11:25.844667] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:25.853795] [DEBUG] [LOCAL ] CTDD: Loaded 5891 existing records from primary storage. [2025-09-26T18:11:25.853948] [INFO ] [MAIN ] CTDD: Loaded 5891 existing records. [2025-09-26T18:11:26.079962] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:11:26.080283] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-26T18:11:26.080334] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-26T18:11:26.080718] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-26T18:11:26.080793] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-26T18:11:26.363406] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-26T18:11:26.502742] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:26.510532] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T18:11:27.156770] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-26T18:11:27.876107] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T18:11:27.895132] [INFO ] [REMOTE ] CSTM: Full fetch complete (69191 records). [2025-09-26T18:11:27.896273] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-26T18:11:27.896156] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T18:11:27.961890] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-26T18:11:28.322961] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-26T18:11:28.323101] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-26T18:11:28.324133] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-26T18:11:28.324222] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-26T18:11:28.326427] [DEBUG] [LOCAL ] CSTM: Trimmed 69191 records to 48360 (keeping 200 days of data) [2025-09-26T18:11:28.637673] [DEBUG] [LOCAL ] CSTM: Primary data saved (48360 records). [2025-09-26T18:11:28.637843] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-26T18:11:28.637973] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CSTM took 30.4s. Estimated remaining: 4h 1m 2s. Rate: 7.6 symbols/min [2025-09-26T18:11:28.761839] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-26T18:11:28.829315] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:28.829672] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-26T18:11:28.829797] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-26T18:11:28.830069] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-26T18:11:28.830180] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-26T18:11:28.830251] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-26T18:11:28.830289] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-26T18:11:29.141823] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T18:11:29.273313] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:29.427102] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:11:29.556743] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-26T18:11:30.175202] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T18:11:30.356754] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-26T18:11:30.947852] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T18:11:31.156737] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-26T18:11:31.956744] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-26T18:11:32.037970] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T18:11:32.391216] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:32.391576] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-26T18:11:32.756786] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-26T18:11:32.987600] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:32.988011] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-26T18:11:33.556740] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-26T18:11:34.275829] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T18:11:34.356768] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-26T18:11:35.073760] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T18:11:35.156786] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-26T18:11:35.956760] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-26T18:11:36.045324] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:11:36.380427] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-26T18:11:36.756739] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-26T18:11:37.556716] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-26T18:11:37.734916] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T18:11:37.739056] [INFO ] [REMOTE ] CSW: Full fetch complete (8247 records). [2025-09-26T18:11:37.739193] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-26T18:11:37.944954] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 77 unique days, need 200 days [2025-09-26T18:11:37.945208] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:11:37.945281] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:11:37.945356] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-26T18:11:37.945431] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-26T18:11:37.945478] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-26T18:11:37.945546] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-26T18:11:37.945634] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CSW took 29.2s. Estimated remaining: 4h 0m 59s. Rate: 7.6 symbols/min [2025-09-26T18:11:38.072969] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-26T18:11:38.145856] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:38.146120] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-26T18:11:38.146174] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-26T18:11:38.146324] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-26T18:11:38.146396] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-26T18:11:38.146449] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-26T18:11:38.146485] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-26T18:11:38.361867] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-26T18:11:38.538683] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:39.053145] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:11:39.156775] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-26T18:11:39.956729] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-26T18:11:40.056061] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T18:11:40.509694] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T18:11:40.756747] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-26T18:11:41.416260] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T18:11:41.556727] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-26T18:11:42.077362] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T18:11:42.356732] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-26T18:11:43.099958] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T18:11:43.156732] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-26T18:11:43.529585] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:43.529989] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-26T18:11:43.956738] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-26T18:11:44.158026] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:44.158438] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-26T18:11:44.756744] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-26T18:11:45.055031] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:45.055387] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-26T18:11:45.556721] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-26T18:11:46.322465] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T18:11:46.324351] [INFO ] [REMOTE ] CTDD: Full fetch complete (8507 records). [2025-09-26T18:11:46.324440] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-26T18:11:46.361852] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-26T18:11:46.718397] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-26T18:11:46.718534] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-26T18:11:46.718809] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-26T18:11:46.718873] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-26T18:11:46.719389] [DEBUG] [LOCAL ] CTDD: Trimmed 8507 records to 5947 (keeping 200 days of data) [2025-09-26T18:11:46.758499] [DEBUG] [LOCAL ] CTDD: Primary data saved (5947 records). [2025-09-26T18:11:46.758672] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-26T18:11:46.758787] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTDD took 21.2s. Estimated remaining: 4h 0m 54s. Rate: 7.6 symbols/min [2025-09-26T18:11:46.845024] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T18:11:46.947224] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:46.980929] [DEBUG] [LOCAL ] CTO: Loaded 28465 existing records from primary storage. [2025-09-26T18:11:46.981077] [INFO ] [MAIN ] CTO: Loaded 28465 existing records. [2025-09-26T18:11:47.158424] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-26T18:11:47.172932] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:11:47.173162] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-26T18:11:47.173231] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-26T18:11:47.174221] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-26T18:11:47.174290] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-26T18:11:47.454783] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:47.480250] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-26T18:11:47.562950] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:47.956730] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-26T18:11:48.756745] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-26T18:11:49.505631] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T18:11:49.556709] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-26T18:11:49.768285] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T18:11:50.356715] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-26T18:11:50.505066] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:11:50.859873] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T18:11:51.156777] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-26T18:11:51.956715] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-26T18:11:52.005702] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-26T18:11:52.547713] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:11:52.756758] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-26T18:11:53.556723] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-26T18:11:53.646938] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:11:54.016741] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T18:11:54.356773] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-26T18:11:55.061147] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-26T18:11:55.156719] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-26T18:11:55.912634] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T18:11:55.914598] [INFO ] [REMOTE ] CTBB: Full fetch complete (10893 records). [2025-09-26T18:11:55.914694] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-26T18:11:55.961910] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-26T18:11:56.308858] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-26T18:11:56.308999] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-26T18:11:56.309632] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-26T18:11:56.309732] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-26T18:11:56.310476] [DEBUG] [LOCAL ] CTBB: Trimmed 10893 records to 7168 (keeping 200 days of data) [2025-09-26T18:11:56.349170] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:11:56.350718] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-26T18:11:56.363977] [DEBUG] [LOCAL ] CTBB: Primary data saved (7168 records). [2025-09-26T18:11:56.364180] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-26T18:11:56.364338] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CTBB took 35.1s. Estimated remaining: 4h 0m 52s. Rate: 7.6 symbols/min [2025-09-26T18:11:56.551999] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:11:56.595620] [DEBUG] [LOCAL ] CTOS: Loaded 36991 existing records from primary storage. [2025-09-26T18:11:56.595910] [INFO ] [MAIN ] CTOS: Loaded 36991 existing records. [2025-09-26T18:11:56.761856] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-26T18:11:56.807605] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:11:56.807977] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-26T18:11:56.808048] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-26T18:11:56.809263] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-26T18:11:56.809331] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-26T18:11:57.202450] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:11:57.556730] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-26T18:11:58.035103] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:11:58.356719] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-26T18:11:58.780254] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:11:59.156722] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-26T18:11:59.472212] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:11:59.956719] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-26T18:12:00.756700] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-26T18:12:01.131352] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T18:12:01.556727] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-26T18:12:02.356773] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-26T18:12:02.487333] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-26T18:12:03.156787] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-26T18:12:03.947811] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (3.19 seconds). [2025-09-26T18:12:03.956746] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-26T18:12:04.199373] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T18:12:04.231261] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-26T18:12:04.373940] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-26T18:12:04.761808] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-26T18:12:04.772732] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-26T18:12:05.556752] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-26T18:12:05.857196] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-26T18:12:05.876014] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:12:05.879054] [INFO ] [REMOTE ] CTEV: Full fetch complete (13801 records). [2025-09-26T18:12:05.879136] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-26T18:12:06.073454] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 146 unique days, need 200 days [2025-09-26T18:12:06.073812] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:12:06.073896] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:12:06.073981] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-26T18:12:06.074082] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-26T18:12:06.074140] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-26T18:12:06.074202] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-26T18:12:06.074304] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTEV took 28.1s. Estimated remaining: 4h 0m 50s. Rate: 7.6 symbols/min [2025-09-26T18:12:06.270905] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:06.342449] [DEBUG] [LOCAL ] CTRA: Loaded 54038 existing records from primary storage. [2025-09-26T18:12:06.342671] [INFO ] [MAIN ] CTRA: Loaded 54038 existing records. [2025-09-26T18:12:06.365336] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-26T18:12:06.539950] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:06.540281] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-26T18:12:06.540340] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-26T18:12:06.541832] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-26T18:12:06.541895] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-26T18:12:06.691144] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:12:06.705804] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-26T18:12:06.930784] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:07.156768] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-26T18:12:07.956744] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-26T18:12:08.353718] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:12:08.354055] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-26T18:12:08.354162] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-26T18:12:08.354238] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-26T18:12:08.354930] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:12:08.355011] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:12:08.355079] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:12:08.355153] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-26T18:12:08.355237] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-26T18:12:08.355296] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-26T18:12:08.355356] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-26T18:12:08.355469] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTEST took 39.7s. Estimated remaining: 4h 0m 23s. Rate: 7.6 symbols/min [2025-09-26T18:12:08.561153] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:08.599809] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T18:12:08.639803] [DEBUG] [LOCAL ] CTRE: Loaded 49589 existing records from primary storage. [2025-09-26T18:12:08.640050] [INFO ] [MAIN ] CTRE: Loaded 49589 existing records. [2025-09-26T18:12:08.761886] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-26T18:12:08.831881] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:08.832122] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-26T18:12:08.832172] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-26T18:12:08.834086] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-26T18:12:08.834174] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-26T18:12:09.242040] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:09.556730] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-26T18:12:10.154853] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:12:10.356754] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-26T18:12:11.156738] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-26T18:12:11.327263] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:12:11.767615] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:12:11.956738] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-26T18:12:12.357879] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T18:12:12.756773] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-26T18:12:13.556728] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-26T18:12:13.733994] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T18:12:14.356780] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-26T18:12:15.156809] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-26T18:12:16.065177] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-26T18:12:16.075135] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-26T18:12:16.108380] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (3.35 seconds). [2025-09-26T18:12:16.173683] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:12:16.214417] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T18:12:16.756759] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-26T18:12:17.040828] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:12:17.556737] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-26T18:12:17.663267] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T18:12:18.356808] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-26T18:12:18.938728] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T18:12:19.156779] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-26T18:12:19.599712] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T18:12:19.956732] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-26T18:12:20.756710] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-26T18:12:21.115313] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T18:12:21.477864] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:12:21.483944] [INFO ] [REMOTE ] CTO: Full fetch complete (41766 records). [2025-09-26T18:12:21.484076] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-26T18:12:21.561861] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-26T18:12:21.925094] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-26T18:12:21.925204] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-26T18:12:21.925784] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-26T18:12:21.925853] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-26T18:12:21.927025] [DEBUG] [LOCAL ] CTO: Trimmed 41766 records to 28661 (keeping 200 days of data) [2025-09-26T18:12:22.110504] [DEBUG] [LOCAL ] CTO: Primary data saved (28661 records). [2025-09-26T18:12:22.110684] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-26T18:12:22.110798] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTO took 35.4s. Estimated remaining: 4h 0m 34s. Rate: 7.6 symbols/min [2025-09-26T18:12:22.299806] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:22.339194] [DEBUG] [LOCAL ] CTRI: Loaded 38243 existing records from primary storage. [2025-09-26T18:12:22.339340] [INFO ] [MAIN ] CTRI: Loaded 38243 existing records. [2025-09-26T18:12:22.362903] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-26T18:12:22.569992] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:22.573567] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-26T18:12:22.573298] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T18:12:22.573786] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-26T18:12:22.587700] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-26T18:12:22.587796] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-26T18:12:22.972191] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:23.156735] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-26T18:12:23.500443] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T18:12:23.956746] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-26T18:12:24.676241] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:12:24.756736] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-26T18:12:25.130926] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-09-26T18:12:25.556746] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-26T18:12:26.356762] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-26T18:12:26.744486] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-26T18:12:26.972317] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-26T18:12:27.008587] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T18:12:27.156732] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-26T18:12:27.280915] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T18:12:27.956771] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-26T18:12:28.566614] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T18:12:28.756762] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-26T18:12:29.162855] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T18:12:29.169727] [INFO ] [REMOTE ] CTOS: Full fetch complete (53495 records). [2025-09-26T18:12:29.169833] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-26T18:12:29.561963] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-26T18:12:29.565824] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-26T18:12:29.565886] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-26T18:12:29.566713] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-26T18:12:29.566895] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-26T18:12:29.568206] [DEBUG] [LOCAL ] CTOS: Trimmed 53495 records to 37246 (keeping 200 days of data) [2025-09-26T18:12:29.778830] [DEBUG] [LOCAL ] CTOS: Primary data saved (37246 records). [2025-09-26T18:12:29.779042] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-26T18:12:29.779170] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTOS took 33.4s. Estimated remaining: 4h 0m 26s. Rate: 7.6 symbols/min [2025-09-26T18:12:29.957501] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:29.977807] [DEBUG] [LOCAL ] CTS: Loaded 19488 existing records from primary storage. [2025-09-26T18:12:29.977966] [INFO ] [MAIN ] CTS: Loaded 19488 existing records. [2025-09-26T18:12:30.182549] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:30.183197] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-26T18:12:30.183292] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-26T18:12:30.184066] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-26T18:12:30.184143] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-26T18:12:30.357395] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-26T18:12:30.594071] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:30.625195] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T18:12:30.653465] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T18:12:31.156730] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-26T18:12:31.956730] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-26T18:12:32.119895] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T18:12:32.190399] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T18:12:32.756735] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-26T18:12:33.556763] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-26T18:12:33.691800] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T18:12:33.746784] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T18:12:34.356752] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-26T18:12:34.941427] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T18:12:35.156687] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-26T18:12:35.168889] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T18:12:35.956772] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-26T18:12:36.756796] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-26T18:12:37.207247] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T18:12:37.561106] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-26T18:12:37.567340] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T18:12:37.875030] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T18:12:38.356787] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-26T18:12:39.066460] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:12:39.156763] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-26T18:12:39.956773] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-26T18:12:40.506301] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T18:12:40.517715] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-09-26T18:12:40.517914] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-26T18:12:40.766853] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-26T18:12:40.879270] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:12:40.960673] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:12:41.011938] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-26T18:12:41.012138] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-26T18:12:41.013236] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-26T18:12:41.013330] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-26T18:12:41.015263] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 54428 (keeping 200 days of data) [2025-09-26T18:12:41.355525] [DEBUG] [LOCAL ] CTRA: Primary data saved (54428 records). [2025-09-26T18:12:41.355736] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-26T18:12:41.355863] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 35.3s. Estimated remaining: 4h 0m 30s. Rate: 7.6 symbols/min [2025-09-26T18:12:41.539952] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:41.556771] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-26T18:12:41.612922] [DEBUG] [LOCAL ] CTVA: Loaded 53612 existing records from primary storage. [2025-09-26T18:12:41.613082] [INFO ] [MAIN ] CTVA: Loaded 53612 existing records. [2025-09-26T18:12:41.826380] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:12:41.826661] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-26T18:12:41.826723] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-26T18:12:41.828149] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-26T18:12:41.828212] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-26T18:12:42.212250] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:42.356700] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-26T18:12:42.482245] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T18:12:42.493022] [INFO ] [REMOTE ] CTRE: Full fetch complete (71115 records). [2025-09-26T18:12:42.493201] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-26T18:12:42.972130] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:12:42.972230] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-26T18:12:42.972367] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-26T18:12:42.981360] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-26T18:12:42.981752] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-26T18:12:42.983493] [DEBUG] [LOCAL ] CTRE: Trimmed 71115 records to 49964 (keeping 200 days of data) [2025-09-26T18:12:43.161639] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-26T18:12:43.294342] [DEBUG] [LOCAL ] CTRE: Primary data saved (49964 records). [2025-09-26T18:12:43.294493] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-26T18:12:43.294582] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRE took 34.9s. Estimated remaining: 4h 0m 2s. Rate: 7.6 symbols/min [2025-09-26T18:12:43.474981] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:12:43.496333] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:43.501900] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-26T18:12:43.501969] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-26T18:12:43.502136] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-26T18:12:43.502182] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-26T18:12:43.502230] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-26T18:12:43.502264] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-26T18:12:43.894274] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:43.956753] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-26T18:12:44.756750] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-26T18:12:44.958169] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T18:12:45.145492] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-26T18:12:45.556741] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-26T18:12:45.712007] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T18:12:46.356720] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-26T18:12:46.980967] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T18:12:47.156778] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-26T18:12:47.956779] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-26T18:12:48.165629] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T18:12:48.175369] [INFO ] [REMOTE ] CTRI: Full fetch complete (51314 records). [2025-09-26T18:12:48.175487] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-26T18:12:48.253412] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-26T18:12:48.591030] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-26T18:12:48.591214] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-26T18:12:48.591987] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-26T18:12:48.592160] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-26T18:12:48.593801] [DEBUG] [LOCAL ] CTRI: Trimmed 51314 records to 38571 (keeping 200 days of data) [2025-09-26T18:12:48.692105] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T18:12:48.757806] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-26T18:12:48.898861] [DEBUG] [LOCAL ] CTRI: Primary data saved (38571 records). [2025-09-26T18:12:48.899035] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-26T18:12:48.899143] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTRI took 26.8s. Estimated remaining: 3h 59m 47s. Rate: 7.6 symbols/min [2025-09-26T18:12:49.093243] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:12:49.093421] [DEBUG] [LOCAL ] CUBE: No existing data file found in primary storage. [2025-09-26T18:12:49.093460] [WARN ] [MAIN ] CUBE: No existing data found, performing full refresh instead. [2025-09-26T18:12:49.093606] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-26T18:12:49.093679] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-26T18:12:49.093743] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-09-26T18:12:49.093791] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-26T18:12:49.480624] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:12:49.556733] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-26T18:12:49.896868] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-26T18:12:50.356724] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-26T18:12:50.552604] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T18:12:50.698731] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T18:12:51.156745] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-26T18:12:51.453793] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-26T18:12:51.956743] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-26T18:12:52.756795] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-26T18:12:53.075485] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T18:12:53.556736] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-26T18:12:54.324507] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:12:54.356691] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-26T18:12:54.381813] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T18:12:55.156769] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-26T18:12:55.956715] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-26T18:12:56.079985] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T18:12:56.394824] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T18:12:56.706230] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:12:56.756692] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-26T18:12:57.556759] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-26T18:12:57.892482] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T18:12:58.356786] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-26T18:12:58.586423] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-26T18:12:59.156768] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-26T18:12:59.627880] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T18:12:59.956837] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-26T18:13:00.756752] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-26T18:13:00.954759] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T18:13:01.363528] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T18:13:01.556703] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-26T18:13:01.961747] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T18:13:02.356849] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-26T18:13:03.156779] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-26T18:13:03.383959] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T18:13:03.458763] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T18:13:03.464950] [INFO ] [REMOTE ] CTS: Full fetch complete (26655 records). [2025-09-26T18:13:03.465113] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-26T18:13:03.855939] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-26T18:13:03.856052] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-26T18:13:03.856827] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-26T18:13:03.856892] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-26T18:13:03.857998] [DEBUG] [LOCAL ] CTS: Trimmed 26655 records to 19637 (keeping 200 days of data) [2025-09-26T18:13:03.956812] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-26T18:13:03.997937] [DEBUG] [LOCAL ] CTS: Primary data saved (19637 records). [2025-09-26T18:13:03.998173] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-26T18:13:03.998322] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CTS took 34.2s. Estimated remaining: 4h 0m 2s. Rate: 7.6 symbols/min [2025-09-26T18:13:04.180283] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:04.180524] [DEBUG] [LOCAL ] CUBI: No existing data file found in primary storage. [2025-09-26T18:13:04.180635] [WARN ] [MAIN ] CUBI: No existing data found, performing full refresh instead. [2025-09-26T18:13:04.180861] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-26T18:13:04.180915] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-26T18:13:04.180960] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-09-26T18:13:04.181012] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-26T18:13:04.266842] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-26T18:13:04.571922] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:04.719518] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T18:13:04.756760] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-26T18:13:05.556796] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-26T18:13:06.356784] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-26T18:13:06.566755] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T18:13:06.612163] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T18:13:07.156767] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-26T18:13:07.956811] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-26T18:13:08.006142] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T18:13:08.708677] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T18:13:08.756744] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-26T18:13:08.953242] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:13:09.556781] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-26T18:13:10.098226] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T18:13:10.356779] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-26T18:13:10.481024] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T18:13:11.156812] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-26T18:13:11.583632] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T18:13:11.890786] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T18:13:11.956741] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-26T18:13:12.756732] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-26T18:13:13.556811] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-26T18:13:13.756336] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T18:13:13.820121] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T18:13:14.356761] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-26T18:13:15.156771] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-26T18:13:15.478417] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:13:15.496877] [INFO ] [REMOTE ] CTVA: Full fetch complete (76965 records). [2025-09-26T18:13:15.497223] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-26T18:13:15.758869] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T18:13:15.779236] [INFO ] [REMOTE ] CUBB: Full fetch complete (928 records). [2025-09-26T18:13:15.787541] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-26T18:13:15.970945] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-26T18:13:16.075437] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:13:16.156220] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-26T18:13:16.183143] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-26T18:13:16.195784] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-26T18:13:16.211619] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-26T18:13:16.218877] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T18:13:16.219444] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:13:16.219531] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:13:16.219609] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-26T18:13:16.219730] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-26T18:13:16.220233] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-26T18:13:16.220439] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-26T18:13:16.220617] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CUBB took 32.9s. Estimated remaining: 4h 0m 9s. Rate: 7.6 symbols/min [2025-09-26T18:13:16.309332] [DEBUG] [LOCAL ] CTVA: Trimmed 76965 records to 54002 (keeping 200 days of data) [2025-09-26T18:13:16.508534] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:16.705949] [DEBUG] [LOCAL ] CUK: Loaded 51382 existing records from primary storage. [2025-09-26T18:13:16.707013] [INFO ] [MAIN ] CUK: Loaded 51382 existing records. [2025-09-26T18:13:16.766821] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-26T18:13:16.927593] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:16.937006] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-26T18:13:16.941583] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-26T18:13:16.979157] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-26T18:13:16.986350] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-26T18:13:17.357950] [DEBUG] [LOCAL ] CTVA: Primary data saved (54002 records). [2025-09-26T18:13:17.383122] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-26T18:13:17.397901] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CTVA took 36.0s. Estimated remaining: 3h 59m 39s. Rate: 7.6 symbols/min [2025-09-26T18:13:17.467843] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:17.558781] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-26T18:13:17.638483] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:17.643319] [DEBUG] [LOCAL ] CULP: Loaded 3087 existing records from primary storage. [2025-09-26T18:13:17.643420] [INFO ] [MAIN ] CULP: Loaded 3087 existing records. [2025-09-26T18:13:17.848111] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:17.848789] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-26T18:13:17.848865] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-26T18:13:17.849145] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-26T18:13:17.849207] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-26T18:13:18.171389] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T18:13:18.264471] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:18.340479] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-26T18:13:18.356683] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-26T18:13:19.128167] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:13:19.156712] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-26T18:13:19.821868] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:13:19.835146] [INFO ] [REMOTE ] CUBE: Full fetch complete (72973 records). [2025-09-26T18:13:19.835392] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-26T18:13:19.961848] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-26T18:13:20.264073] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-26T18:13:20.264233] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-26T18:13:20.265117] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-26T18:13:20.265190] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-26T18:13:20.266805] [DEBUG] [LOCAL ] CUBE: Trimmed 72973 records to 51391 (keeping 200 days of data) [2025-09-26T18:13:20.602773] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T18:13:20.646972] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:13:20.647101] [DEBUG] [LOCAL ] CUBE: Primary data saved (51391 records). [2025-09-26T18:13:20.647435] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-26T18:13:20.663411] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CUBE took 31.8s. Estimated remaining: 3h 59m 15s. Rate: 7.6 symbols/min [2025-09-26T18:13:20.761997] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-26T18:13:20.851593] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:20.888613] [DEBUG] [LOCAL ] CURB: Loaded 33144 existing records from primary storage. [2025-09-26T18:13:20.888790] [INFO ] [MAIN ] CURB: Loaded 33144 existing records. [2025-09-26T18:13:21.074603] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:21.074896] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-26T18:13:21.074948] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-26T18:13:21.075826] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-26T18:13:21.075889] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-26T18:13:21.446050] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:21.556724] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-26T18:13:21.905974] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T18:13:22.356728] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-26T18:13:22.752393] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T18:13:22.782372] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:13:23.156728] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-26T18:13:23.583698] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-26T18:13:23.956766] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-26T18:13:24.756737] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-26T18:13:25.355744] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T18:13:25.556737] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-26T18:13:25.715207] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T18:13:26.356732] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-26T18:13:26.872472] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:13:27.156740] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-26T18:13:27.769061] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T18:13:27.956726] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-26T18:13:28.099992] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:13:28.750753] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T18:13:28.757072] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-26T18:13:29.556719] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-26T18:13:30.356758] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-26T18:13:30.610073] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T18:13:31.099204] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T18:13:31.156757] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-26T18:13:31.420863] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T18:13:31.703688] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T18:13:31.956794] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-26T18:13:32.756755] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-26T18:13:33.556739] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-26T18:13:33.771581] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:13:33.841516] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:13:34.356769] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-26T18:13:35.156732] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-26T18:13:35.501816] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T18:13:35.956705] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-26T18:13:36.148280] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T18:13:36.176401] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-26T18:13:36.182830] [INFO ] [REMOTE ] CUBI: Full fetch complete (39300 records). [2025-09-26T18:13:36.182979] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-26T18:13:36.576960] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-26T18:13:36.577047] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-26T18:13:36.577626] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-26T18:13:36.577717] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-26T18:13:36.578666] [DEBUG] [LOCAL ] CUBI: Trimmed 39300 records to 27667 (keeping 200 days of data) [2025-09-26T18:13:36.757198] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-26T18:13:36.780123] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T18:13:36.790292] [DEBUG] [LOCAL ] CUBI: Primary data saved (27667 records). [2025-09-26T18:13:36.790803] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-26T18:13:36.790922] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBI took 32.8s. Estimated remaining: 3h 59m 34s. Rate: 7.6 symbols/min [2025-09-26T18:13:37.354852] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T18:13:37.556737] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-26T18:13:38.356689] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-26T18:13:38.671559] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:13:39.156729] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-26T18:13:39.782204] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T18:13:39.956784] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-26T18:13:40.250545] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:13:40.756728] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-26T18:13:41.556778] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-26T18:13:41.615137] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T18:13:42.101815] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T18:13:42.231781] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:13:42.356730] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-26T18:13:43.156721] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-26T18:13:43.807424] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T18:13:43.814181] [INFO ] [REMOTE ] CURB: Full fetch complete (47232 records). [2025-09-26T18:13:43.814300] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-26T18:13:43.966215] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-26T18:13:44.231232] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-26T18:13:44.231334] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-26T18:13:44.232077] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-26T18:13:44.232145] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-26T18:13:44.233476] [DEBUG] [LOCAL ] CURB: Trimmed 47232 records to 33350 (keeping 200 days of data) [2025-09-26T18:13:44.446080] [DEBUG] [LOCAL ] CURB: Primary data saved (33350 records). [2025-09-26T18:13:44.446233] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-26T18:13:44.446339] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CURB took 23.8s. Estimated remaining: 3h 59m 26s. Rate: 7.6 symbols/min [2025-09-26T18:13:44.456072] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T18:13:44.756733] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-26T18:13:44.903337] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T18:13:44.913531] [INFO ] [REMOTE ] CUK: Full fetch complete (73802 records). [2025-09-26T18:13:44.913717] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-26T18:13:45.288057] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-26T18:13:45.310782] [INFO ] [REMOTE ] CULP: Full fetch complete (4778 records). [2025-09-26T18:13:45.332806] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-26T18:13:45.351787] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-26T18:13:45.357447] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-26T18:13:45.392446] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-26T18:13:45.406842] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-26T18:13:45.491380] [DEBUG] [LOCAL ] CUK: Trimmed 73802 records to 51762 (keeping 200 days of data) [2025-09-26T18:13:45.922928] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-26T18:13:45.923320] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-26T18:13:45.923500] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-26T18:13:45.924183] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-26T18:13:45.928473] [DEBUG] [LOCAL ] CULP: Trimmed 4778 records to 3111 (keeping 200 days of data) [2025-09-26T18:13:46.005769] [DEBUG] [LOCAL ] CULP: Primary data saved (3111 records). [2025-09-26T18:13:46.014734] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-26T18:13:46.015202] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CULP took 28.6s. Estimated remaining: 3h 58m 57s. Rate: 7.6 symbols/min [2025-09-26T18:13:46.149272] [DEBUG] [LOCAL ] CUK: Primary data saved (51762 records). [2025-09-26T18:13:46.149443] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-26T18:13:46.149545] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CUK took 29.9s. Estimated remaining: 3h 58m 24s. Rate: 7.6 symbols/min [2025-09-26T18:13:46.819144] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:46.882749] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:46.881135] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:46.923931] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-09-26T18:13:46.931378] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-09-26T18:13:46.961344] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-26T18:13:46.961013] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:13:46.961600] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-26T18:13:46.961707] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-09-26T18:13:46.962845] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-09-26T18:13:46.963058] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-26T18:13:46.963113] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-26T18:13:46.961806] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-09-26T18:13:46.963185] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-26T18:13:46.975888] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-09-26T18:13:47.012679] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-26T18:13:47.524417] [DEBUG] [LOCAL ] CVE: Loaded 53946 existing records from primary storage. [2025-09-26T18:13:47.539973] [INFO ] [MAIN ] CVE: Loaded 53946 existing records. [2025-09-26T18:13:47.523440] [DEBUG] [LOCAL ] CUZ: Loaded 49778 existing records from primary storage. [2025-09-26T18:13:47.545300] [INFO ] [MAIN ] CUZ: Loaded 49778 existing records. [2025-09-26T18:13:48.070538] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:48.108084] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-26T18:13:48.235503] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:48.287447] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-26T18:13:48.280854] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:48.287801] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:13:48.289308] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-26T18:13:48.289226] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-26T18:13:48.290484] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-26T18:13:48.290628] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-26T18:13:48.292236] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-26T18:13:48.292322] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-26T18:13:48.297874] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-26T18:13:48.358605] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-26T18:13:49.044711] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:49.051337] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-26T18:13:49.086077] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:13:49.086692] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-26T18:13:49.244085] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T18:13:49.246973] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-26T18:13:49.518100] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:13:49.556744] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-26T18:13:49.712623] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T18:13:50.337747] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T18:13:50.356677] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-26T18:13:50.422559] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T18:13:50.666060] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:13:50.955036] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T18:13:51.156724] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-26T18:13:51.956720] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-26T18:13:52.723659] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:13:52.756683] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-26T18:13:52.780972] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T18:13:53.556742] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-26T18:13:54.356710] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-26T18:13:54.579199] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:13:54.619879] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T18:13:55.156718] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-26T18:13:55.463699] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T18:13:55.799790] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T18:13:55.956705] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-26T18:13:56.756789] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-26T18:13:56.977509] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T18:13:57.556719] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-26T18:13:58.180159] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:13:58.201486] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T18:13:58.356737] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-26T18:13:59.156778] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-26T18:13:59.636691] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T18:13:59.956767] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-26T18:14:00.473889] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:14:00.756772] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-26T18:14:01.121780] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T18:14:01.556750] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-26T18:14:02.356736] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-26T18:14:02.954300] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T18:14:03.108556] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-26T18:14:03.156694] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-26T18:14:03.498730] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:14:03.956714] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-26T18:14:04.317065] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:14:04.756792] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-26T18:14:05.556743] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-26T18:14:05.681081] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T18:14:06.141103] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T18:14:06.278751] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T18:14:06.356696] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-26T18:14:07.156734] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-26T18:14:07.956755] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-26T18:14:08.089892] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T18:14:08.093361] [INFO ] [REMOTE ] CVEO: Full fetch complete (20241 records). [2025-09-26T18:14:08.093529] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-26T18:14:08.448815] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-26T18:14:08.548722] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-26T18:14:08.548820] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-26T18:14:08.549197] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-26T18:14:08.549239] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-26T18:14:08.549969] [DEBUG] [LOCAL ] CVEO: Trimmed 20241 records to 15402 (keeping 200 days of data) [2025-09-26T18:14:08.647260] [DEBUG] [LOCAL ] CVEO: Primary data saved (15402 records). [2025-09-26T18:14:08.647438] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-26T18:14:08.647529] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CVEO took 22.5s. Estimated remaining: 3h 59m 3s. Rate: 7.6 symbols/min [2025-09-26T18:14:08.761844] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-26T18:14:08.866726] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:08.916938] [DEBUG] [LOCAL ] CVI: Loaded 46801 existing records from primary storage. [2025-09-26T18:14:08.917279] [INFO ] [MAIN ] CVI: Loaded 46801 existing records. [2025-09-26T18:14:09.025687] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T18:14:09.145074] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:09.145360] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-26T18:14:09.145410] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-26T18:14:09.146486] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-26T18:14:09.146547] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-26T18:14:09.521105] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:09.556677] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-26T18:14:10.032957] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T18:14:10.356748] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-26T18:14:10.853708] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-26T18:14:11.156738] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-26T18:14:11.879126] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:14:11.956697] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-26T18:14:12.252124] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:14:12.756728] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-26T18:14:13.042019] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:14:13.556725] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-26T18:14:14.356703] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-26T18:14:14.442143] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:14:14.449745] [INFO ] [REMOTE ] CURV: Full fetch complete (39328 records). [2025-09-26T18:14:14.449867] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-26T18:14:14.847766] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-26T18:14:14.847934] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-26T18:14:14.848587] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-26T18:14:14.848686] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-26T18:14:14.849729] [DEBUG] [LOCAL ] CURV: Trimmed 39328 records to 26933 (keeping 200 days of data) [2025-09-26T18:14:15.008344] [DEBUG] [LOCAL ] CURV: Primary data saved (26933 records). [2025-09-26T18:14:15.008501] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-26T18:14:15.008586] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CURV took 28.9s. Estimated remaining: 3h 58m 50s. Rate: 7.6 symbols/min [2025-09-26T18:14:15.165472] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-26T18:14:15.221222] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:15.227339] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:14:15.250437] [DEBUG] [LOCAL ] CVLG: Loaded 15677 existing records from primary storage. [2025-09-26T18:14:15.250567] [INFO ] [MAIN ] CVLG: Loaded 15677 existing records. [2025-09-26T18:14:15.438418] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:15.438751] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-26T18:14:15.438811] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-26T18:14:15.439467] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-26T18:14:15.439527] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-26T18:14:15.815613] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:15.956753] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-26T18:14:16.247684] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T18:14:16.581295] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T18:14:16.756732] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-26T18:14:17.091791] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T18:14:17.556743] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-26T18:14:18.356720] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-26T18:14:18.572293] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T18:14:18.603433] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:14:18.613757] [INFO ] [REMOTE ] CUZ: Full fetch complete (70846 records). [2025-09-26T18:14:18.613931] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-26T18:14:19.028459] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-26T18:14:19.028558] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-26T18:14:19.029378] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-26T18:14:19.029453] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-26T18:14:19.031138] [DEBUG] [LOCAL ] CUZ: Trimmed 70846 records to 50140 (keeping 200 days of data) [2025-09-26T18:14:19.158117] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-26T18:14:19.354369] [DEBUG] [LOCAL ] CUZ: Primary data saved (50140 records). [2025-09-26T18:14:19.354528] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-26T18:14:19.354745] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CUZ took 33.2s. Estimated remaining: 3h 58m 31s. Rate: 7.6 symbols/min [2025-09-26T18:14:19.542006] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:19.604572] [DEBUG] [LOCAL ] CVNA: Loaded 53395 existing records from primary storage. [2025-09-26T18:14:19.604770] [INFO ] [MAIN ] CVNA: Loaded 53395 existing records. [2025-09-26T18:14:19.834282] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:19.835092] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-26T18:14:19.837098] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:14:19.835506] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-26T18:14:19.849728] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-26T18:14:19.849832] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-26T18:14:19.962813] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-26T18:14:20.254019] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:20.283256] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:14:20.756753] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-26T18:14:21.556718] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-26T18:14:21.753912] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:14:21.993019] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:14:22.356751] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-26T18:14:23.156756] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-26T18:14:23.370136] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:14:23.956773] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-26T18:14:24.524929] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:14:24.597268] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-26T18:14:24.711877] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T18:14:24.756717] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-26T18:14:25.556768] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-26T18:14:25.691162] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T18:14:26.356790] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-26T18:14:26.999230] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:14:27.156734] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-26T18:14:27.965497] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-26T18:14:27.986219] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T18:14:27.997707] [INFO ] [REMOTE ] CVE: Full fetch complete (77548 records). [2025-09-26T18:14:27.997861] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-26T18:14:28.437779] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-26T18:14:28.437993] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-26T18:14:28.438917] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-26T18:14:28.438995] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-26T18:14:28.440764] [DEBUG] [LOCAL ] CVE: Trimmed 77548 records to 54336 (keeping 200 days of data) [2025-09-26T18:14:28.766621] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-26T18:14:28.798426] [DEBUG] [LOCAL ] CVE: Primary data saved (54336 records). [2025-09-26T18:14:28.798585] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-26T18:14:28.798767] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVE took 42.6s. Estimated remaining: 3h 58m 28s. Rate: 7.6 symbols/min [2025-09-26T18:14:28.986488] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:29.047353] [DEBUG] [LOCAL ] CVS: Loaded 54086 existing records from primary storage. [2025-09-26T18:14:29.047591] [INFO ] [MAIN ] CVS: Loaded 54086 existing records. [2025-09-26T18:14:29.244844] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:29.245517] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-26T18:14:29.245766] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-26T18:14:29.247675] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-26T18:14:29.247742] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-26T18:14:29.602783] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-26T18:14:29.644627] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-26T18:14:29.689977] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:29.720629] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:14:29.757351] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T18:14:30.356749] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-26T18:14:31.156756] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-26T18:14:31.330121] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:14:31.500595] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T18:14:31.956763] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-26T18:14:32.705090] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T18:14:32.756757] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-26T18:14:33.023836] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T18:14:33.366082] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T18:14:33.556722] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-26T18:14:34.356745] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-26T18:14:35.156738] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-26T18:14:35.308373] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T18:14:35.956768] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-26T18:14:35.983770] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T18:14:36.254057] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-26T18:14:36.756734] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-26T18:14:37.556748] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-26T18:14:37.747852] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T18:14:38.356787] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-26T18:14:38.872229] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:14:38.881936] [INFO ] [REMOTE ] CVI: Full fetch complete (67280 records). [2025-09-26T18:14:38.882084] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-26T18:14:39.159534] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-26T18:14:39.336485] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-26T18:14:39.336704] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-26T18:14:39.337672] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-26T18:14:39.337795] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-26T18:14:39.339624] [DEBUG] [LOCAL ] CVI: Trimmed 67280 records to 47160 (keeping 200 days of data) [2025-09-26T18:14:39.456891] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T18:14:39.667350] [DEBUG] [LOCAL ] CVI: Primary data saved (47160 records). [2025-09-26T18:14:39.667510] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-26T18:14:39.667626] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVI took 31.0s. Estimated remaining: 3h 58m 29s. Rate: 7.6 symbols/min [2025-09-26T18:14:39.853019] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:39.912060] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-09-26T18:14:39.912225] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-09-26T18:14:39.966194] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-26T18:14:40.120834] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T18:14:40.125362] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:40.128626] [INFO ] [REMOTE ] CVLG: Full fetch complete (20783 records). [2025-09-26T18:14:40.128759] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-26T18:14:40.128916] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-26T18:14:40.128998] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-26T18:14:40.163295] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-26T18:14:40.190412] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-26T18:14:40.856262] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-26T18:14:40.870006] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-26T18:14:40.870483] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-26T18:14:40.871038] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-26T18:14:40.939570] [DEBUG] [LOCAL ] CVLG: Trimmed 20783 records to 15730 (keeping 200 days of data) [2025-09-26T18:14:40.962003] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:40.962532] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-26T18:14:41.082610] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-26T18:14:41.120680] [DEBUG] [LOCAL ] CVLG: Primary data saved (15730 records). [2025-09-26T18:14:41.120892] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-26T18:14:41.121059] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVLG took 26.1s. Estimated remaining: 3h 58m 1s. Rate: 7.6 symbols/min [2025-09-26T18:14:41.361825] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:41.389284] [DEBUG] [LOCAL ] CW: Loaded 22557 existing records from primary storage. [2025-09-26T18:14:41.389428] [INFO ] [MAIN ] CW: Loaded 22557 existing records. [2025-09-26T18:14:41.567453] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-26T18:14:41.613054] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:41.614138] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-26T18:14:41.614382] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-26T18:14:41.615342] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-26T18:14:41.615430] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-26T18:14:41.784857] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T18:14:42.076888] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:42.356781] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-26T18:14:43.167749] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-26T18:14:43.200962] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-26T18:14:43.659340] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-26T18:14:43.956716] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-26T18:14:44.592383] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T18:14:44.632763] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-26T18:14:44.756738] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-26T18:14:45.556788] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-26T18:14:45.991628] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-26T18:14:46.052257] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T18:14:46.356785] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-26T18:14:47.156835] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-26T18:14:47.452049] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-26T18:14:47.956800] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-26T18:14:48.100696] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:14:48.132040] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T18:14:48.756761] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-26T18:14:49.556777] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-26T18:14:49.832707] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T18:14:50.356732] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-26T18:14:50.427679] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T18:14:51.129707] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-26T18:14:51.156707] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-26T18:14:51.956749] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-26T18:14:52.654966] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T18:14:52.756756] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-26T18:14:52.789361] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T18:14:53.306724] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T18:14:53.556800] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-26T18:14:54.356852] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-26T18:14:55.167448] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-26T18:14:55.191746] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-26T18:14:55.273269] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:14:55.346092] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:14:55.956763] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-26T18:14:56.756776] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-26T18:14:57.106913] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T18:14:57.118184] [INFO ] [REMOTE ] CVNA: Full fetch complete (76673 records). [2025-09-26T18:14:57.118428] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-26T18:14:57.543456] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-26T18:14:57.543743] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-26T18:14:57.545036] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-26T18:14:57.545128] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-26T18:14:57.547286] [DEBUG] [LOCAL ] CVNA: Trimmed 76673 records to 53766 (keeping 200 days of data) [2025-09-26T18:14:57.563746] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-26T18:14:57.565440] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T18:14:57.941914] [DEBUG] [LOCAL ] CVNA: Primary data saved (53766 records). [2025-09-26T18:14:57.942272] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-26T18:14:57.942520] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVNA took 38.6s. Estimated remaining: 3h 58m 21s. Rate: 7.6 symbols/min [2025-09-26T18:14:58.125909] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:14:58.162022] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-26T18:14:58.226346] [DEBUG] [LOCAL ] CWAN: Loaded 52772 existing records from primary storage. [2025-09-26T18:14:58.226568] [INFO ] [MAIN ] CWAN: Loaded 52772 existing records. [2025-09-26T18:14:58.362022] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-26T18:14:58.422982] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:14:58.423276] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-26T18:14:58.423328] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-26T18:14:58.424850] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-26T18:14:58.424924] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-26T18:14:58.819712] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:14:59.156788] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-26T18:14:59.277088] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T18:14:59.412254] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T18:14:59.956735] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-26T18:15:00.756746] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-26T18:15:00.922962] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:15:01.556733] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-26T18:15:01.886535] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:15:02.156686] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T18:15:02.356734] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-26T18:15:03.040551] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:15:03.156787] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-26T18:15:03.956715] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-26T18:15:04.106520] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T18:15:04.112163] [INFO ] [REMOTE ] CW: Full fetch complete (33459 records). [2025-09-26T18:15:04.112269] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-26T18:15:04.534200] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-26T18:15:04.534382] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-26T18:15:04.534951] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-26T18:15:04.535059] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-26T18:15:04.538673] [DEBUG] [LOCAL ] CW: Trimmed 33459 records to 22705 (keeping 200 days of data) [2025-09-26T18:15:04.668484] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-26T18:15:04.731075] [DEBUG] [LOCAL ] CW: Primary data saved (22705 records). [2025-09-26T18:15:04.731202] [INFO ] [MAIN ] CW: Full history saved. [2025-09-26T18:15:04.731382] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CW took 23.6s. Estimated remaining: 3h 58m 10s. Rate: 7.6 symbols/min [2025-09-26T18:15:04.763576] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-26T18:15:04.913587] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:04.913823] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-09-26T18:15:04.913881] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-09-26T18:15:04.914082] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-26T18:15:04.914127] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-26T18:15:04.914170] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-09-26T18:15:04.914214] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-26T18:15:05.306178] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:05.556719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-26T18:15:06.003156] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-26T18:15:06.021638] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-09-26T18:15:06.021855] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-26T18:15:06.360766] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-26T18:15:06.472828] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-26T18:15:06.473082] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-26T18:15:06.474096] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-26T18:15:06.474534] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-26T18:15:06.486126] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 54476 (keeping 200 days of data) [2025-09-26T18:15:06.504397] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T18:15:06.868797] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T18:15:06.886773] [DEBUG] [LOCAL ] CVS: Primary data saved (54476 records). [2025-09-26T18:15:06.886923] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-26T18:15:06.887064] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CVS took 38.1s. Estimated remaining: 3h 57m 43s. Rate: 7.6 symbols/min [2025-09-26T18:15:07.066163] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:07.122470] [DEBUG] [LOCAL ] CWH: Loaded 51776 existing records from primary storage. [2025-09-26T18:15:07.122671] [INFO ] [MAIN ] CWH: Loaded 51776 existing records. [2025-09-26T18:15:07.161907] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-26T18:15:07.316098] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:07.316388] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-26T18:15:07.316436] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-26T18:15:07.317798] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-26T18:15:07.317873] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-26T18:15:07.703935] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:07.956733] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-26T18:15:08.450876] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:15:08.729998] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-26T18:15:08.756724] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-26T18:15:09.420436] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:15:09.556739] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-26T18:15:10.356768] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-26T18:15:10.803585] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T18:15:11.156763] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-26T18:15:11.362106] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T18:15:11.489917] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:15:11.956744] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-26T18:15:12.544925] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:15:12.756768] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-26T18:15:13.258686] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T18:15:13.556769] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-26T18:15:14.356747] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-26T18:15:15.104497] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:15:15.156695] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-26T18:15:15.392114] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-26T18:15:15.403517] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-26T18:15:15.403753] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-26T18:15:15.918435] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-26T18:15:15.918792] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-26T18:15:15.922338] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:15:15.920845] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-26T18:15:15.931619] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-26T18:15:15.934296] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54540 (keeping 200 days of data) [2025-09-26T18:15:16.005571] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-26T18:15:16.317525] [DEBUG] [LOCAL ] CVX: Primary data saved (54540 records). [2025-09-26T18:15:16.317716] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-26T18:15:16.317856] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CVX took 36.7s. Estimated remaining: 3h 57m 40s. Rate: 7.6 symbols/min [2025-09-26T18:15:16.535325] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:16.602093] [DEBUG] [LOCAL ] CWK: Loaded 49795 existing records from primary storage. [2025-09-26T18:15:16.602256] [INFO ] [MAIN ] CWK: Loaded 49795 existing records. [2025-09-26T18:15:16.776932] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-26T18:15:16.827429] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:16.827898] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-26T18:15:16.828040] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-26T18:15:16.829570] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-26T18:15:16.829682] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-26T18:15:17.038938] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T18:15:17.280769] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:17.556742] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-26T18:15:17.781353] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T18:15:18.356818] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-26T18:15:18.838419] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-26T18:15:19.068591] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:15:19.156785] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-26T18:15:19.653346] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:15:19.956794] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-26T18:15:20.524346] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:15:20.756781] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-26T18:15:21.556933] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-26T18:15:22.051857] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-26T18:15:22.273062] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:15:22.356777] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-26T18:15:22.735132] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T18:15:23.156787] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-26T18:15:23.804872] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T18:15:23.956789] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-26T18:15:24.657180] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:15:24.756764] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-26T18:15:25.166495] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T18:15:25.556725] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-26T18:15:26.005726] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T18:15:26.356729] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-26T18:15:27.156742] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-26T18:15:27.211222] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:15:27.956719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-26T18:15:28.126844] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T18:15:28.535598] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T18:15:28.756763] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-26T18:15:29.502258] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:15:29.511964] [INFO ] [REMOTE ] CWEN: Full fetch complete (64451 records). [2025-09-26T18:15:29.512123] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-26T18:15:29.561905] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-26T18:15:29.940775] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-26T18:15:29.940882] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-26T18:15:29.941776] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-26T18:15:29.941878] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-26T18:15:29.943455] [DEBUG] [LOCAL ] CWEN: Trimmed 64451 records to 45717 (keeping 200 days of data) [2025-09-26T18:15:30.210739] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T18:15:30.295114] [DEBUG] [LOCAL ] CWEN: Primary data saved (45717 records). [2025-09-26T18:15:30.295258] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-26T18:15:30.295342] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWEN took 25.6s. Estimated remaining: 3h 57m 51s. Rate: 7.6 symbols/min [2025-09-26T18:15:30.361827] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-26T18:15:30.488106] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:30.523229] [DEBUG] [LOCAL ] CWT: Loaded 28104 existing records from primary storage. [2025-09-26T18:15:30.523373] [INFO ] [MAIN ] CWT: Loaded 28104 existing records. [2025-09-26T18:15:30.711327] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:30.711687] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-26T18:15:30.711769] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-26T18:15:30.712680] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-26T18:15:30.712750] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-26T18:15:31.117492] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:31.156726] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-26T18:15:31.559277] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T18:15:31.956720] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-26T18:15:32.175107] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:15:32.231471] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T18:15:32.756778] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-26T18:15:33.556733] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-26T18:15:34.085609] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:15:34.356764] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-26T18:15:34.661466] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T18:15:35.050120] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-09-26T18:15:35.061556] [INFO ] [REMOTE ] CWAN: Full fetch complete (74721 records). [2025-09-26T18:15:35.061859] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-26T18:15:35.062931] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:15:35.063035] [FATAL] [MAIN ] CWAN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:15:35.063111] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:15:35.063193] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-26T18:15:35.063263] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-26T18:15:35.063302] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-09-26T18:15:35.063890] [DEBUG] [LOCAL ] CWAN: Deleted derivative data file. [2025-09-26T18:15:35.064002] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWAN took 37.1s. Estimated remaining: 3h 57m 34s. Rate: 7.6 symbols/min [2025-09-26T18:15:35.161836] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-26T18:15:35.268559] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:35.326970] [DEBUG] [LOCAL ] CX: Loaded 53229 existing records from primary storage. [2025-09-26T18:15:35.327197] [INFO ] [MAIN ] CX: Loaded 53229 existing records. [2025-09-26T18:15:35.520849] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:35.521100] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-26T18:15:35.521148] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-26T18:15:35.522437] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-26T18:15:35.522502] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-26T18:15:35.911101] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:35.945459] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T18:15:35.956885] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-26T18:15:36.158247] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:15:36.756775] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-26T18:15:37.357846] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:15:37.556734] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-26T18:15:38.246959] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:15:38.356734] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-26T18:15:38.951568] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T18:15:39.156729] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-26T18:15:39.956706] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-26T18:15:40.139256] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:15:40.403337] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T18:15:40.756731] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-26T18:15:41.540681] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:15:41.556677] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-26T18:15:42.027872] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:15:42.356730] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-26T18:15:42.566407] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T18:15:43.156743] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-26T18:15:43.835264] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T18:15:43.845688] [INFO ] [REMOTE ] CWK: Full fetch complete (70917 records). [2025-09-26T18:15:43.845868] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-26T18:15:43.961793] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-26T18:15:44.319315] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-26T18:15:44.319421] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-26T18:15:44.320226] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-26T18:15:44.320295] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-26T18:15:44.321972] [DEBUG] [LOCAL ] CWK: Trimmed 70917 records to 50158 (keeping 200 days of data) [2025-09-26T18:15:44.645847] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:15:44.674364] [DEBUG] [LOCAL ] CWK: Primary data saved (50158 records). [2025-09-26T18:15:44.675362] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-26T18:15:44.675526] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWK took 28.4s. Estimated remaining: 3h 57m 31s. Rate: 7.6 symbols/min [2025-09-26T18:15:44.761813] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-26T18:15:44.868283] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:44.891044] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T18:15:44.894627] [DEBUG] [LOCAL ] CXE: Loaded 7230 existing records from primary storage. [2025-09-26T18:15:44.894834] [INFO ] [MAIN ] CXE: Loaded 7230 existing records. [2025-09-26T18:15:45.099186] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:15:45.099438] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-26T18:15:45.099489] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-26T18:15:45.099920] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-26T18:15:45.099985] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-26T18:15:45.517845] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:45.556743] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-26T18:15:46.356697] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-26T18:15:46.474013] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:15:46.607680] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-26T18:15:47.156723] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-26T18:15:47.225241] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T18:15:47.956721] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-26T18:15:48.756756] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-26T18:15:48.963137] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:15:49.205792] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T18:15:49.556716] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-26T18:15:50.356726] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-26T18:15:50.574860] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T18:15:50.586326] [INFO ] [REMOTE ] CWH: Full fetch complete (72851 records). [2025-09-26T18:15:50.586518] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-26T18:15:51.061524] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-26T18:15:51.061717] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-26T18:15:51.062638] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-26T18:15:51.062765] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-26T18:15:51.064831] [DEBUG] [LOCAL ] CWH: Trimmed 72851 records to 52151 (keeping 200 days of data) [2025-09-26T18:15:51.097778] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T18:15:51.161780] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-26T18:15:51.250095] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:15:51.491725] [DEBUG] [LOCAL ] CWH: Primary data saved (52151 records). [2025-09-26T18:15:51.491944] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-26T18:15:51.492082] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWH took 44.6s. Estimated remaining: 3h 57m 20s. Rate: 7.6 symbols/min [2025-09-26T18:15:51.690710] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:51.690912] [DEBUG] [LOCAL ] CXH: No existing data file found in primary storage. [2025-09-26T18:15:51.690954] [WARN ] [MAIN ] CXH: No existing data found, performing full refresh instead. [2025-09-26T18:15:51.691114] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-26T18:15:51.691160] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-26T18:15:51.691205] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-09-26T18:15:51.691240] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-26T18:15:51.961846] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-26T18:15:52.107046] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:52.112770] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:15:52.756732] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-26T18:15:53.212689] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T18:15:53.556721] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-26T18:15:53.732342] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T18:15:54.356767] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-26T18:15:54.583144] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T18:15:54.589051] [INFO ] [REMOTE ] CWT: Full fetch complete (40268 records). [2025-09-26T18:15:54.589228] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-26T18:15:55.010429] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-26T18:15:55.010557] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-26T18:15:55.011189] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-26T18:15:55.011311] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-26T18:15:55.020151] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T18:15:55.023099] [DEBUG] [LOCAL ] CWT: Trimmed 40268 records to 28294 (keeping 200 days of data) [2025-09-26T18:15:55.167866] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-26T18:15:55.203412] [DEBUG] [LOCAL ] CWT: Primary data saved (28294 records). [2025-09-26T18:15:55.203574] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-26T18:15:55.203711] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CWT took 24.9s. Estimated remaining: 3h 56m 58s. Rate: 7.6 symbols/min [2025-09-26T18:15:55.391790] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:15:55.392000] [DEBUG] [LOCAL ] CXM: No existing data file found in primary storage. [2025-09-26T18:15:55.392062] [WARN ] [MAIN ] CXM: No existing data found, performing full refresh instead. [2025-09-26T18:15:55.392282] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-26T18:15:55.392339] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-26T18:15:55.392385] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-09-26T18:15:55.392419] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-26T18:15:55.717831] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-26T18:15:55.796275] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:15:55.956777] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-26T18:15:56.756734] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-26T18:15:56.862821] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T18:15:57.556746] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-26T18:15:58.041058] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T18:15:58.356733] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-26T18:15:58.670257] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-26T18:15:59.156734] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-26T18:15:59.392635] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T18:15:59.533239] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-26T18:15:59.956731] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-26T18:16:00.686855] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T18:16:00.756742] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-26T18:16:01.241782] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T18:16:01.556750] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-26T18:16:02.356768] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-26T18:16:03.156718] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-26T18:16:03.508946] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T18:16:03.521035] [INFO ] [REMOTE ] CX: Full fetch complete (76381 records). [2025-09-26T18:16:03.521270] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-26T18:16:03.972537] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-26T18:16:03.972342] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-26T18:16:03.974263] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-26T18:16:03.975312] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-26T18:16:03.980048] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-26T18:16:03.983537] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T18:16:03.987827] [DEBUG] [LOCAL ] CX: Trimmed 76381 records to 53603 (keeping 200 days of data) [2025-09-26T18:16:04.017031] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T18:16:04.361371] [DEBUG] [LOCAL ] CX: Primary data saved (53603 records). [2025-09-26T18:16:04.361571] [INFO ] [MAIN ] CX: Full history saved. [2025-09-26T18:16:04.361712] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CX took 29.3s. Estimated remaining: 3h 56m 54s. Rate: 7.6 symbols/min [2025-09-26T18:16:04.571836] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:04.579311] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T18:16:04.615738] [DEBUG] [LOCAL ] CXT: Loaded 31343 existing records from primary storage. [2025-09-26T18:16:04.615893] [INFO ] [MAIN ] CXT: Loaded 31343 existing records. [2025-09-26T18:16:04.761899] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-26T18:16:04.825065] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:04.825355] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-26T18:16:04.825414] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-26T18:16:04.826427] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-26T18:16:04.826492] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-26T18:16:05.215681] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:05.422677] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-26T18:16:05.556728] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-26T18:16:06.356783] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-26T18:16:07.056942] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T18:16:07.156779] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-26T18:16:07.330069] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:16:07.956719] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-26T18:16:08.602494] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T18:16:08.756727] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-26T18:16:09.558430] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-26T18:16:09.562861] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T18:16:09.851403] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:16:10.191709] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T18:16:10.356771] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-26T18:16:10.839883] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-26T18:16:11.156772] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-26T18:16:11.956738] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-26T18:16:12.079283] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T18:16:12.082031] [INFO ] [REMOTE ] CXE: Full fetch complete (11871 records). [2025-09-26T18:16:12.082161] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-26T18:16:12.652381] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-26T18:16:12.652496] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-26T18:16:12.652905] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-26T18:16:12.653004] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-26T18:16:12.654020] [DEBUG] [LOCAL ] CXE: Trimmed 11871 records to 7247 (keeping 200 days of data) [2025-09-26T18:16:12.717035] [DEBUG] [LOCAL ] CXE: Primary data saved (7247 records). [2025-09-26T18:16:12.717271] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-26T18:16:12.717468] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXE took 28.0s. Estimated remaining: 3h 56m 48s. Rate: 7.6 symbols/min [2025-09-26T18:16:12.761937] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-26T18:16:12.922979] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:12.982396] [DEBUG] [LOCAL ] CXW: Loaded 44634 existing records from primary storage. [2025-09-26T18:16:12.982563] [INFO ] [MAIN ] CXW: Loaded 44634 existing records. [2025-09-26T18:16:13.177804] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:13.178205] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-26T18:16:13.178324] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-26T18:16:13.179437] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-26T18:16:13.179506] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-26T18:16:13.314612] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T18:16:13.561140] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-26T18:16:13.640514] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:16:13.648704] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:14.219088] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-26T18:16:14.220819] [INFO ] [REMOTE ] CXH: Full fetch complete (5478 records). [2025-09-26T18:16:14.220917] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-26T18:16:14.403436] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-26T18:16:14.711793] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-26T18:16:14.711932] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-26T18:16:14.712152] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-26T18:16:14.712213] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-26T18:16:14.712936] [DEBUG] [LOCAL ] CXH: Trimmed 5478 records to 4436 (keeping 200 days of data) [2025-09-26T18:16:14.744082] [DEBUG] [LOCAL ] CXH: Primary data saved (4436 records). [2025-09-26T18:16:14.744248] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-26T18:16:14.744350] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXH took 23.3s. Estimated remaining: 3h 56m 22s. Rate: 7.6 symbols/min [2025-09-26T18:16:14.923375] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:14.952933] [DEBUG] [LOCAL ] CYD: Loaded 26935 existing records from primary storage. [2025-09-26T18:16:14.953109] [INFO ] [MAIN ] CYD: Loaded 26935 existing records. [2025-09-26T18:16:15.139821] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:15.140133] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-26T18:16:15.140183] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-26T18:16:15.141074] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-26T18:16:15.141137] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-26T18:16:15.162613] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-26T18:16:15.539209] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:15.956738] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-26T18:16:16.155865] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T18:16:16.371690] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T18:16:16.582360] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-26T18:16:16.756785] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-26T18:16:17.429314] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T18:16:17.556778] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-26T18:16:18.356764] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-26T18:16:19.039195] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:16:19.156710] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-26T18:16:19.174105] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T18:16:19.956688] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-26T18:16:20.438382] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T18:16:20.756773] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-26T18:16:21.464779] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:16:21.556736] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-26T18:16:22.084548] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T18:16:22.356745] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-26T18:16:22.958529] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:16:23.156794] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-26T18:16:23.775831] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:16:23.956731] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-26T18:16:24.725160] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:16:24.756760] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-26T18:16:24.897801] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T18:16:25.556747] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-26T18:16:26.132517] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:16:26.318211] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T18:16:26.356698] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-26T18:16:27.156738] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-26T18:16:27.720962] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T18:16:27.956766] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-26T18:16:28.367440] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T18:16:28.756782] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-26T18:16:29.255007] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:16:29.556728] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-26T18:16:30.165766] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:16:30.356742] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-26T18:16:31.156714] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-26T18:16:31.283186] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:16:31.337035] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T18:16:31.956713] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-26T18:16:32.524168] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T18:16:32.756741] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-26T18:16:33.556719] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-26T18:16:33.664442] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T18:16:33.969844] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T18:16:34.356714] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-26T18:16:34.447946] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:16:35.156774] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-26T18:16:35.751926] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T18:16:35.763565] [INFO ] [REMOTE ] CXM: Full fetch complete (68943 records). [2025-09-26T18:16:35.763917] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-26T18:16:35.966357] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-26T18:16:36.238837] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-26T18:16:36.238985] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-26T18:16:36.240342] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-26T18:16:36.240586] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-26T18:16:36.262204] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:16:36.269124] [DEBUG] [LOCAL ] CXM: Trimmed 68943 records to 48607 (keeping 200 days of data) [2025-09-26T18:16:36.270957] [INFO ] [REMOTE ] CXT: Full fetch complete (44916 records). [2025-09-26T18:16:36.271540] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-26T18:16:36.272475] [FATAL] [VALIDATOR ] CXT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:16:36.272597] [FATAL] [MAIN ] CXT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:16:36.272674] [WARN ] [MAIN ] CXT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:16:36.272754] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-26T18:16:36.272834] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-09-26T18:16:36.272885] [INFO ] [LOCAL ] CXT: Starting deletion of derivative data. [2025-09-26T18:16:36.328300] [DEBUG] [LOCAL ] CXT: Deleted derivative data file. [2025-09-26T18:16:36.339120] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXT took 32.0s. Estimated remaining: 3h 56m 56s. Rate: 7.6 symbols/min [2025-09-26T18:16:36.699805] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:36.706829] [DEBUG] [LOCAL ] CYH: No existing data file found in primary storage. [2025-09-26T18:16:36.709440] [WARN ] [MAIN ] CYH: No existing data found, performing full refresh instead. [2025-09-26T18:16:36.715771] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-26T18:16:36.720238] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-26T18:16:36.722525] [DEBUG] [LOCAL ] CYH: No primary data file found to delete. [2025-09-26T18:16:36.724542] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-26T18:16:36.761580] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-26T18:16:37.175053] [DEBUG] [LOCAL ] CXM: Primary data saved (48607 records). [2025-09-26T18:16:37.201991] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-26T18:16:37.208184] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:37.208475] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXM took 42.0s. Estimated remaining: 3h 56m 26s. Rate: 7.6 symbols/min [2025-09-26T18:16:37.400996] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:37.401200] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-09-26T18:16:37.401254] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-09-26T18:16:37.401410] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-26T18:16:37.401457] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-26T18:16:37.401501] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-09-26T18:16:37.401535] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-26T18:16:37.561870] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-26T18:16:37.805183] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:37.942071] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T18:16:38.315056] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:16:38.321504] [INFO ] [REMOTE ] CYD: Full fetch complete (32733 records). [2025-09-26T18:16:38.321687] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-26T18:16:38.361814] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-26T18:16:38.774117] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-26T18:16:38.774205] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-26T18:16:38.774756] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-26T18:16:38.774820] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-26T18:16:38.775916] [DEBUG] [LOCAL ] CYD: Trimmed 32733 records to 27145 (keeping 200 days of data) [2025-09-26T18:16:38.949812] [DEBUG] [LOCAL ] CYD: Primary data saved (27145 records). [2025-09-26T18:16:38.950168] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-26T18:16:38.950275] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. CYD took 24.2s. Estimated remaining: 3h 55m 59s. Rate: 7.6 symbols/min [2025-09-26T18:16:39.054422] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:16:39.157966] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-26T18:16:39.186051] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:39.201720] [DEBUG] [LOCAL ] DAC: Loaded 12696 existing records from primary storage. [2025-09-26T18:16:39.201875] [INFO ] [MAIN ] DAC: Loaded 12696 existing records. [2025-09-26T18:16:39.405947] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:39.406202] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-26T18:16:39.406252] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-26T18:16:39.406783] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-26T18:16:39.406847] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-26T18:16:39.799503] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:39.826616] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T18:16:39.956711] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-26T18:16:40.431460] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T18:16:40.646841] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T18:16:40.756725] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-26T18:16:41.556726] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-26T18:16:42.356730] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-26T18:16:42.545001] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T18:16:42.589822] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:16:43.156720] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-26T18:16:43.692305] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T18:16:43.768042] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T18:16:43.956735] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-26T18:16:44.756763] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-26T18:16:44.980903] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T18:16:45.556725] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-26T18:16:46.356947] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-26T18:16:46.714379] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-26T18:16:46.738221] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:16:47.156767] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-26T18:16:47.638477] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:16:47.956761] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-26T18:16:48.756733] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-26T18:16:48.913731] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:16:49.527133] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T18:16:49.556676] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-26T18:16:49.569194] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:16:50.356735] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-26T18:16:51.156767] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-26T18:16:51.281096] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:16:51.595227] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:16:51.956732] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-26T18:16:52.111831] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T18:16:52.756778] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-26T18:16:53.556712] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-26T18:16:53.628499] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T18:16:53.695671] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:16:54.356773] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-26T18:16:55.166705] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-26T18:16:55.192152] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:16:55.202067] [INFO ] [REMOTE ] CXW: Full fetch complete (65037 records). [2025-09-26T18:16:55.202271] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-26T18:16:55.654381] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-26T18:16:55.654503] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-26T18:16:55.655518] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-26T18:16:55.655607] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-26T18:16:55.666760] [DEBUG] [LOCAL ] CXW: Trimmed 65037 records to 44899 (keeping 200 days of data) [2025-09-26T18:16:55.687803] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:16:55.802931] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:16:55.965238] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-26T18:16:55.986854] [DEBUG] [LOCAL ] CXW: Primary data saved (44899 records). [2025-09-26T18:16:55.987005] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-26T18:16:55.987124] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CXW took 43.3s. Estimated remaining: 3h 56m 20s. Rate: 7.6 symbols/min [2025-09-26T18:16:56.173429] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:56.230972] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-09-26T18:16:56.231145] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-09-26T18:16:56.432046] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:56.432347] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-26T18:16:56.432415] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-26T18:16:56.433860] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-26T18:16:56.433929] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-26T18:16:56.761844] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-26T18:16:56.837874] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:57.556733] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-26T18:16:57.693470] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:16:57.726472] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T18:16:57.729234] [INFO ] [REMOTE ] DAC: Full fetch complete (19544 records). [2025-09-26T18:16:57.729336] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-26T18:16:57.729887] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:16:57.729994] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:16:57.730073] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:16:57.730164] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-26T18:16:57.730251] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-26T18:16:57.730293] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-09-26T18:16:57.730595] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-09-26T18:16:57.730767] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. DAC took 18.8s. Estimated remaining: 3h 55m 53s. Rate: 7.6 symbols/min [2025-09-26T18:16:57.916021] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:16:57.966862] [DEBUG] [LOCAL ] DAN: Loaded 49394 existing records from primary storage. [2025-09-26T18:16:57.967103] [INFO ] [MAIN ] DAN: Loaded 49394 existing records. [2025-09-26T18:16:58.156823] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:16:58.157243] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-26T18:16:58.157301] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-26T18:16:58.158635] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-26T18:16:58.158728] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-26T18:16:58.362810] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-26T18:16:58.537785] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:16:59.090916] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T18:16:59.156771] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-26T18:16:59.956738] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-26T18:17:00.135998] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:17:00.757239] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-26T18:17:00.760555] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T18:17:01.346030] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:17:01.556741] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-26T18:17:02.356916] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-26T18:17:02.501121] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:17:02.834562] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T18:17:03.156735] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-26T18:17:03.956739] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-26T18:17:04.020205] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:17:04.756747] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-26T18:17:04.830946] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:17:05.273109] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T18:17:05.556739] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-26T18:17:05.980591] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T18:17:06.356777] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-26T18:17:07.156746] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-26T18:17:07.407995] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:17:07.420046] [INFO ] [REMOTE ] CYH: Full fetch complete (70185 records). [2025-09-26T18:17:07.420255] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-26T18:17:07.869213] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-26T18:17:07.869309] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-26T18:17:07.870142] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-26T18:17:07.870253] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-26T18:17:07.872940] [DEBUG] [LOCAL ] CYH: Trimmed 70185 records to 48352 (keeping 200 days of data) [2025-09-26T18:17:07.966712] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-26T18:17:08.177526] [DEBUG] [LOCAL ] CYH: Primary data saved (48352 records). [2025-09-26T18:17:08.178043] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-26T18:17:08.178256] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. CYH took 31.8s. Estimated remaining: 3h 55m 53s. Rate: 7.6 symbols/min [2025-09-26T18:17:08.362085] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:08.384510] [DEBUG] [LOCAL ] DAO: Loaded 21360 existing records from primary storage. [2025-09-26T18:17:08.384788] [INFO ] [MAIN ] DAO: Loaded 21360 existing records. [2025-09-26T18:17:08.588332] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:08.589942] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-26T18:17:08.590108] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-26T18:17:08.591154] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-26T18:17:08.591243] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-26T18:17:08.894481] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-26T18:17:08.938999] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-26T18:17:09.093111] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T18:17:09.100163] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:09.556695] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-26T18:17:09.728874] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T18:17:10.356770] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-26T18:17:11.062383] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T18:17:11.156723] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-26T18:17:11.251144] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T18:17:11.414959] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-26T18:17:11.956758] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-26T18:17:12.723689] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:17:12.756722] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-26T18:17:13.556721] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-26T18:17:14.279701] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-26T18:17:14.356791] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-26T18:17:14.570082] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T18:17:15.156747] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-26T18:17:15.456950] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T18:17:15.956719] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-26T18:17:16.511256] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-26T18:17:16.756700] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-26T18:17:16.903203] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T18:17:17.423734] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T18:17:17.522848] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:17:17.556698] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-26T18:17:18.356770] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-26T18:17:19.156787] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-26T18:17:19.510083] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T18:17:19.956769] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-26T18:17:20.371684] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T18:17:20.433247] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T18:17:20.756773] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-26T18:17:21.328314] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:17:21.556737] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-26T18:17:22.356756] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-26T18:17:22.851670] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T18:17:22.862871] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-09-26T18:17:22.863071] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-26T18:17:23.167050] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-26T18:17:23.249884] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:17:23.359307] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-26T18:17:23.359421] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-26T18:17:23.360474] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-26T18:17:23.360715] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-26T18:17:23.364938] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 54426 (keeping 200 days of data) [2025-09-26T18:17:23.761487] [DEBUG] [LOCAL ] D: Primary data saved (54426 records). [2025-09-26T18:17:23.761709] [INFO ] [MAIN ] D: Full history saved. [2025-09-26T18:17:23.761859] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. D took 46.6s. Estimated remaining: 3h 56m 8s. Rate: 7.6 symbols/min [2025-09-26T18:17:23.965028] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-26T18:17:24.003322] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:24.047236] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:17:24.058966] [INFO ] [REMOTE ] DAN: Full fetch complete (70847 records). [2025-09-26T18:17:24.059182] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-26T18:17:24.376300] [DEBUG] [LOCAL ] DAR: Loaded 52219 existing records from primary storage. [2025-09-26T18:17:24.410192] [INFO ] [MAIN ] DAR: Loaded 52219 existing records. [2025-09-26T18:17:24.968034] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-26T18:17:24.991682] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-26T18:17:24.994664] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-26T18:17:25.011881] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-26T18:17:25.012045] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:25.013182] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-26T18:17:25.013313] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-26T18:17:25.021859] [DEBUG] [LOCAL ] DAN: Trimmed 70847 records to 49753 (keeping 200 days of data) [2025-09-26T18:17:25.021962] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-26T18:17:25.036087] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-26T18:17:25.148937] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:17:25.232558] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-26T18:17:25.590082] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-26T18:17:25.664049] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-26T18:17:25.690713] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:25.904379] [DEBUG] [LOCAL ] DAN: Primary data saved (49753 records). [2025-09-26T18:17:25.904555] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-26T18:17:25.904700] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAN took 28.2s. Estimated remaining: 3h 55m 42s. Rate: 7.6 symbols/min [2025-09-26T18:17:26.097989] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:26.142091] [DEBUG] [LOCAL ] DAVA: Loaded 40977 existing records from primary storage. [2025-09-26T18:17:26.142246] [INFO ] [MAIN ] DAVA: Loaded 40977 existing records. [2025-09-26T18:17:26.350751] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T18:17:26.361879] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-26T18:17:26.355065] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:26.364023] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-26T18:17:26.364094] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-26T18:17:26.365434] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-26T18:17:26.365520] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-26T18:17:26.752174] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:27.156772] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-26T18:17:27.584968] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:17:27.597752] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-26T18:17:27.597953] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-26T18:17:27.958071] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-26T18:17:28.092877] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-26T18:17:28.093113] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-26T18:17:28.094303] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-26T18:17:28.094434] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-26T18:17:28.135429] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T18:17:28.133556] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54533 (keeping 200 days of data) [2025-09-26T18:17:28.306335] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:17:28.537860] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-09-26T18:17:28.538010] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-26T18:17:28.538110] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAL took 32.6s. Estimated remaining: 3h 55m 18s. Rate: 7.6 symbols/min [2025-09-26T18:17:28.706947] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T18:17:28.739706] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:28.766701] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-26T18:17:28.790316] [DEBUG] [LOCAL ] DAY: Loaded 50193 existing records from primary storage. [2025-09-26T18:17:28.790459] [INFO ] [MAIN ] DAY: Loaded 50193 existing records. [2025-09-26T18:17:28.979899] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:28.980230] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-26T18:17:28.980289] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-26T18:17:28.981409] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-26T18:17:28.981475] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-26T18:17:29.440595] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:29.556692] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-26T18:17:29.580938] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T18:17:30.356750] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-26T18:17:30.872385] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T18:17:31.156738] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-26T18:17:31.339701] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T18:17:31.956728] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-26T18:17:32.449941] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:17:32.756751] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-26T18:17:33.559049] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-26T18:17:33.565468] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T18:17:34.068290] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T18:17:34.356699] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-26T18:17:34.433222] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T18:17:35.156743] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-26T18:17:35.940779] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:17:35.956677] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-26T18:17:36.300155] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T18:17:36.304945] [INFO ] [REMOTE ] DAO: Full fetch complete (32843 records). [2025-09-26T18:17:36.305057] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-26T18:17:36.728061] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-26T18:17:36.728231] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-26T18:17:36.728952] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-26T18:17:36.729032] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-26T18:17:36.730183] [DEBUG] [LOCAL ] DAO: Trimmed 32843 records to 21546 (keeping 200 days of data) [2025-09-26T18:17:36.780328] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-26T18:17:36.860271] [DEBUG] [LOCAL ] DAO: Primary data saved (21546 records). [2025-09-26T18:17:36.860413] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-26T18:17:36.860499] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAO took 28.7s. Estimated remaining: 3h 55m 12s. Rate: 7.6 symbols/min [2025-09-26T18:17:37.059099] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:37.059442] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-09-26T18:17:37.059631] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-09-26T18:17:37.060074] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-26T18:17:37.060154] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-26T18:17:37.060319] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-26T18:17:37.060398] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-26T18:17:37.295126] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T18:17:37.509772] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:37.556724] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-26T18:17:38.317451] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:17:38.356714] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-26T18:17:39.156763] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-26T18:17:39.493092] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T18:17:39.956755] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-26T18:17:40.039812] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:17:40.494067] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T18:17:40.756761] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-26T18:17:41.327881] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:17:41.556750] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-26T18:17:42.356728] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-26T18:17:42.573693] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:17:43.156782] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-26T18:17:43.479589] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T18:17:43.860387] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T18:17:43.956722] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-26T18:17:44.632975] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:17:44.756765] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-26T18:17:44.998527] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:17:45.556736] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-26T18:17:46.356728] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-26T18:17:46.363012] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T18:17:47.116776] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T18:17:47.156733] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-26T18:17:47.647677] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T18:17:47.956774] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-26T18:17:48.756691] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-26T18:17:48.959889] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T18:17:49.556731] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-26T18:17:49.602507] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T18:17:50.154097] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:17:50.356753] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-26T18:17:50.929494] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:17:51.156775] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-26T18:17:51.790888] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:17:51.956766] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-26T18:17:52.756727] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-26T18:17:52.879101] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:17:53.556745] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-26T18:17:54.078727] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:17:54.088800] [INFO ] [REMOTE ] DAVA: Full fetch complete (55610 records). [2025-09-26T18:17:54.088960] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-26T18:17:54.357439] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-26T18:17:54.552596] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-26T18:17:54.552758] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-26T18:17:54.553808] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-26T18:17:54.554125] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-26T18:17:54.587749] [DEBUG] [LOCAL ] DAVA: Trimmed 55610 records to 41308 (keeping 200 days of data) [2025-09-26T18:17:54.589315] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T18:17:54.853760] [DEBUG] [LOCAL ] DAVA: Primary data saved (41308 records). [2025-09-26T18:17:54.853940] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-26T18:17:54.854053] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAVA took 28.9s. Estimated remaining: 3h 55m 34s. Rate: 7.6 symbols/min [2025-09-26T18:17:55.034076] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:55.034309] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-26T18:17:55.034366] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-26T18:17:55.034528] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-26T18:17:55.034573] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-26T18:17:55.034617] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-26T18:17:55.034689] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-26T18:17:55.157911] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-26T18:17:55.426735] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:17:55.462414] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T18:17:55.694768] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:17:55.956749] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-26T18:17:56.571941] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:17:56.622529] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:17:56.756735] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-26T18:17:57.556722] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-26T18:17:58.356752] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-26T18:17:58.446275] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T18:17:58.647698] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T18:17:58.658572] [INFO ] [REMOTE ] DAR: Full fetch complete (74542 records). [2025-09-26T18:17:58.658783] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-26T18:17:59.086613] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-26T18:17:59.086736] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-26T18:17:59.087577] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-26T18:17:59.087666] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-26T18:17:59.089285] [DEBUG] [LOCAL ] DAR: Trimmed 74542 records to 52603 (keeping 200 days of data) [2025-09-26T18:17:59.175663] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-26T18:17:59.428672] [DEBUG] [LOCAL ] DAR: Primary data saved (52603 records). [2025-09-26T18:17:59.428919] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-26T18:17:59.429046] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAR took 35.7s. Estimated remaining: 3h 55m 16s. Rate: 7.6 symbols/min [2025-09-26T18:17:59.621482] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:17:59.671590] [DEBUG] [LOCAL ] DBI: Loaded 45297 existing records from primary storage. [2025-09-26T18:17:59.671861] [INFO ] [MAIN ] DBI: Loaded 45297 existing records. [2025-09-26T18:17:59.862723] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:17:59.863057] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-26T18:17:59.863109] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-26T18:17:59.864313] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-26T18:17:59.864379] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-26T18:17:59.961031] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-26T18:18:00.110834] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T18:18:00.301051] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:00.336301] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T18:18:00.756800] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-26T18:18:01.556750] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-26T18:18:01.903044] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T18:18:02.146340] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-26T18:18:02.356778] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-26T18:18:03.153931] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:18:03.159384] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-26T18:18:03.431155] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T18:18:03.443166] [INFO ] [REMOTE ] DAY: Full fetch complete (71674 records). [2025-09-26T18:18:03.443449] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-26T18:18:03.887314] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-26T18:18:03.887470] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-26T18:18:03.888974] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-26T18:18:03.889061] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-26T18:18:03.891436] [DEBUG] [LOCAL ] DAY: Trimmed 71674 records to 50491 (keeping 200 days of data) [2025-09-26T18:18:03.983940] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-26T18:18:04.225608] [DEBUG] [LOCAL ] DAY: Primary data saved (50491 records). [2025-09-26T18:18:04.225908] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-26T18:18:04.226086] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DAY took 35.7s. Estimated remaining: 3h 54m 59s. Rate: 7.6 symbols/min [2025-09-26T18:18:04.411496] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:04.423544] [DEBUG] [LOCAL ] DBL: Loaded 9203 existing records from primary storage. [2025-09-26T18:18:04.423699] [INFO ] [MAIN ] DBL: Loaded 9203 existing records. [2025-09-26T18:18:04.616349] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:04.617262] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-26T18:18:04.617334] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-26T18:18:04.617936] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-26T18:18:04.618008] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-26T18:18:04.761697] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-26T18:18:05.023351] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:05.041966] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T18:18:05.556694] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-26T18:18:05.736726] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T18:18:05.955471] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T18:18:06.266956] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T18:18:06.356809] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-26T18:18:07.070414] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T18:18:07.156722] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-26T18:18:07.956773] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-26T18:18:07.971909] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T18:18:08.756783] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-26T18:18:09.556717] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-26T18:18:09.627105] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T18:18:09.865226] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:18:09.979075] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-26T18:18:10.356743] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-26T18:18:11.156722] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-26T18:18:11.276153] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T18:18:11.956749] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-26T18:18:12.549449] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T18:18:12.756736] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-26T18:18:12.806841] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-26T18:18:13.552004] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:18:13.556784] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-26T18:18:14.356753] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-26T18:18:14.713809] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T18:18:14.718940] [INFO ] [REMOTE ] DBD: Full fetch complete (30620 records). [2025-09-26T18:18:14.719047] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-26T18:18:14.719561] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:18:14.719696] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:18:14.719785] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:18:14.720039] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-26T18:18:14.720334] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-26T18:18:14.720400] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-26T18:18:14.720474] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-26T18:18:14.720602] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DBD took 19.9s. Estimated remaining: 3h 54m 59s. Rate: 7.6 symbols/min [2025-09-26T18:18:14.903472] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:14.956043] [DEBUG] [LOCAL ] DBRG: Loaded 50157 existing records from primary storage. [2025-09-26T18:18:14.956290] [INFO ] [MAIN ] DBRG: Loaded 50157 existing records. [2025-09-26T18:18:15.142816] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:15.143182] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-26T18:18:15.143232] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-26T18:18:15.144485] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-26T18:18:15.144551] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-26T18:18:15.165875] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-26T18:18:15.561751] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:15.956813] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-26T18:18:16.349101] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T18:18:16.756800] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-26T18:18:17.030382] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T18:18:17.315163] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T18:18:17.556795] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-26T18:18:18.147303] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:18:18.356804] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-26T18:18:18.943165] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T18:18:19.156758] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-26T18:18:19.339723] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T18:18:19.350125] [INFO ] [REMOTE ] DB: Full fetch complete (74332 records). [2025-09-26T18:18:19.350277] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-26T18:18:19.785873] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-26T18:18:19.786076] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-26T18:18:19.786960] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-26T18:18:19.787038] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-26T18:18:19.788732] [DEBUG] [LOCAL ] DB: Trimmed 74332 records to 53377 (keeping 200 days of data) [2025-09-26T18:18:19.965346] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-26T18:18:20.131171] [DEBUG] [LOCAL ] DB: Primary data saved (53377 records). [2025-09-26T18:18:20.131335] [INFO ] [MAIN ] DB: Full history saved. [2025-09-26T18:18:20.131528] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DB took 43.3s. Estimated remaining: 3h 54m 43s. Rate: 7.6 symbols/min [2025-09-26T18:18:20.318507] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:20.359774] [DEBUG] [LOCAL ] DCI: Loaded 37809 existing records from primary storage. [2025-09-26T18:18:20.359952] [INFO ] [MAIN ] DCI: Loaded 37809 existing records. [2025-09-26T18:18:20.553354] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:20.553757] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-26T18:18:20.553910] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-26T18:18:20.564373] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-26T18:18:20.582395] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-26T18:18:20.633361] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:18:20.762143] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-26T18:18:20.991038] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:21.311467] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:18:21.556723] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-26T18:18:22.235464] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:18:22.356746] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-26T18:18:22.872042] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T18:18:23.156743] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-26T18:18:23.516177] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T18:18:23.956743] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-26T18:18:24.664098] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T18:18:24.756746] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-26T18:18:25.556707] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-26T18:18:25.648343] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T18:18:26.356727] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-26T18:18:26.744670] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-26T18:18:26.808102] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T18:18:27.156742] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-26T18:18:27.926869] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:18:27.956682] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-26T18:18:28.247217] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T18:18:28.756752] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-26T18:18:29.556725] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-26T18:18:29.760009] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:18:30.151074] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T18:18:30.356778] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-26T18:18:30.457097] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T18:18:31.156725] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-26T18:18:31.956718] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-26T18:18:32.057733] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-26T18:18:32.095008] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T18:18:32.756743] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-26T18:18:33.547350] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T18:18:33.556677] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-26T18:18:33.861471] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T18:18:33.870636] [INFO ] [REMOTE ] DBI: Full fetch complete (66174 records). [2025-09-26T18:18:33.870833] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-26T18:18:34.298541] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-26T18:18:34.298725] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-26T18:18:34.305938] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-26T18:18:34.306360] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-26T18:18:34.306193] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T18:18:34.309430] [INFO ] [REMOTE ] DBL: Full fetch complete (12506 records). [2025-09-26T18:18:34.309780] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-26T18:18:34.357620] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-26T18:18:34.363509] [DEBUG] [LOCAL ] DBI: Trimmed 66174 records to 45524 (keeping 200 days of data) [2025-09-26T18:18:34.831785] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-26T18:18:34.832348] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-26T18:18:34.834051] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-26T18:18:34.835904] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-26T18:18:34.842993] [DEBUG] [LOCAL ] DBL: Trimmed 12506 records to 9259 (keeping 200 days of data) [2025-09-26T18:18:34.999321] [DEBUG] [LOCAL ] DBL: Primary data saved (9259 records). [2025-09-26T18:18:35.000324] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-26T18:18:35.001084] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBL took 30.8s. Estimated remaining: 3h 54m 56s. Rate: 7.6 symbols/min [2025-09-26T18:18:35.157333] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-26T18:18:35.213239] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:35.232758] [DEBUG] [LOCAL ] DCO: Loaded 13929 existing records from primary storage. [2025-09-26T18:18:35.234237] [INFO ] [MAIN ] DCO: Loaded 13929 existing records. [2025-09-26T18:18:35.451439] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:35.453561] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-26T18:18:35.453675] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-26T18:18:35.469518] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-26T18:18:35.473006] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-26T18:18:35.737589] [DEBUG] [LOCAL ] DBI: Primary data saved (45524 records). [2025-09-26T18:18:35.785982] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-26T18:18:35.804788] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DBI took 36.4s. Estimated remaining: 3h 54m 27s. Rate: 7.6 symbols/min [2025-09-26T18:18:36.011588] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:36.021518] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-26T18:18:36.110680] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:36.144893] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T18:18:36.206351] [DEBUG] [LOCAL ] DD: Loaded 53213 existing records from primary storage. [2025-09-26T18:18:36.206526] [INFO ] [MAIN ] DD: Loaded 53213 existing records. [2025-09-26T18:18:36.404025] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:18:36.404514] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-26T18:18:36.404576] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-26T18:18:36.406034] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-26T18:18:36.406111] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-26T18:18:36.780935] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-26T18:18:36.795114] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:36.836977] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:18:36.864850] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T18:18:37.556791] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-26T18:18:38.276459] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T18:18:38.356754] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-26T18:18:39.156730] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-26T18:18:39.453776] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T18:18:39.468493] [INFO ] [REMOTE ] DBRG: Full fetch complete (72246 records). [2025-09-26T18:18:39.468811] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-26T18:18:39.622270] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:18:39.978080] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-26T18:18:40.002853] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-26T18:18:40.002945] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-26T18:18:40.003777] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-26T18:18:40.003845] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-26T18:18:40.005502] [DEBUG] [LOCAL ] DBRG: Trimmed 72246 records to 50526 (keeping 200 days of data) [2025-09-26T18:18:40.320825] [DEBUG] [LOCAL ] DBRG: Primary data saved (50526 records). [2025-09-26T18:18:40.320977] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-26T18:18:40.321068] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBRG took 25.6s. Estimated remaining: 3h 54m 9s. Rate: 7.6 symbols/min [2025-09-26T18:18:40.513024] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:18:40.513244] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-09-26T18:18:40.513300] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-09-26T18:18:40.513450] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-26T18:18:40.513494] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-26T18:18:40.513546] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-09-26T18:18:40.513581] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-26T18:18:40.706170] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T18:18:40.763445] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-26T18:18:40.951383] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:18:41.075444] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T18:18:41.556728] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-26T18:18:41.589794] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T18:18:42.356762] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-26T18:18:43.156700] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-26T18:18:43.191635] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T18:18:43.423083] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T18:18:43.956774] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-26T18:18:44.265459] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:18:44.478939] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-26T18:18:44.756738] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-26T18:18:45.556722] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-26T18:18:46.359683] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-26T18:18:46.363299] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T18:18:47.156695] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-26T18:18:47.332212] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:18:47.408962] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:18:47.956730] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-26T18:18:48.756721] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-26T18:18:48.852120] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T18:18:49.556730] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-26T18:18:49.695421] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T18:18:50.068689] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T18:18:50.249773] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:18:50.356769] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-26T18:18:51.156739] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-26T18:18:51.956804] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-26T18:18:52.120631] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T18:18:52.399444] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:18:52.756761] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-26T18:18:53.044746] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:18:53.556730] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-26T18:18:54.361934] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-26T18:18:54.383507] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:18:55.032965] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:18:55.156740] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-26T18:18:55.647621] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:18:55.656206] [INFO ] [REMOTE ] DCI: Full fetch complete (54165 records). [2025-09-26T18:18:55.656445] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-26T18:18:55.963088] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-26T18:18:56.123586] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T18:18:56.149896] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-26T18:18:56.150033] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-26T18:18:56.151043] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-26T18:18:56.151138] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-26T18:18:56.152539] [DEBUG] [LOCAL ] DCI: Trimmed 54165 records to 38065 (keeping 200 days of data) [2025-09-26T18:18:56.416921] [DEBUG] [LOCAL ] DCI: Primary data saved (38065 records). [2025-09-26T18:18:56.417175] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-26T18:18:56.417354] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DCI took 36.3s. Estimated remaining: 3h 54m 25s. Rate: 7.6 symbols/min [2025-09-26T18:18:56.756785] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-26T18:18:57.530710] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:18:57.556755] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-26T18:18:58.356839] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-26T18:18:58.523275] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T18:18:59.156866] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-26T18:18:59.377380] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T18:18:59.413072] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T18:18:59.417027] [INFO ] [REMOTE ] DCO: Full fetch complete (19308 records). [2025-09-26T18:18:59.417182] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-26T18:18:59.814932] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-26T18:18:59.815032] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-26T18:18:59.815623] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-26T18:18:59.815739] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-26T18:18:59.816537] [DEBUG] [LOCAL ] DCO: Trimmed 19308 records to 14003 (keeping 200 days of data) [2025-09-26T18:18:59.918585] [DEBUG] [LOCAL ] DCO: Primary data saved (14003 records). [2025-09-26T18:18:59.918811] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-26T18:18:59.918944] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DCO took 24.9s. Estimated remaining: 3h 54m 4s. Rate: 7.6 symbols/min [2025-09-26T18:18:59.956833] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-26T18:19:00.858539] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T18:19:00.870550] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-26T18:19:01.650522] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T18:19:01.663263] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-26T18:19:02.281921] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T18:19:02.356804] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-26T18:19:03.244598] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:19:03.256888] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-26T18:19:03.765610] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:19:03.956742] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-26T18:19:05.248920] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T18:19:05.260676] [INFO ] [REMOTE ] DD: Full fetch complete (76293 records). [2025-09-26T18:19:05.260946] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-26T18:19:05.696748] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-26T18:19:05.696990] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-26T18:19:05.698248] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-26T18:19:05.698344] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-26T18:19:05.733969] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:19:05.732677] [DEBUG] [LOCAL ] DD: Trimmed 76293 records to 53595 (keeping 200 days of data) [2025-09-26T18:19:05.746630] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-26T18:19:06.104494] [DEBUG] [LOCAL ] DD: Primary data saved (53595 records). [2025-09-26T18:19:06.104689] [INFO ] [MAIN ] DD: Full history saved. [2025-09-26T18:19:06.106448] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 30.3s. Estimated remaining: 3h 53m 51s. Rate: 7.6 symbols/min [2025-09-26T18:19:07.655420] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T18:19:07.666262] [INFO ] [REMOTE ] DDD: Full fetch complete (73697 records). [2025-09-26T18:19:07.666460] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-26T18:19:08.102284] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-26T18:19:08.102440] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-26T18:19:08.103407] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-26T18:19:08.103476] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-26T18:19:08.105140] [DEBUG] [LOCAL ] DDD: Trimmed 73697 records to 51647 (keeping 200 days of data) [2025-09-26T18:19:08.409238] [DEBUG] [LOCAL ] DDD: Primary data saved (51647 records). [2025-09-26T18:19:08.409409] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-26T18:19:08.409497] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 28.1s. Estimated remaining: 3h 53m 27s. Rate: 7.6 symbols/min [2025-09-26T18:19:09.131016] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:09.153831] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:09.231094] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-09-26T18:19:09.235107] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:09.260151] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:09.260331] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-09-26T18:19:09.265937] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-26T18:19:09.266134] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-26T18:19:09.267105] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-09-26T18:19:09.267334] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-26T18:19:09.358280] [DEBUG] [LOCAL ] DDT: Loaded 2107 existing records from primary storage. [2025-09-26T18:19:09.370330] [INFO ] [MAIN ] DDT: Loaded 2107 existing records. [2025-09-26T18:19:09.841740] [DEBUG] [LOCAL ] DE: Loaded 48062 existing records from primary storage. [2025-09-26T18:19:09.847199] [INFO ] [MAIN ] DE: Loaded 48062 existing records. [2025-09-26T18:19:09.821844] [DEBUG] [LOCAL ] DDL: Loaded 36655 existing records from primary storage. [2025-09-26T18:19:09.899558] [INFO ] [MAIN ] DDL: Loaded 36655 existing records. [2025-09-26T18:19:10.116353] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:10.219911] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-26T18:19:10.252493] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-26T18:19:10.252388] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:10.281021] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-26T18:19:10.309757] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-26T18:19:10.323218] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-26T18:19:10.608978] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:10.635496] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:10.672758] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-26T18:19:10.678199] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-26T18:19:10.687414] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-26T18:19:10.701823] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-26T18:19:10.718989] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-26T18:19:10.719181] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-26T18:19:10.718911] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-26T18:19:10.729711] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-26T18:19:11.654349] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:11.711248] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-26T18:19:11.939947] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T18:19:12.002418] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-26T18:19:12.064108] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:12.095147] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:12.095566] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-26T18:19:12.096582] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-26T18:19:12.504112] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T18:19:12.505692] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-26T18:19:12.833287] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T18:19:12.836699] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-26T18:19:12.996339] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-26T18:19:12.997893] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-26T18:19:13.319227] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T18:19:13.320841] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-26T18:19:13.619034] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:19:13.629432] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-26T18:19:13.698135] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T18:19:13.709199] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-26T18:19:13.719745] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T18:19:13.773674] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T18:19:14.356765] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-26T18:19:14.976717] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:19:15.156762] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-26T18:19:15.426767] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T18:19:15.469053] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:19:15.956756] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-26T18:19:16.159104] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:19:16.316571] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-26T18:19:16.756771] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-26T18:19:17.556721] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-26T18:19:17.891482] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:19:18.356731] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-26T18:19:19.118335] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T18:19:19.156687] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-26T18:19:19.425015] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T18:19:19.956741] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-26T18:19:20.669906] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T18:19:20.756711] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-26T18:19:20.875000] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T18:19:21.556838] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-26T18:19:22.013703] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T18:19:22.359158] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-26T18:19:22.362678] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T18:19:22.936616] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T18:19:23.156730] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-26T18:19:23.956751] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-26T18:19:24.485937] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:19:24.756733] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-26T18:19:25.556732] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-26T18:19:25.894350] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:19:25.929636] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-26T18:19:25.948366] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T18:19:26.356740] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-26T18:19:27.156733] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-26T18:19:27.663992] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T18:19:27.702297] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T18:19:27.956719] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-26T18:19:28.756724] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-26T18:19:29.556747] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-26T18:19:29.666663] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:19:29.676016] [INFO ] [REMOTE ] DDL: Full fetch complete (53388 records). [2025-09-26T18:19:29.676500] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-26T18:19:29.721836] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T18:19:30.096547] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-26T18:19:30.096692] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-26T18:19:30.097456] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-26T18:19:30.097523] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-26T18:19:30.101338] [DEBUG] [LOCAL ] DDL: Trimmed 53388 records to 37016 (keeping 200 days of data) [2025-09-26T18:19:30.311204] [DEBUG] [LOCAL ] DDL: Primary data saved (37016 records). [2025-09-26T18:19:30.311360] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-26T18:19:30.311483] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDL took 21.9s. Estimated remaining: 3h 53m 60s. Rate: 7.6 symbols/min [2025-09-26T18:19:30.361804] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-26T18:19:30.497988] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:30.546634] [DEBUG] [LOCAL ] DEA: Loaded 41610 existing records from primary storage. [2025-09-26T18:19:30.546812] [INFO ] [MAIN ] DEA: Loaded 41610 existing records. [2025-09-26T18:19:30.742890] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:30.743229] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-26T18:19:30.743297] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-26T18:19:30.744523] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-26T18:19:30.744588] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-26T18:19:31.140141] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T18:19:31.139977] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:31.141632] [INFO ] [REMOTE ] DDT: Full fetch complete (2901 records). [2025-09-26T18:19:31.141735] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-26T18:19:31.163515] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-26T18:19:31.522823] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-26T18:19:31.522903] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-26T18:19:31.523015] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-26T18:19:31.523080] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-26T18:19:31.523451] [DEBUG] [LOCAL ] DDT: Trimmed 2901 records to 2117 (keeping 200 days of data) [2025-09-26T18:19:31.538047] [DEBUG] [LOCAL ] DDT: Primary data saved (2117 records). [2025-09-26T18:19:31.538119] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-26T18:19:31.538225] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDT took 23.1s. Estimated remaining: 3h 53m 32s. Rate: 7.6 symbols/min [2025-09-26T18:19:31.720137] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:31.772810] [DEBUG] [LOCAL ] DEC: Loaded 30878 existing records from primary storage. [2025-09-26T18:19:31.773063] [INFO ] [MAIN ] DEC: Loaded 30878 existing records. [2025-09-26T18:19:31.987609] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-26T18:19:31.997031] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:31.998498] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-26T18:19:31.998577] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-26T18:19:32.000007] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-26T18:19:32.002281] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-26T18:19:32.002080] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-26T18:19:32.328907] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-26T18:19:32.407464] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:32.756726] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-26T18:19:33.312626] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:19:33.464410] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T18:19:33.467364] [INFO ] [REMOTE ] DDS: Full fetch complete (19231 records). [2025-09-26T18:19:33.467477] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-26T18:19:33.561932] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-26T18:19:33.888563] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-26T18:19:33.888677] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-26T18:19:33.889082] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-26T18:19:33.889125] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-26T18:19:33.889882] [DEBUG] [LOCAL ] DDS: Trimmed 19231 records to 13374 (keeping 200 days of data) [2025-09-26T18:19:33.987215] [DEBUG] [LOCAL ] DDS: Primary data saved (13374 records). [2025-09-26T18:19:33.987411] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-26T18:19:33.987529] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DDS took 25.6s. Estimated remaining: 3h 53m 8s. Rate: 7.6 symbols/min [2025-09-26T18:19:34.173862] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:34.243795] [DEBUG] [LOCAL ] DECK: Loaded 53690 existing records from primary storage. [2025-09-26T18:19:34.243946] [INFO ] [MAIN ] DECK: Loaded 53690 existing records. [2025-09-26T18:19:34.361901] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-26T18:19:34.440523] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:19:34.440832] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-26T18:19:34.440887] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-26T18:19:34.442296] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-26T18:19:34.442360] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-26T18:19:34.893755] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:35.056667] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:19:35.156784] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-26T18:19:35.350788] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T18:19:35.956740] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-26T18:19:36.739786] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:19:36.760452] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-26T18:19:36.768154] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T18:19:37.556724] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-26T18:19:38.248152] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T18:19:38.356728] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-26T18:19:38.933273] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T18:19:39.156738] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-26T18:19:39.956744] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-26T18:19:39.998779] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T18:19:40.756793] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-26T18:19:40.792048] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T18:19:41.556715] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-26T18:19:41.777364] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T18:19:42.140349] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T18:19:42.356776] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-26T18:19:42.515628] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T18:19:43.156747] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-26T18:19:43.956718] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-26T18:19:44.021066] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T18:19:44.756741] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-26T18:19:45.206684] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T18:19:45.261567] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T18:19:45.556747] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-26T18:19:45.791608] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T18:19:46.356777] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-26T18:19:47.156755] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-26T18:19:47.587729] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-26T18:19:47.785033] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:19:47.956775] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-26T18:19:48.530732] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:19:48.756738] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-26T18:19:48.810894] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T18:19:49.556722] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-26T18:19:50.253983] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:19:50.356775] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-26T18:19:51.156718] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-26T18:19:51.413447] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T18:19:51.956692] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-26T18:19:51.997859] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T18:19:52.032563] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T18:19:52.756750] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-26T18:19:53.556725] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-26T18:19:53.990547] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T18:19:54.034367] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T18:19:54.040689] [INFO ] [REMOTE ] DEC: Full fetch complete (42936 records). [2025-09-26T18:19:54.041001] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-26T18:19:54.361830] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-26T18:19:54.486704] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-26T18:19:54.486805] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-26T18:19:54.487405] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-26T18:19:54.487472] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-26T18:19:54.488684] [DEBUG] [LOCAL ] DEC: Trimmed 42936 records to 31121 (keeping 200 days of data) [2025-09-26T18:19:54.681183] [DEBUG] [LOCAL ] DEC: Primary data saved (31121 records). [2025-09-26T18:19:54.681348] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-26T18:19:54.681756] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DEC took 23.1s. Estimated remaining: 3h 53m 38s. Rate: 7.6 symbols/min [2025-09-26T18:19:54.895389] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:54.891111] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:19:54.895611] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-09-26T18:19:54.903858] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-09-26T18:19:54.904088] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-26T18:19:54.904562] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-26T18:19:54.904632] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-26T18:19:54.904713] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-26T18:19:55.161822] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-26T18:19:55.313927] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:55.956778] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-26T18:19:56.099993] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T18:19:56.351023] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T18:19:56.359406] [INFO ] [REMOTE ] DEA: Full fetch complete (62786 records). [2025-09-26T18:19:56.359560] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-26T18:19:56.760025] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-26T18:19:56.777549] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-26T18:19:56.777673] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-26T18:19:56.778460] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-26T18:19:56.778675] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-26T18:19:56.780323] [DEBUG] [LOCAL ] DEA: Trimmed 62786 records to 41860 (keeping 200 days of data) [2025-09-26T18:19:57.051067] [DEBUG] [LOCAL ] DEA: Primary data saved (41860 records). [2025-09-26T18:19:57.051229] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-26T18:19:57.051328] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEA took 26.7s. Estimated remaining: 3h 53m 14s. Rate: 7.6 symbols/min [2025-09-26T18:19:57.241357] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:19:57.241589] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-09-26T18:19:57.241639] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-09-26T18:19:57.241834] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-26T18:19:57.241887] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-26T18:19:57.241933] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-26T18:19:57.241966] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-26T18:19:57.562955] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-26T18:19:57.630862] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:19:57.665589] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T18:19:58.155500] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:19:58.356781] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-26T18:19:59.156779] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-26T18:19:59.523234] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T18:19:59.956742] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-26T18:20:00.632278] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:20:00.707685] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-26T18:20:00.756755] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-26T18:20:01.525562] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T18:20:01.535945] [INFO ] [REMOTE ] DE: Full fetch complete (69580 records). [2025-09-26T18:20:01.536114] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-26T18:20:01.565761] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-26T18:20:02.059151] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-26T18:20:02.059281] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-26T18:20:02.060084] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-26T18:20:02.060151] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-26T18:20:02.063567] [DEBUG] [LOCAL ] DE: Trimmed 69580 records to 48397 (keeping 200 days of data) [2025-09-26T18:20:02.359291] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-26T18:20:02.416210] [DEBUG] [LOCAL ] DE: Primary data saved (48397 records). [2025-09-26T18:20:02.416375] [INFO ] [MAIN ] DE: Full history saved. [2025-09-26T18:20:02.416472] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DE took 54.0s. Estimated remaining: 3h 52m 58s. Rate: 7.6 symbols/min [2025-09-26T18:20:02.610049] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:02.661337] [DEBUG] [LOCAL ] DEO: Loaded 49405 existing records from primary storage. [2025-09-26T18:20:02.661567] [INFO ] [MAIN ] DEO: Loaded 49405 existing records. [2025-09-26T18:20:02.879837] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:02.880452] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-26T18:20:02.880573] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-26T18:20:02.890715] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-26T18:20:02.909110] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-26T18:20:02.916398] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T18:20:03.167811] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-26T18:20:03.396079] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:03.426315] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-26T18:20:03.956809] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-26T18:20:04.010406] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T18:20:04.712318] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T18:20:04.756792] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-26T18:20:05.556742] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-26T18:20:06.065958] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-26T18:20:06.356764] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-26T18:20:06.990913] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-26T18:20:07.156704] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-26T18:20:07.412060] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T18:20:07.902755] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T18:20:07.956730] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-26T18:20:08.756773] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-26T18:20:09.140400] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T18:20:09.301448] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T18:20:09.556744] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-26T18:20:10.356758] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-26T18:20:11.056176] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-26T18:20:11.156726] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-26T18:20:11.491985] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T18:20:11.949409] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T18:20:11.962999] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-26T18:20:12.756743] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-26T18:20:13.197210] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T18:20:13.420768] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:20:13.556725] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-26T18:20:13.915927] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:20:14.356766] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-26T18:20:15.156736] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-26T18:20:15.915421] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-26T18:20:15.956748] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-26T18:20:16.616496] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-26T18:20:16.756801] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-26T18:20:17.086357] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T18:20:17.556776] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-26T18:20:17.871393] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T18:20:18.356728] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-26T18:20:18.744189] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T18:20:19.156776] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-26T18:20:19.956772] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-26T18:20:20.136624] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-26T18:20:20.355634] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T18:20:20.364858] [INFO ] [REMOTE ] DEI: Full fetch complete (69289 records). [2025-09-26T18:20:20.365027] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-26T18:20:20.366100] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:20:20.366200] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:20:20.366248] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:20:20.366300] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-26T18:20:20.366364] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-26T18:20:20.366408] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-09-26T18:20:20.366477] [DEBUG] [LOCAL ] DEI: No derivative data file found to delete. [2025-09-26T18:20:20.366566] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DEI took 25.7s. Estimated remaining: 3h 53m 20s. Rate: 7.6 symbols/min [2025-09-26T18:20:20.572985] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:20.610411] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (3.85 seconds). [2025-09-26T18:20:20.645930] [DEBUG] [LOCAL ] DFH: Loaded 32932 existing records from primary storage. [2025-09-26T18:20:20.646108] [INFO ] [MAIN ] DFH: Loaded 32932 existing records. [2025-09-26T18:20:20.761854] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-26T18:20:20.859493] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:20.859773] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-26T18:20:20.859829] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-26T18:20:20.860576] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-26T18:20:20.860637] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-26T18:20:21.264088] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:21.556752] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-26T18:20:21.641794] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T18:20:22.356807] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-26T18:20:22.868321] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T18:20:22.988741] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-26T18:20:23.156763] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-26T18:20:23.956726] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-26T18:20:24.001373] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T18:20:24.756813] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-26T18:20:25.459066] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-26T18:20:25.470324] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-09-26T18:20:25.470588] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-26T18:20:25.560737] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-26T18:20:25.862970] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T18:20:25.928543] [INFO ] [REMOTE ] DECK: Full fetch complete (76626 records). [2025-09-26T18:20:25.944627] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-26T18:20:25.990344] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-26T18:20:25.990600] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-26T18:20:26.014872] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-26T18:20:26.046255] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-26T18:20:26.116999] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54515 (keeping 200 days of data) [2025-09-26T18:20:26.266114] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T18:20:26.402600] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-26T18:20:26.607216] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-26T18:20:26.607633] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-26T18:20:26.609659] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-26T18:20:26.610028] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-26T18:20:26.619787] [DEBUG] [LOCAL ] DECK: Trimmed 76626 records to 54078 (keeping 200 days of data) [2025-09-26T18:20:27.193177] [DEBUG] [LOCAL ] DECK: Primary data saved (54078 records). [2025-09-26T18:20:27.193991] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-26T18:20:27.194200] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DECK took 53.2s. Estimated remaining: 3h 53m 8s. Rate: 7.6 symbols/min [2025-09-26T18:20:27.395023] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:27.412529] [DEBUG] [LOCAL ] DELL: Primary data saved (54515 records). [2025-09-26T18:20:27.412875] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-26T18:20:27.413154] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DELL took 30.4s. Estimated remaining: 3h 52m 38s. Rate: 7.6 symbols/min [2025-09-26T18:20:27.468600] [DEBUG] [LOCAL ] DFIN: Loaded 23491 existing records from primary storage. [2025-09-26T18:20:27.468948] [INFO ] [MAIN ] DFIN: Loaded 23491 existing records. [2025-09-26T18:20:27.838721] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:27.880273] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:27.926936] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-26T18:20:27.927468] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-26T18:20:27.931248] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-26T18:20:27.931694] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-26T18:20:27.931924] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-26T18:20:27.992829] [DEBUG] [LOCAL ] DFP: Loaded 11734 existing records from primary storage. [2025-09-26T18:20:28.019544] [INFO ] [MAIN ] DFP: Loaded 11734 existing records. [2025-09-26T18:20:28.019361] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-26T18:20:28.392687] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-26T18:20:28.452822] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-26T18:20:28.553297] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:28.579905] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-26T18:20:28.611920] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-26T18:20:28.617067] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-26T18:20:28.639484] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:28.639707] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-26T18:20:28.761905] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-26T18:20:29.037400] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:29.556727] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-26T18:20:29.930342] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:20:30.037102] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T18:20:30.047900] [INFO ] [REMOTE ] DEO: Full fetch complete (71519 records). [2025-09-26T18:20:30.048091] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-26T18:20:30.223947] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:20:30.251909] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:20:30.361847] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-26T18:20:30.543416] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-26T18:20:30.543586] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-26T18:20:30.544493] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-26T18:20:30.544561] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-26T18:20:30.546116] [DEBUG] [LOCAL ] DEO: Trimmed 71519 records to 49777 (keeping 200 days of data) [2025-09-26T18:20:30.861298] [DEBUG] [LOCAL ] DEO: Primary data saved (49777 records). [2025-09-26T18:20:30.861469] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-26T18:20:30.861612] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 28.4s. Estimated remaining: 3h 52m 17s. Rate: 7.6 symbols/min [2025-09-26T18:20:31.044989] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:31.103589] [DEBUG] [LOCAL ] DG: Loaded 53678 existing records from primary storage. [2025-09-26T18:20:31.103848] [INFO ] [MAIN ] DG: Loaded 53678 existing records. [2025-09-26T18:20:31.157098] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-26T18:20:31.244128] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T18:20:31.316535] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:31.316919] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-26T18:20:31.316979] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-26T18:20:31.318921] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-26T18:20:31.318984] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-26T18:20:31.686171] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:31.956794] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-26T18:20:32.703381] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T18:20:32.750631] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T18:20:32.756675] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-26T18:20:33.556730] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-26T18:20:33.841090] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:20:34.021163] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T18:20:34.356773] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-26T18:20:35.156809] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-26T18:20:35.918931] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T18:20:35.956729] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-26T18:20:36.166174] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T18:20:36.545992] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T18:20:36.756773] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-26T18:20:37.556742] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-26T18:20:37.906800] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-26T18:20:38.356739] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-26T18:20:39.163779] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-26T18:20:39.187281] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T18:20:39.256555] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T18:20:39.956727] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-26T18:20:40.078285] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T18:20:40.756763] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-26T18:20:41.556706] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-26T18:20:41.654003] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T18:20:42.150603] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:20:42.356761] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-26T18:20:42.435299] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T18:20:43.156691] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-26T18:20:43.168714] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T18:20:43.956767] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-26T18:20:44.600621] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T18:20:44.740825] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T18:20:44.756714] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-26T18:20:45.556743] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-26T18:20:45.750827] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T18:20:45.754456] [INFO ] [REMOTE ] DFP: Full fetch complete (16110 records). [2025-09-26T18:20:45.754559] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-26T18:20:45.755087] [FATAL] [VALIDATOR ] DFP: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:20:45.755177] [FATAL] [MAIN ] DFP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:20:45.755293] [WARN ] [MAIN ] DFP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:20:45.755380] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-26T18:20:45.755487] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-26T18:20:45.755562] [INFO ] [LOCAL ] DFP: Starting deletion of derivative data. [2025-09-26T18:20:45.756275] [DEBUG] [LOCAL ] DFP: Deleted derivative data file. [2025-09-26T18:20:45.756405] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFP took 18.3s. Estimated remaining: 3h 52m 29s. Rate: 7.6 symbols/min [2025-09-26T18:20:45.940761] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:45.993037] [DEBUG] [LOCAL ] DGX: Loaded 45481 existing records from primary storage. [2025-09-26T18:20:45.993190] [INFO ] [MAIN ] DGX: Loaded 45481 existing records. [2025-09-26T18:20:46.185795] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:46.186078] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-26T18:20:46.186127] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-26T18:20:46.187015] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-26T18:20:46.187085] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-26T18:20:46.360389] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-26T18:20:46.573242] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:47.156773] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-26T18:20:47.590509] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T18:20:47.812689] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:20:47.956757] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-26T18:20:48.348271] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T18:20:48.354815] [INFO ] [REMOTE ] DFH: Full fetch complete (48992 records). [2025-09-26T18:20:48.354992] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-26T18:20:48.751162] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-26T18:20:48.751260] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-26T18:20:48.751981] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-26T18:20:48.752062] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-26T18:20:48.753362] [DEBUG] [LOCAL ] DFH: Trimmed 48992 records to 33106 (keeping 200 days of data) [2025-09-26T18:20:48.801749] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-26T18:20:48.958181] [DEBUG] [LOCAL ] DFH: Primary data saved (33106 records). [2025-09-26T18:20:48.958353] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-26T18:20:48.958465] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFH took 28.6s. Estimated remaining: 3h 52m 8s. Rate: 7.6 symbols/min [2025-09-26T18:20:49.152006] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:20:49.181071] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:20:49.206799] [DEBUG] [LOCAL ] DHF: Loaded 20665 existing records from primary storage. [2025-09-26T18:20:49.206952] [INFO ] [MAIN ] DHF: Loaded 20665 existing records. [2025-09-26T18:20:49.402059] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:20:49.402332] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-26T18:20:49.402386] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-26T18:20:49.402759] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-26T18:20:49.402821] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-26T18:20:49.566044] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-26T18:20:49.814210] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:20:50.356698] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-26T18:20:50.610580] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T18:20:50.811123] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T18:20:51.156725] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-26T18:20:51.537255] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T18:20:51.956726] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-26T18:20:52.756754] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-26T18:20:52.981179] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T18:20:53.229331] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-26T18:20:53.556731] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-26T18:20:54.217004] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:20:54.356757] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-26T18:20:55.163188] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-26T18:20:55.185745] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T18:20:55.231369] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T18:20:55.956746] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-26T18:20:56.726953] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T18:20:56.756688] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-26T18:20:57.072138] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:20:57.556723] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-26T18:20:58.356703] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-26T18:20:58.476598] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T18:20:59.131673] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:20:59.157191] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-26T18:20:59.159961] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:20:59.956737] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-26T18:21:00.054397] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T18:21:00.756801] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-26T18:21:01.556728] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-26T18:21:01.681604] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T18:21:02.356751] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-26T18:21:02.395667] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T18:21:02.435957] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:21:03.156751] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-26T18:21:03.964132] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-26T18:21:03.984238] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T18:21:04.756785] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-26T18:21:05.065015] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T18:21:05.244944] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T18:21:05.256587] [INFO ] [REMOTE ] DG: Full fetch complete (77216 records). [2025-09-26T18:21:05.256840] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-26T18:21:05.560938] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-26T18:21:05.690631] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T18:21:05.804307] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-26T18:21:05.804409] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-26T18:21:05.805440] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-26T18:21:05.805541] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-26T18:21:05.807391] [DEBUG] [LOCAL ] DG: Trimmed 77216 records to 54068 (keeping 200 days of data) [2025-09-26T18:21:06.165790] [DEBUG] [LOCAL ] DG: Primary data saved (54068 records). [2025-09-26T18:21:06.165949] [INFO ] [MAIN ] DG: Full history saved. [2025-09-26T18:21:06.166042] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DG took 35.3s. Estimated remaining: 3h 52m 27s. Rate: 7.6 symbols/min [2025-09-26T18:21:06.356975] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:06.357062] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-26T18:21:06.357364] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-09-26T18:21:06.357461] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-09-26T18:21:06.358597] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-26T18:21:06.358680] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-26T18:21:06.358807] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-26T18:21:06.358863] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-26T18:21:06.821445] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:07.156716] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-26T18:21:07.247695] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T18:21:07.583074] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T18:21:07.956784] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-26T18:21:08.677420] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:21:08.756769] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-26T18:21:08.839320] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T18:21:09.561822] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-26T18:21:09.570166] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T18:21:10.356734] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-26T18:21:10.784127] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T18:21:11.156768] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-26T18:21:11.879966] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T18:21:11.956757] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-26T18:21:12.562085] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:21:12.756724] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-26T18:21:13.556704] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-26T18:21:13.821958] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-26T18:21:14.361946] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-26T18:21:14.377698] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T18:21:14.443811] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T18:21:14.448151] [INFO ] [REMOTE ] DHF: Full fetch complete (29349 records). [2025-09-26T18:21:14.448270] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-26T18:21:14.448959] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:21:14.449050] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:21:14.449095] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:21:14.449136] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-26T18:21:14.449196] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-09-26T18:21:14.449248] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-09-26T18:21:14.449846] [DEBUG] [LOCAL ] DHF: Deleted derivative data file. [2025-09-26T18:21:14.449965] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DHF took 25.5s. Estimated remaining: 3h 52m 20s. Rate: 7.6 symbols/min [2025-09-26T18:21:14.662326] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:14.662554] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-09-26T18:21:14.662593] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-09-26T18:21:14.662816] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-26T18:21:14.662869] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-26T18:21:14.662913] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-26T18:21:14.662946] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-26T18:21:15.128200] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:15.156699] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-26T18:21:15.956750] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-26T18:21:16.107724] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T18:21:16.756715] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-26T18:21:16.821061] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T18:21:16.828437] [INFO ] [REMOTE ] DFIN: Full fetch complete (33465 records). [2025-09-26T18:21:16.828735] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-26T18:21:16.829535] [FATAL] [VALIDATOR ] DFIN: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:21:16.829685] [FATAL] [MAIN ] DFIN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:21:16.829766] [WARN ] [MAIN ] DFIN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:21:16.829850] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-26T18:21:16.829966] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-09-26T18:21:16.830025] [INFO ] [LOCAL ] DFIN: Starting deletion of derivative data. [2025-09-26T18:21:16.830413] [DEBUG] [LOCAL ] DFIN: Deleted derivative data file. [2025-09-26T18:21:16.830555] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DFIN took 49.6s. Estimated remaining: 3h 51m 56s. Rate: 7.6 symbols/min [2025-09-26T18:21:17.101151] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:17.101479] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-09-26T18:21:17.101582] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-09-26T18:21:17.102087] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-26T18:21:17.102289] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-26T18:21:17.102396] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-26T18:21:17.102583] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-26T18:21:17.567333] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-26T18:21:17.570774] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-26T18:21:17.770114] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:18.351427] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:21:18.362233] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-26T18:21:19.156726] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-26T18:21:19.421217] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:21:19.430525] [INFO ] [REMOTE ] DGX: Full fetch complete (65133 records). [2025-09-26T18:21:19.430755] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-26T18:21:19.885811] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-26T18:21:19.886142] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-26T18:21:19.887018] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-26T18:21:19.887107] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-26T18:21:19.918507] [DEBUG] [LOCAL ] DGX: Trimmed 65133 records to 45736 (keeping 200 days of data) [2025-09-26T18:21:19.920583] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T18:21:19.998484] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-26T18:21:20.236400] [DEBUG] [LOCAL ] DGX: Primary data saved (45736 records). [2025-09-26T18:21:20.236549] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-26T18:21:20.236661] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DGX took 34.5s. Estimated remaining: 3h 51m 35s. Rate: 7.6 symbols/min [2025-09-26T18:21:20.452115] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:20.471062] [DEBUG] [LOCAL ] DHX: Loaded 13311 existing records from primary storage. [2025-09-26T18:21:20.471228] [INFO ] [MAIN ] DHX: Loaded 13311 existing records. [2025-09-26T18:21:20.682625] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:20.682957] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-26T18:21:20.683009] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-26T18:21:20.683513] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-26T18:21:20.683575] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-26T18:21:20.757282] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-26T18:21:21.103733] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:21.134752] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-26T18:21:21.468263] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T18:21:21.556736] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-26T18:21:22.170578] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T18:21:22.356755] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-26T18:21:22.942128] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T18:21:23.156723] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-26T18:21:23.835546] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:21:23.956721] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-26T18:21:24.758927] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-26T18:21:24.762829] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:21:25.353085] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:21:25.556753] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-26T18:21:26.356725] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-26T18:21:26.492227] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:21:27.156724] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-26T18:21:27.484694] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T18:21:27.939966] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-26T18:21:27.956684] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-26T18:21:28.186319] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T18:21:28.756703] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-26T18:21:29.060708] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T18:21:29.556793] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-26T18:21:30.356708] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-26T18:21:30.685033] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T18:21:30.739206] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T18:21:31.156797] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-26T18:21:31.840938] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T18:21:31.956778] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-26T18:21:32.093090] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:21:32.756766] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-26T18:21:32.983170] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T18:21:33.556736] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-26T18:21:34.356711] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-26T18:21:34.398829] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T18:21:35.050491] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:21:35.071189] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T18:21:35.156763] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-26T18:21:35.956729] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-26T18:21:36.756751] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-26T18:21:37.182474] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-26T18:21:37.485710] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T18:21:37.556716] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-26T18:21:37.911551] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T18:21:38.357951] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-26T18:21:38.360741] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T18:21:39.156777] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-26T18:21:39.719403] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-26T18:21:39.956817] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-26T18:21:40.424775] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-26T18:21:40.689635] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T18:21:40.693132] [INFO ] [REMOTE ] DHX: Full fetch complete (20819 records). [2025-09-26T18:21:40.693261] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-26T18:21:40.762455] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-26T18:21:41.091114] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-26T18:21:41.091199] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-26T18:21:41.091608] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-26T18:21:41.091728] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-26T18:21:41.093473] [DEBUG] [LOCAL ] DHX: Trimmed 20819 records to 13404 (keeping 200 days of data) [2025-09-26T18:21:41.173590] [DEBUG] [LOCAL ] DHX: Primary data saved (13404 records). [2025-09-26T18:21:41.173792] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-26T18:21:41.174003] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHX took 20.9s. Estimated remaining: 3h 52m 4s. Rate: 7.6 symbols/min [2025-09-26T18:21:41.361368] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:41.380783] [DEBUG] [LOCAL ] DIAX: Loaded 12627 existing records from primary storage. [2025-09-26T18:21:41.380934] [INFO ] [MAIN ] DIAX: Loaded 12627 existing records. [2025-09-26T18:21:41.577477] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-26T18:21:41.585111] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:41.585485] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-26T18:21:41.585552] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-26T18:21:41.586259] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-26T18:21:41.586333] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-26T18:21:41.964998] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:42.356740] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-26T18:21:42.712861] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T18:21:43.120074] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T18:21:43.156731] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-26T18:21:43.407533] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T18:21:43.423892] [INFO ] [REMOTE ] DHI: Full fetch complete (76839 records). [2025-09-26T18:21:43.424098] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-26T18:21:43.430128] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:21:43.430295] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:21:43.430390] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:21:43.430481] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-26T18:21:43.430566] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-26T18:21:43.430678] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-09-26T18:21:43.430769] [DEBUG] [LOCAL ] DHI: No derivative data file found to delete. [2025-09-26T18:21:43.430884] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DHI took 37.3s. Estimated remaining: 3h 51m 40s. Rate: 7.6 symbols/min [2025-09-26T18:21:43.622241] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:43.656878] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T18:21:43.672724] [DEBUG] [LOCAL ] DIN: Loaded 37533 existing records from primary storage. [2025-09-26T18:21:43.672867] [INFO ] [MAIN ] DIN: Loaded 37533 existing records. [2025-09-26T18:21:43.863334] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:43.863617] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-26T18:21:43.863698] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-26T18:21:43.865243] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-26T18:21:43.865305] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-26T18:21:43.961831] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-26T18:21:44.240249] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:44.756762] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-26T18:21:45.527566] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T18:21:45.556771] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-26T18:21:46.362320] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-26T18:21:46.369974] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-26T18:21:46.951611] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T18:21:47.156774] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-26T18:21:47.494476] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T18:21:47.956756] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-26T18:21:48.516668] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T18:21:48.533697] [INFO ] [REMOTE ] DHT: Full fetch complete (69994 records). [2025-09-26T18:21:48.534467] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T18:21:48.534600] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-26T18:21:48.765965] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-26T18:21:48.951512] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-26T18:21:48.951677] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-26T18:21:48.952685] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-26T18:21:48.952763] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-26T18:21:48.954701] [DEBUG] [LOCAL ] DHT: Trimmed 69994 records to 48583 (keeping 200 days of data) [2025-09-26T18:21:49.274521] [DEBUG] [LOCAL ] DHT: Primary data saved (48583 records). [2025-09-26T18:21:49.274693] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-26T18:21:49.274805] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHT took 32.4s. Estimated remaining: 3h 51m 26s. Rate: 7.6 symbols/min [2025-09-26T18:21:49.454085] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:49.509726] [DEBUG] [LOCAL ] DINO: Loaded 53341 existing records from primary storage. [2025-09-26T18:21:49.509880] [INFO ] [MAIN ] DINO: Loaded 53341 existing records. [2025-09-26T18:21:49.567011] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-26T18:21:49.702079] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:49.702376] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-26T18:21:49.702452] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-26T18:21:49.703782] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-26T18:21:49.703845] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-26T18:21:50.086380] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:50.116807] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:21:50.303900] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T18:21:50.356756] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-26T18:21:51.156745] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-26T18:21:51.956730] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-26T18:21:52.026885] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T18:21:52.756733] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-26T18:21:52.838949] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T18:21:52.851716] [INFO ] [REMOTE ] DHR: Full fetch complete (77267 records). [2025-09-26T18:21:52.851905] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-26T18:21:53.274948] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-26T18:21:53.282590] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-26T18:21:53.295724] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-26T18:21:53.295828] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-26T18:21:53.298061] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T18:21:53.307517] [DEBUG] [LOCAL ] DHR: Trimmed 77267 records to 54139 (keeping 200 days of data) [2025-09-26T18:21:53.556925] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-26T18:21:53.675079] [DEBUG] [LOCAL ] DHR: Primary data saved (54139 records). [2025-09-26T18:21:53.675237] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-26T18:21:53.675356] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DHR took 39.2s. Estimated remaining: 3h 51m 9s. Rate: 7.6 symbols/min [2025-09-26T18:21:53.859748] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:21:53.924112] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-09-26T18:21:53.924274] [INFO ] [MAIN ] DIS: Loaded 54178 existing records. [2025-09-26T18:21:54.111388] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:21:54.111725] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-26T18:21:54.111788] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-26T18:21:54.113206] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-26T18:21:54.113270] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-26T18:21:54.360729] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-26T18:21:54.526902] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:21:54.560392] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T18:21:55.114841] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T18:21:55.156688] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-26T18:21:55.251076] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T18:21:55.956740] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-26T18:21:56.678919] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:21:56.756756] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-26T18:21:57.319890] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T18:21:57.423227] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:21:57.556726] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-26T18:21:58.356755] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-26T18:21:59.156702] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-26T18:21:59.284142] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:21:59.309298] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T18:21:59.956764] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-26T18:22:00.756792] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-26T18:22:01.556688] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-26T18:22:01.591418] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-26T18:22:01.802294] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T18:22:02.038312] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T18:22:02.160820] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T18:22:02.356731] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-26T18:22:03.156753] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-26T18:22:03.292473] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T18:22:03.296000] [INFO ] [REMOTE ] DIAX: Full fetch complete (17384 records). [2025-09-26T18:22:03.296080] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-26T18:22:03.707670] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-26T18:22:03.707767] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-26T18:22:03.708166] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-26T18:22:03.708229] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-26T18:22:03.708966] [DEBUG] [LOCAL ] DIAX: Trimmed 17384 records to 12780 (keeping 200 days of data) [2025-09-26T18:22:03.800661] [DEBUG] [LOCAL ] DIAX: Primary data saved (12780 records). [2025-09-26T18:22:03.800901] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-26T18:22:03.801037] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DIAX took 22.6s. Estimated remaining: 3h 51m 7s. Rate: 7.6 symbols/min [2025-09-26T18:22:03.961888] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-26T18:22:03.989233] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:03.989478] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-26T18:22:03.989549] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-26T18:22:03.989737] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-26T18:22:03.989792] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-26T18:22:03.989837] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-26T18:22:03.989870] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-26T18:22:04.374336] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:04.756729] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-26T18:22:05.216817] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T18:22:05.556752] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-26T18:22:05.663833] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-26T18:22:05.846017] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T18:22:05.882614] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-26T18:22:06.356742] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-26T18:22:06.711176] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-26T18:22:07.156720] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-26T18:22:07.660432] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-26T18:22:07.956753] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-26T18:22:08.379832] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-26T18:22:08.756772] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-26T18:22:09.556740] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-26T18:22:10.201609] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:22:10.356796] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-26T18:22:10.943916] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T18:22:11.156775] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-26T18:22:11.315119] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T18:22:11.956764] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-26T18:22:12.241287] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-26T18:22:12.756713] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-26T18:22:12.942186] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:22:13.070734] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-26T18:22:13.556722] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-26T18:22:14.356773] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-26T18:22:15.156720] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-26T18:22:15.356308] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T18:22:15.798014] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T18:22:15.956730] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-26T18:22:16.317634] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T18:22:16.756730] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-26T18:22:17.141211] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-26T18:22:17.556746] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-26T18:22:17.976184] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T18:22:17.984399] [INFO ] [REMOTE ] DIN: Full fetch complete (55216 records). [2025-09-26T18:22:17.984572] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-26T18:22:18.361915] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-26T18:22:18.458039] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-26T18:22:18.458196] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-26T18:22:18.458990] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-26T18:22:18.459073] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-26T18:22:18.460608] [DEBUG] [LOCAL ] DIN: Trimmed 55216 records to 37823 (keeping 200 days of data) [2025-09-26T18:22:18.690694] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-26T18:22:18.720019] [DEBUG] [LOCAL ] DIN: Primary data saved (37823 records). [2025-09-26T18:22:18.720190] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-26T18:22:18.720283] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DIN took 35.3s. Estimated remaining: 3h 51m 19s. Rate: 7.6 symbols/min [2025-09-26T18:22:18.915778] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:18.916074] [DEBUG] [LOCAL ] DK: No existing data file found in primary storage. [2025-09-26T18:22:18.916132] [WARN ] [MAIN ] DK: No existing data found, performing full refresh instead. [2025-09-26T18:22:18.916311] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-26T18:22:18.916365] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-26T18:22:18.916410] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-26T18:22:18.916444] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-26T18:22:19.158788] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-26T18:22:19.317029] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:19.350473] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:22:19.361549] [INFO ] [REMOTE ] DINO: Full fetch complete (76675 records). [2025-09-26T18:22:19.361751] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-26T18:22:19.790985] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T18:22:19.807925] [INFO ] [REMOTE ] DIVY: Full fetch complete (1720 records). [2025-09-26T18:22:19.811886] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-26T18:22:19.961877] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-26T18:22:20.089878] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-26T18:22:20.102429] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-26T18:22:20.118871] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-26T18:22:20.125825] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-26T18:22:20.125615] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T18:22:20.126040] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:22:20.126114] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:22:20.126185] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-26T18:22:20.126257] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-26T18:22:20.126296] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-26T18:22:20.126628] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-26T18:22:20.126837] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DIVY took 16.3s. Estimated remaining: 3h 50m 52s. Rate: 7.6 symbols/min [2025-09-26T18:22:20.197930] [DEBUG] [LOCAL ] DINO: Trimmed 76675 records to 53729 (keeping 200 days of data) [2025-09-26T18:22:20.414832] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:20.441528] [DEBUG] [LOCAL ] DKL: Loaded 19153 existing records from primary storage. [2025-09-26T18:22:20.442530] [INFO ] [MAIN ] DKL: Loaded 19153 existing records. [2025-09-26T18:22:20.659680] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:22:20.662326] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-26T18:22:20.662677] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-26T18:22:20.663495] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-26T18:22:20.664159] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-26T18:22:20.759355] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-26T18:22:21.200082] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:21.332070] [DEBUG] [LOCAL ] DINO: Primary data saved (53729 records). [2025-09-26T18:22:21.332246] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-26T18:22:21.332626] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DINO took 32.1s. Estimated remaining: 3h 50m 26s. Rate: 7.6 symbols/min [2025-09-26T18:22:21.535425] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:21.535623] [DEBUG] [LOCAL ] DKS: No existing data file found in primary storage. [2025-09-26T18:22:21.535704] [WARN ] [MAIN ] DKS: No existing data found, performing full refresh instead. [2025-09-26T18:22:21.535858] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-26T18:22:21.535901] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-26T18:22:21.535943] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-09-26T18:22:21.535976] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-26T18:22:21.569100] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-26T18:22:21.935994] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:22.370724] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-26T18:22:22.374022] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-26T18:22:22.469923] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T18:22:22.858313] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T18:22:23.156725] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-26T18:22:23.727319] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T18:22:23.873183] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T18:22:23.956740] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-26T18:22:24.756765] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-26T18:22:25.556695] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-26T18:22:25.721510] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T18:22:25.884147] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:22:26.356783] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-26T18:22:27.156785] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-26T18:22:27.501539] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T18:22:27.956762] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-26T18:22:28.224736] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-26T18:22:28.378095] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:22:28.756755] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-26T18:22:29.556732] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-26T18:22:29.854051] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T18:22:30.356792] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-26T18:22:31.163024] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-26T18:22:31.183159] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:22:31.291700] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-26T18:22:31.772532] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:22:31.956769] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-26T18:22:32.237596] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T18:22:32.756776] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-26T18:22:33.556727] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-26T18:22:34.315684] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-26T18:22:34.356716] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-26T18:22:34.484264] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:22:35.156730] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-26T18:22:35.504577] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T18:22:35.956721] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-26T18:22:36.082023] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T18:22:36.457468] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-26T18:22:36.756749] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-26T18:22:37.454547] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:22:37.556740] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-26T18:22:38.178697] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:22:38.356741] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-26T18:22:38.732756] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T18:22:39.156774] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-26T18:22:39.729530] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:22:39.956767] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-26T18:22:40.756752] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-26T18:22:40.973296] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T18:22:41.556705] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-26T18:22:41.810294] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T18:22:41.834867] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T18:22:42.356727] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-26T18:22:43.156751] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-26T18:22:43.372158] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T18:22:43.956713] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-26T18:22:44.022669] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-26T18:22:44.033919] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-26T18:22:44.034098] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-26T18:22:44.504972] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-26T18:22:44.505235] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-26T18:22:44.507119] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-26T18:22:44.507494] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-26T18:22:44.509382] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 54568 (keeping 200 days of data) [2025-09-26T18:22:44.756758] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-26T18:22:44.886084] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T18:22:44.909503] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T18:22:44.914849] [INFO ] [REMOTE ] DKL: Full fetch complete (28985 records). [2025-09-26T18:22:44.915840] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-26T18:22:44.917395] [FATAL] [VALIDATOR ] DKL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:22:44.918130] [FATAL] [MAIN ] DKL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:22:44.918470] [WARN ] [MAIN ] DKL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:22:44.918900] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-26T18:22:44.919513] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-26T18:22:44.920336] [INFO ] [LOCAL ] DKL: Starting deletion of derivative data. [2025-09-26T18:22:44.921779] [DEBUG] [LOCAL ] DKL: Deleted derivative data file. [2025-09-26T18:22:44.922036] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DKL took 24.8s. Estimated remaining: 3h 51m 1s. Rate: 7.6 symbols/min [2025-09-26T18:22:45.129405] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:45.142410] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-09-26T18:22:45.142621] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-26T18:22:45.144241] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DIS took 51.5s. Estimated remaining: 3h 50m 32s. Rate: 7.6 symbols/min [2025-09-26T18:22:45.331247] [DEBUG] [LOCAL ] DLB: Loaded 32368 existing records from primary storage. [2025-09-26T18:22:45.349031] [INFO ] [MAIN ] DLB: Loaded 32368 existing records. [2025-09-26T18:22:45.375637] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:45.398194] [DEBUG] [LOCAL ] DLNG: No existing data file found in primary storage. [2025-09-26T18:22:45.413062] [WARN ] [MAIN ] DLNG: No existing data found, performing full refresh instead. [2025-09-26T18:22:45.460047] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-26T18:22:45.477710] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-26T18:22:45.491545] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-09-26T18:22:45.491765] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-26T18:22:45.561902] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-26T18:22:45.707305] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:22:45.712532] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-26T18:22:45.739287] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-26T18:22:45.765332] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-26T18:22:45.791079] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-26T18:22:46.164233] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:46.369987] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-26T18:22:46.394844] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:46.895143] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-26T18:22:46.977029] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T18:22:47.156779] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-26T18:22:47.794920] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-26T18:22:47.805468] [INFO ] [REMOTE ] DKS: Full fetch complete (71559 records). [2025-09-26T18:22:47.805736] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-26T18:22:47.961974] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-26T18:22:48.258262] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-26T18:22:48.258722] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-26T18:22:48.259900] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-26T18:22:48.260100] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-26T18:22:48.262510] [DEBUG] [LOCAL ] DKS: Trimmed 71559 records to 50579 (keeping 200 days of data) [2025-09-26T18:22:48.390502] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:22:48.628445] [DEBUG] [LOCAL ] DKS: Primary data saved (50579 records). [2025-09-26T18:22:48.628612] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-26T18:22:48.628745] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKS took 27.3s. Estimated remaining: 3h 50m 12s. Rate: 7.6 symbols/min [2025-09-26T18:22:48.761906] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-26T18:22:48.825240] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:22:48.893736] [DEBUG] [LOCAL ] DLR: Loaded 51508 existing records from primary storage. [2025-09-26T18:22:48.893892] [INFO ] [MAIN ] DLR: Loaded 51508 existing records. [2025-09-26T18:22:49.096463] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:22:49.097859] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T18:22:49.098133] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-26T18:22:49.102884] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-26T18:22:49.105867] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-26T18:22:49.105951] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-26T18:22:49.478533] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:22:49.556731] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-26T18:22:50.228770] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T18:22:50.361872] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-26T18:22:50.377757] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T18:22:51.156747] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-26T18:22:51.786729] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:22:51.956747] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-26T18:22:52.756733] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-26T18:22:53.556730] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-26T18:23:06.316667] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (15.16 seconds). [2025-09-26T18:23:06.319359] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-26T18:23:06.355756] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (12.80 seconds). [2025-09-26T18:23:06.366572] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-26T18:23:06.462228] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (13.71 seconds). [2025-09-26T18:23:06.474738] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-26T18:23:06.585274] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (14.63 seconds). [2025-09-26T18:23:06.592741] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-26T18:23:07.788087] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T18:23:07.800637] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-26T18:23:07.837023] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:23:07.844572] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-26T18:23:07.915246] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T18:23:07.926218] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-26T18:23:08.626419] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-26T18:23:08.629450] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-26T18:23:09.129160] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:23:09.132052] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-26T18:23:09.224219] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:23:09.234857] [INFO ] [REMOTE ] DK: Full fetch complete (70361 records). [2025-09-26T18:23:09.235023] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-26T18:23:09.235871] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:23:09.235978] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:23:09.236046] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:23:09.236120] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-26T18:23:09.236223] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-26T18:23:09.236281] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-09-26T18:23:09.236328] [DEBUG] [LOCAL ] DK: No derivative data file found to delete. [2025-09-26T18:23:09.236425] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DK took 50.5s. Estimated remaining: 3h 50m 39s. Rate: 7.6 symbols/min [2025-09-26T18:23:09.435267] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:09.468442] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:23:09.497456] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-26T18:23:09.499960] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:23:09.512459] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-26T18:23:09.536923] [DEBUG] [LOCAL ] DLX: Loaded 29145 existing records from primary storage. [2025-09-26T18:23:09.537109] [INFO ] [MAIN ] DLX: Loaded 29145 existing records. [2025-09-26T18:23:09.740508] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:09.740806] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-26T18:23:09.740876] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-26T18:23:09.741832] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-26T18:23:09.741904] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-26T18:23:09.978009] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T18:23:10.032363] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-26T18:23:10.141053] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:10.141418] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-26T18:23:10.676887] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:23:10.679316] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-26T18:23:10.865982] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:23:10.877368] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-26T18:23:11.047894] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:23:11.059727] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-26T18:23:11.071384] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-26T18:23:11.073491] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-26T18:23:11.554865] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:23:11.560059] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-26T18:23:11.597910] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T18:23:11.599486] [INFO ] [REMOTE ] DLNG: Full fetch complete (11928 records). [2025-09-26T18:23:11.599580] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-26T18:23:11.600185] [FATAL] [VALIDATOR ] DLNG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:23:11.600273] [FATAL] [MAIN ] DLNG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:23:11.600317] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:23:11.600380] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-26T18:23:11.600445] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-09-26T18:23:11.600494] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-09-26T18:23:11.600563] [DEBUG] [LOCAL ] DLNG: No derivative data file found to delete. [2025-09-26T18:23:11.600632] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DLNG took 26.5s. Estimated remaining: 3h 50m 16s. Rate: 7.6 symbols/min [2025-09-26T18:23:11.781355] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:11.833703] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T18:23:11.832466] [DEBUG] [LOCAL ] DLY: Loaded 19619 existing records from primary storage. [2025-09-26T18:23:11.840267] [INFO ] [MAIN ] DLY: Loaded 19619 existing records. [2025-09-26T18:23:11.889247] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-26T18:23:12.046612] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:12.046912] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-26T18:23:12.046971] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-26T18:23:12.047673] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-26T18:23:12.047751] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-26T18:23:12.448851] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:12.449343] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-26T18:23:12.465888] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:23:12.472258] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-26T18:23:12.506426] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T18:23:12.518230] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-26T18:23:12.867131] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T18:23:12.874485] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-26T18:23:13.375072] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:23:13.382250] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-26T18:23:13.711690] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T18:23:13.717747] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-26T18:23:13.775927] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-26T18:23:14.004688] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:23:14.356752] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-26T18:23:14.768419] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T18:23:14.769455] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T18:23:15.156723] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-26T18:23:15.956725] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-26T18:23:16.248436] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T18:23:16.249226] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T18:23:16.260302] [INFO ] [REMOTE ] DLB: Full fetch complete (46887 records). [2025-09-26T18:23:16.260760] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-26T18:23:16.657688] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-26T18:23:16.657786] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-26T18:23:16.658389] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-26T18:23:16.658433] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-26T18:23:16.659587] [DEBUG] [LOCAL ] DLB: Trimmed 46887 records to 32601 (keeping 200 days of data) [2025-09-26T18:23:16.756702] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-26T18:23:16.870507] [DEBUG] [LOCAL ] DLB: Primary data saved (32601 records). [2025-09-26T18:23:16.870701] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-26T18:23:16.870810] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLB took 31.9s. Estimated remaining: 3h 50m 0s. Rate: 7.6 symbols/min [2025-09-26T18:23:17.056238] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:17.062532] [DEBUG] [LOCAL ] DMA: Loaded 4570 existing records from primary storage. [2025-09-26T18:23:17.062639] [INFO ] [MAIN ] DMA: Loaded 4570 existing records. [2025-09-26T18:23:17.249564] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:17.249898] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-26T18:23:17.249967] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-26T18:23:17.250305] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-26T18:23:17.250365] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-26T18:23:17.561792] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-26T18:23:17.620660] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:17.785324] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T18:23:17.967405] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T18:23:18.356722] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-26T18:23:18.696221] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:23:18.838446] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-26T18:23:19.156735] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-26T18:23:19.956722] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-26T18:23:20.272084] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-26T18:23:20.756726] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-26T18:23:21.512091] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T18:23:21.556724] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-26T18:23:22.356795] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-26T18:23:22.557957] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T18:23:22.797972] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T18:23:23.137705] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:23:23.156698] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-26T18:23:23.956778] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-26T18:23:24.524770] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:23:24.756698] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-26T18:23:24.857206] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:23:24.867803] [INFO ] [REMOTE ] DLR: Full fetch complete (73841 records). [2025-09-26T18:23:24.867972] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-26T18:23:24.868877] [FATAL] [VALIDATOR ] DLR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:23:24.869019] [FATAL] [MAIN ] DLR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:23:24.869094] [WARN ] [MAIN ] DLR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:23:24.869188] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-26T18:23:24.869334] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-09-26T18:23:24.869465] [INFO ] [LOCAL ] DLR: Starting deletion of derivative data. [2025-09-26T18:23:24.870004] [DEBUG] [LOCAL ] DLR: Deleted derivative data file. [2025-09-26T18:23:24.870113] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLR took 36.2s. Estimated remaining: 3h 49m 53s. Rate: 7.6 symbols/min [2025-09-26T18:23:25.109322] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:25.123871] [DEBUG] [LOCAL ] DMB: Loaded 10216 existing records from primary storage. [2025-09-26T18:23:25.124009] [INFO ] [MAIN ] DMB: Loaded 10216 existing records. [2025-09-26T18:23:25.282243] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T18:23:25.378546] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:25.378916] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-26T18:23:25.378980] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-26T18:23:25.379423] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-26T18:23:25.379496] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-26T18:23:25.574089] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-26T18:23:25.776235] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:26.266945] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T18:23:26.356744] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-26T18:23:27.156694] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-26T18:23:27.194080] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T18:23:27.956710] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-26T18:23:28.188884] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T18:23:28.756784] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-26T18:23:29.023330] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T18:23:29.431355] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T18:23:29.556760] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-26T18:23:30.357072] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-26T18:23:30.360844] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T18:23:31.156743] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-26T18:23:31.653607] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T18:23:31.682531] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-26T18:23:31.956732] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-26T18:23:32.443607] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-26T18:23:32.756743] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-26T18:23:33.262554] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T18:23:33.556722] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-26T18:23:34.356755] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-26T18:23:35.076323] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T18:23:35.076734] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-26T18:23:35.156757] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-26T18:23:35.956709] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-26T18:23:36.194256] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T18:23:36.344777] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-26T18:23:36.756774] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-26T18:23:37.556740] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-26T18:23:37.641681] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T18:23:37.644346] [INFO ] [REMOTE ] DMA: Full fetch complete (6578 records). [2025-09-26T18:23:37.644446] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-26T18:23:37.645115] [FATAL] [VALIDATOR ] DMA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:23:37.645219] [FATAL] [MAIN ] DMA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:23:37.645292] [WARN ] [MAIN ] DMA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:23:37.645385] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-26T18:23:37.645479] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-09-26T18:23:37.645554] [INFO ] [LOCAL ] DMA: Starting deletion of derivative data. [2025-09-26T18:23:37.646079] [DEBUG] [LOCAL ] DMA: Deleted derivative data file. [2025-09-26T18:23:37.646235] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DMA took 20.8s. Estimated remaining: 3h 49m 58s. Rate: 7.6 symbols/min [2025-09-26T18:23:37.870723] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:37.882533] [DEBUG] [LOCAL ] DMO: Loaded 9919 existing records from primary storage. [2025-09-26T18:23:37.882700] [INFO ] [MAIN ] DMO: Loaded 9919 existing records. [2025-09-26T18:23:38.081480] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:38.081765] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-26T18:23:38.081822] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-26T18:23:38.082290] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-26T18:23:38.082351] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-26T18:23:38.363810] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-26T18:23:38.499667] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:38.648275] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:23:39.047426] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T18:23:39.156752] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-26T18:23:39.956747] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-26T18:23:40.426557] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T18:23:40.432352] [INFO ] [REMOTE ] DLX: Full fetch complete (41297 records). [2025-09-26T18:23:40.432516] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-26T18:23:40.615992] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T18:23:40.761872] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-26T18:23:40.933484] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-26T18:23:40.933590] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-26T18:23:40.934269] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-26T18:23:40.934342] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-26T18:23:40.935724] [DEBUG] [LOCAL ] DLX: Trimmed 41297 records to 29284 (keeping 200 days of data) [2025-09-26T18:23:41.126324] [DEBUG] [LOCAL ] DLX: Primary data saved (29284 records). [2025-09-26T18:23:41.126486] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-26T18:23:41.126585] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DLX took 31.9s. Estimated remaining: 3h 49m 38s. Rate: 7.6 symbols/min [2025-09-26T18:23:41.326249] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:41.379134] [DEBUG] [LOCAL ] DNA: Loaded 48681 existing records from primary storage. [2025-09-26T18:23:41.379292] [INFO ] [MAIN ] DNA: Loaded 48681 existing records. [2025-09-26T18:23:41.569558] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-26T18:23:41.577598] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:41.578417] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-26T18:23:41.578774] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-26T18:23:41.591051] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-26T18:23:41.590971] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T18:23:41.591281] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-26T18:23:41.986339] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:42.356703] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-26T18:23:42.659797] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T18:23:43.046889] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:23:43.156755] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-26T18:23:43.956778] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-26T18:23:44.756754] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-26T18:23:45.197407] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T18:23:45.203225] [INFO ] [REMOTE ] DLY: Full fetch complete (28178 records). [2025-09-26T18:23:45.203417] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-26T18:23:45.406244] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-26T18:23:45.486853] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T18:23:45.561861] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-26T18:23:45.670782] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-26T18:23:45.670863] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-26T18:23:45.671308] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-26T18:23:45.671349] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-26T18:23:45.672093] [DEBUG] [LOCAL ] DLY: Trimmed 28178 records to 19800 (keeping 200 days of data) [2025-09-26T18:23:45.798898] [DEBUG] [LOCAL ] DLY: Primary data saved (19800 records). [2025-09-26T18:23:45.799053] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-26T18:23:45.799146] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DLY took 34.2s. Estimated remaining: 3h 49m 21s. Rate: 7.6 symbols/min [2025-09-26T18:23:45.974169] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:46.025815] [DEBUG] [LOCAL ] DNOW: Loaded 43851 existing records from primary storage. [2025-09-26T18:23:46.025968] [INFO ] [MAIN ] DNOW: Loaded 43851 existing records. [2025-09-26T18:23:46.212829] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:46.213121] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-26T18:23:46.213175] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-26T18:23:46.214295] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-26T18:23:46.214358] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-26T18:23:46.362780] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-26T18:23:46.624129] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:47.156738] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-26T18:23:47.234144] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-26T18:23:47.383711] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T18:23:47.636931] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T18:23:47.956768] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-26T18:23:48.756770] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-26T18:23:49.556713] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-26T18:23:49.588054] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T18:23:49.795614] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T18:23:50.356736] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-26T18:23:50.969554] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:23:51.005296] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T18:23:51.156741] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-26T18:23:51.960176] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-26T18:23:51.961404] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:23:52.756749] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-26T18:23:52.894576] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:23:53.500974] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T18:23:53.556722] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-26T18:23:54.356775] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-26T18:23:55.131460] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:23:55.156937] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-26T18:23:55.168849] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T18:23:55.956820] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-26T18:23:56.756756] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-26T18:23:57.049573] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T18:23:57.123349] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T18:23:57.457192] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T18:23:57.460776] [INFO ] [REMOTE ] DMB: Full fetch complete (15052 records). [2025-09-26T18:23:57.460913] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-26T18:23:57.561882] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-26T18:23:57.882853] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-26T18:23:57.882938] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-26T18:23:57.883314] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-26T18:23:57.883356] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-26T18:23:57.884126] [DEBUG] [LOCAL ] DMB: Trimmed 15052 records to 10254 (keeping 200 days of data) [2025-09-26T18:23:57.959961] [DEBUG] [LOCAL ] DMB: Primary data saved (10254 records). [2025-09-26T18:23:57.960302] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-26T18:23:57.960914] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DMB took 33.1s. Estimated remaining: 3h 49m 25s. Rate: 7.6 symbols/min [2025-09-26T18:23:58.157203] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:23:58.212344] [DEBUG] [LOCAL ] DNP: Loaded 33558 existing records from primary storage. [2025-09-26T18:23:58.212531] [INFO ] [MAIN ] DNP: Loaded 33558 existing records. [2025-09-26T18:23:58.361904] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-26T18:23:58.427776] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:23:58.428144] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-26T18:23:58.428235] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-26T18:23:58.429107] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-26T18:23:58.429183] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-26T18:23:58.825831] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:23:59.156746] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-26T18:23:59.472301] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T18:23:59.564463] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T18:23:59.956721] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-26T18:24:00.756771] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-26T18:24:01.227336] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-26T18:24:01.556750] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-26T18:24:01.765665] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T18:24:02.035237] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:24:02.215482] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:24:02.356793] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-26T18:24:03.156768] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-26T18:24:03.771858] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:24:03.956773] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-26T18:24:04.279962] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T18:24:04.282691] [INFO ] [REMOTE ] DMO: Full fetch complete (14594 records). [2025-09-26T18:24:04.282787] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-26T18:24:04.693688] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-26T18:24:04.693794] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-26T18:24:04.694185] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-26T18:24:04.694272] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-26T18:24:04.695295] [DEBUG] [LOCAL ] DMO: Trimmed 14594 records to 9981 (keeping 200 days of data) [2025-09-26T18:24:04.760917] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-26T18:24:04.775219] [DEBUG] [LOCAL ] DMO: Primary data saved (9981 records). [2025-09-26T18:24:04.775406] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-26T18:24:04.775548] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DMO took 27.1s. Estimated remaining: 3h 49m 14s. Rate: 7.6 symbols/min [2025-09-26T18:24:04.966585] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:05.038677] [DEBUG] [LOCAL ] DOC: Loaded 53927 existing records from primary storage. [2025-09-26T18:24:05.038838] [INFO ] [MAIN ] DOC: Loaded 53927 existing records. [2025-09-26T18:24:05.240759] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:05.241179] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-26T18:24:05.241240] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-26T18:24:05.242942] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-26T18:24:05.243009] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-26T18:24:05.378940] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T18:24:05.562418] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-26T18:24:05.703268] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:06.146305] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:24:06.356765] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-26T18:24:06.628294] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T18:24:07.156731] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-26T18:24:07.956784] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-26T18:24:08.106164] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:24:08.218175] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T18:24:08.756769] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-26T18:24:09.023754] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T18:24:09.556729] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-26T18:24:10.356728] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-26T18:24:10.623866] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T18:24:10.719135] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:24:11.156743] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-26T18:24:11.782226] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T18:24:11.956725] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-26T18:24:12.756728] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-26T18:24:12.913557] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T18:24:13.254578] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:24:13.556719] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-26T18:24:14.356739] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-26T18:24:14.563135] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T18:24:15.156726] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-26T18:24:15.546847] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T18:24:15.774337] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-26T18:24:15.788282] [INFO ] [REMOTE ] DNA: Full fetch complete (70539 records). [2025-09-26T18:24:15.788501] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-26T18:24:15.789589] [FATAL] [VALIDATOR ] DNA: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:24:15.789728] [FATAL] [MAIN ] DNA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:24:15.789797] [WARN ] [MAIN ] DNA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:24:15.789905] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-26T18:24:15.790005] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-09-26T18:24:15.790053] [INFO ] [LOCAL ] DNA: Starting deletion of derivative data. [2025-09-26T18:24:15.790405] [DEBUG] [LOCAL ] DNA: Deleted derivative data file. [2025-09-26T18:24:15.790549] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNA took 34.7s. Estimated remaining: 3h 49m 14s. Rate: 7.6 symbols/min [2025-09-26T18:24:15.956730] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-26T18:24:16.733509] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T18:24:16.756679] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-26T18:24:17.484934] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:24:17.556703] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-26T18:24:18.356719] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-26T18:24:18.799585] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-26T18:24:18.883469] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:24:19.156768] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-26T18:24:19.699799] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T18:24:19.709769] [INFO ] [REMOTE ] DNP: Full fetch complete (49395 records). [2025-09-26T18:24:19.709933] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-26T18:24:19.969578] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-26T18:24:20.138728] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-26T18:24:20.138834] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-26T18:24:20.139678] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-26T18:24:20.139747] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-26T18:24:20.141043] [DEBUG] [LOCAL ] DNP: Trimmed 49395 records to 33786 (keeping 200 days of data) [2025-09-26T18:24:20.354811] [DEBUG] [LOCAL ] DNP: Primary data saved (33786 records). [2025-09-26T18:24:20.354960] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-26T18:24:20.355051] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNP took 22.4s. Estimated remaining: 3h 48m 57s. Rate: 7.6 symbols/min [2025-09-26T18:24:20.443812] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:24:20.453514] [INFO ] [REMOTE ] DNOW: Full fetch complete (62627 records). [2025-09-26T18:24:20.453744] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-26T18:24:20.882115] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-26T18:24:20.882214] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-26T18:24:20.883113] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-26T18:24:20.883184] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-26T18:24:20.884630] [DEBUG] [LOCAL ] DNOW: Trimmed 62627 records to 44205 (keeping 200 days of data) [2025-09-26T18:24:21.163594] [DEBUG] [LOCAL ] DNOW: Primary data saved (44205 records). [2025-09-26T18:24:21.163797] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-26T18:24:21.163925] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DNOW took 35.4s. Estimated remaining: 3h 48m 30s. Rate: 7.6 symbols/min [2025-09-26T18:24:21.473348] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T18:24:21.485523] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-26T18:24:23.576861] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T18:24:23.589170] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-26T18:24:25.698387] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T18:24:25.713462] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-26T18:24:27.517531] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:24:27.529737] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-26T18:24:29.636800] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-26T18:24:29.655525] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-26T18:24:31.742499] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T18:24:31.755015] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-26T18:24:33.896141] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:24:33.908559] [INFO ] [REMOTE ] DOC: Full fetch complete (77386 records). [2025-09-26T18:24:33.908790] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-26T18:24:34.338066] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-26T18:24:34.338179] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-26T18:24:34.340263] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-26T18:24:34.340336] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-26T18:24:34.342304] [DEBUG] [LOCAL ] DOC: Trimmed 77386 records to 54317 (keeping 200 days of data) [2025-09-26T18:24:34.699507] [DEBUG] [LOCAL ] DOC: Primary data saved (54317 records). [2025-09-26T18:24:34.699735] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-26T18:24:34.699855] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOC took 29.9s. Estimated remaining: 3h 48m 37s. Rate: 7.6 symbols/min [2025-09-26T18:24:35.415828] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:35.453476] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:35.526845] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:35.552496] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:35.618431] [DEBUG] [LOCAL ] DOUG: Loaded 35046 existing records from primary storage. [2025-09-26T18:24:35.618742] [INFO ] [MAIN ] DOUG: Loaded 35046 existing records. [2025-09-26T18:24:35.721371] [DEBUG] [LOCAL ] DOCS: Loaded 51598 existing records from primary storage. [2025-09-26T18:24:35.750479] [INFO ] [MAIN ] DOCS: Loaded 51598 existing records. [2025-09-26T18:24:35.797750] [DEBUG] [LOCAL ] DOLE: Loaded 38240 existing records from primary storage. [2025-09-26T18:24:35.810152] [INFO ] [MAIN ] DOLE: Loaded 38240 existing records. [2025-09-26T18:24:36.069899] [DEBUG] [LOCAL ] DOCN: Loaded 50889 existing records from primary storage. [2025-09-26T18:24:36.151165] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:36.145748] [INFO ] [MAIN ] DOCN: Loaded 50889 existing records. [2025-09-26T18:24:36.213267] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-26T18:24:36.213521] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-26T18:24:36.266770] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:36.282663] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-26T18:24:36.332563] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-26T18:24:36.361980] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-26T18:24:36.337884] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-26T18:24:36.410489] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-26T18:24:36.403834] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:36.410695] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-26T18:24:36.450998] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-26T18:24:36.518029] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-26T18:24:36.560397] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-26T18:24:36.602201] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-26T18:24:36.905474] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:36.964229] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-26T18:24:37.071865] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-26T18:24:37.190361] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-26T18:24:37.303439] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-26T18:24:37.781841] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:37.846302] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-26T18:24:37.952484] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:38.125903] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-26T18:24:38.154686] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:38.162498] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-26T18:24:38.293033] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:38.293438] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-26T18:24:39.495103] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:24:39.504615] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-26T18:24:39.574813] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:24:39.583701] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-26T18:24:39.687479] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:24:39.696754] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-26T18:24:39.766317] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T18:24:39.777821] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-26T18:24:40.432314] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T18:24:40.440926] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-26T18:24:40.585019] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:24:40.593076] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-26T18:24:41.049021] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T18:24:41.059513] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-26T18:24:41.385264] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T18:24:41.395106] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-26T18:24:41.503860] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T18:24:41.511151] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-26T18:24:41.569963] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:24:41.577824] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-26T18:24:42.570256] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T18:24:42.578136] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-26T18:24:42.658178] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T18:24:42.666918] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-26T18:24:42.748795] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T18:24:42.758678] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-26T18:24:43.004404] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:24:43.016579] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-26T18:24:43.742180] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T18:24:43.751354] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-26T18:24:43.774708] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T18:24:43.783516] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-26T18:24:44.049039] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T18:24:44.059881] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-26T18:24:44.442544] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:24:44.454400] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-26T18:24:44.827262] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T18:24:44.837119] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-26T18:24:44.891188] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T18:24:44.900518] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-26T18:24:45.323028] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T18:24:45.333975] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-26T18:24:45.813929] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:24:45.822704] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-26T18:24:45.871275] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:24:45.974855] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:24:46.356731] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-26T18:24:46.823252] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:24:46.917356] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:24:47.156843] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-26T18:24:47.956726] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-26T18:24:48.028822] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T18:24:48.071155] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T18:24:48.756735] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-26T18:24:49.536170] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T18:24:49.556735] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-26T18:24:50.321709] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T18:24:50.356682] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-26T18:24:50.848765] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T18:24:51.156733] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-26T18:24:51.487889] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:24:51.956788] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-26T18:24:52.653825] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:24:52.756751] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-26T18:24:53.556733] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-26T18:24:54.238181] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-26T18:24:54.313001] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T18:24:54.320350] [INFO ] [REMOTE ] DOUG: Full fetch complete (51446 records). [2025-09-26T18:24:54.320514] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-26T18:24:54.361843] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-26T18:24:54.791032] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-26T18:24:54.791152] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-26T18:24:54.791963] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-26T18:24:54.792028] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-26T18:24:54.793487] [DEBUG] [LOCAL ] DOUG: Trimmed 51446 records to 35254 (keeping 200 days of data) [2025-09-26T18:24:54.994376] [DEBUG] [LOCAL ] DOUG: Primary data saved (35254 records). [2025-09-26T18:24:54.994610] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-26T18:24:54.994781] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOUG took 20.3s. Estimated remaining: 3h 49m 3s. Rate: 7.6 symbols/min [2025-09-26T18:24:55.171903] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-26T18:24:55.175519] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:55.210620] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:24:55.266626] [DEBUG] [LOCAL ] DOV: Loaded 46044 existing records from primary storage. [2025-09-26T18:24:55.266810] [INFO ] [MAIN ] DOV: Loaded 46044 existing records. [2025-09-26T18:24:55.457023] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:55.457322] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-26T18:24:55.457377] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-26T18:24:55.458723] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-26T18:24:55.458805] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-26T18:24:55.831459] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:55.956713] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-26T18:24:56.163308] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T18:24:56.591066] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:24:56.600258] [INFO ] [REMOTE ] DOLE: Full fetch complete (53460 records). [2025-09-26T18:24:56.600427] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-26T18:24:56.766214] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-26T18:24:57.021826] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-26T18:24:57.021923] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-26T18:24:57.022697] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-26T18:24:57.022766] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-26T18:24:57.024225] [DEBUG] [LOCAL ] DOLE: Trimmed 53460 records to 38568 (keeping 200 days of data) [2025-09-26T18:24:57.273437] [DEBUG] [LOCAL ] DOLE: Primary data saved (38568 records). [2025-09-26T18:24:57.273591] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-26T18:24:57.275009] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOLE took 22.6s. Estimated remaining: 3h 48m 39s. Rate: 7.6 symbols/min [2025-09-26T18:24:57.455529] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:24:57.511337] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-09-26T18:24:57.511492] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-09-26T18:24:57.561928] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-26T18:24:57.715493] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:24:57.715827] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-26T18:24:57.715884] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-26T18:24:57.717345] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-26T18:24:57.717409] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-26T18:24:58.060871] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-26T18:24:58.153336] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:24:58.356720] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-26T18:24:59.011498] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T18:24:59.022048] [INFO ] [REMOTE ] DOCN: Full fetch complete (71450 records). [2025-09-26T18:24:59.022177] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-26T18:24:59.161438] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-26T18:24:59.450095] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-26T18:24:59.450214] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-26T18:24:59.451258] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-26T18:24:59.451345] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-26T18:24:59.478999] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:24:59.483246] [DEBUG] [LOCAL ] DOCN: Trimmed 71450 records to 51245 (keeping 200 days of data) [2025-09-26T18:24:59.492786] [INFO ] [REMOTE ] DOCS: Full fetch complete (74179 records). [2025-09-26T18:24:59.493036] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-26T18:25:00.048414] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-26T18:25:00.048566] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-26T18:25:00.049597] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-26T18:25:00.050470] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-26T18:25:00.060295] [DEBUG] [LOCAL ] DOCS: Trimmed 74179 records to 51956 (keeping 200 days of data) [2025-09-26T18:25:00.368038] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-26T18:25:00.392270] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-26T18:25:00.538303] [DEBUG] [LOCAL ] DOCN: Primary data saved (51245 records). [2025-09-26T18:25:00.540099] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-26T18:25:00.540950] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOCN took 25.8s. Estimated remaining: 3h 48m 19s. Rate: 7.6 symbols/min [2025-09-26T18:25:00.741216] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:00.778545] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-09-26T18:25:00.795941] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-09-26T18:25:00.799350] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-26T18:25:00.799820] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-26T18:25:00.801306] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-26T18:25:00.801635] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-26T18:25:00.878530] [DEBUG] [LOCAL ] DOCS: Primary data saved (51956 records). [2025-09-26T18:25:00.928581] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-26T18:25:00.953977] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T18:25:00.962806] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCS took 26.3s. Estimated remaining: 3h 47m 51s. Rate: 7.6 symbols/min [2025-09-26T18:25:00.990883] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-26T18:25:01.428687] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:01.455135] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:01.499754] [DEBUG] [LOCAL ] DQ: Loaded 43526 existing records from primary storage. [2025-09-26T18:25:01.499935] [INFO ] [MAIN ] DQ: Loaded 43526 existing records. [2025-09-26T18:25:01.569461] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-26T18:25:01.708157] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:01.708421] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-26T18:25:01.708470] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-26T18:25:01.709517] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-26T18:25:01.709579] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-26T18:25:02.117109] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:02.356704] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-26T18:25:02.407096] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T18:25:02.604476] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-26T18:25:02.685196] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T18:25:03.156761] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-26T18:25:03.956722] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-26T18:25:04.412346] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T18:25:04.756744] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-26T18:25:04.812237] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T18:25:05.179612] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T18:25:05.556725] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-26T18:25:06.331599] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:25:06.356682] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-26T18:25:07.156751] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-26T18:25:07.194835] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T18:25:07.449330] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-26T18:25:07.956728] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-26T18:25:08.756792] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-26T18:25:08.815119] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:25:08.843339] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T18:25:09.556749] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-26T18:25:10.356699] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-26T18:25:10.425683] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:25:10.473318] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T18:25:11.156726] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-26T18:25:11.956759] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-26T18:25:12.112049] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T18:25:12.756730] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-26T18:25:12.867400] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T18:25:13.472001] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T18:25:13.556714] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-26T18:25:13.773819] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T18:25:14.111443] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T18:25:14.356729] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-26T18:25:15.156769] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-26T18:25:15.956761] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-26T18:25:16.721485] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-26T18:25:16.756771] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-26T18:25:16.796823] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T18:25:17.381223] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-26T18:25:17.556736] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-26T18:25:18.356759] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-26T18:25:18.445819] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T18:25:18.671619] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T18:25:19.156742] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-26T18:25:19.484956] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T18:25:19.956732] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-26T18:25:20.756722] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-26T18:25:20.956041] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:25:21.000467] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T18:25:21.556742] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-26T18:25:21.865832] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T18:25:22.356742] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-26T18:25:23.156694] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-26T18:25:23.304146] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T18:25:23.308023] [INFO ] [REMOTE ] DPG: Full fetch complete (19105 records). [2025-09-26T18:25:23.308187] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-26T18:25:23.748006] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-26T18:25:23.748206] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-26T18:25:23.748840] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-26T18:25:23.748936] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-26T18:25:23.750186] [DEBUG] [LOCAL ] DPG: Trimmed 19105 records to 13683 (keeping 200 days of data) [2025-09-26T18:25:23.783410] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T18:25:23.886019] [DEBUG] [LOCAL ] DPG: Primary data saved (13683 records). [2025-09-26T18:25:23.886192] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-26T18:25:23.886343] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DPG took 23.3s. Estimated remaining: 3h 48m 23s. Rate: 7.6 symbols/min [2025-09-26T18:25:23.961865] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-26T18:25:24.085920] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:24.086129] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-09-26T18:25:24.086177] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-09-26T18:25:24.086335] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-26T18:25:24.086389] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-26T18:25:24.086457] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-26T18:25:24.086492] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-26T18:25:24.476815] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:24.756743] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-26T18:25:25.207968] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T18:25:25.449805] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:25:25.556741] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-26T18:25:26.009546] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T18:25:26.356728] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-26T18:25:27.156760] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-26T18:25:27.548863] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T18:25:27.829957] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:25:27.840525] [INFO ] [REMOTE ] DQ: Full fetch complete (62970 records). [2025-09-26T18:25:27.840718] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-26T18:25:27.961889] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-26T18:25:28.280371] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-26T18:25:28.280474] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-26T18:25:28.281358] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-26T18:25:28.281428] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-26T18:25:28.282813] [DEBUG] [LOCAL ] DQ: Trimmed 62970 records to 43880 (keeping 200 days of data) [2025-09-26T18:25:28.563227] [DEBUG] [LOCAL ] DQ: Primary data saved (43880 records). [2025-09-26T18:25:28.563418] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-26T18:25:28.563542] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DQ took 27.6s. Estimated remaining: 3h 48m 6s. Rate: 7.6 symbols/min [2025-09-26T18:25:28.763865] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-26T18:25:28.799479] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:28.833821] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:25:28.888380] [DEBUG] [LOCAL ] DRH: Loaded 50835 existing records from primary storage. [2025-09-26T18:25:28.888540] [INFO ] [MAIN ] DRH: Loaded 50835 existing records. [2025-09-26T18:25:29.086367] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:29.086735] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-26T18:25:29.086793] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-26T18:25:29.088164] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-26T18:25:29.088228] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-26T18:25:29.477518] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:29.556741] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-26T18:25:30.004708] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:25:30.356709] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-26T18:25:30.404890] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-26T18:25:30.416844] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-26T18:25:30.417046] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-26T18:25:30.870867] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-26T18:25:30.870963] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-26T18:25:30.871942] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-26T18:25:30.872026] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-26T18:25:30.873795] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54513 (keeping 200 days of data) [2025-09-26T18:25:31.174613] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-26T18:25:31.231323] [DEBUG] [LOCAL ] DOW: Primary data saved (54513 records). [2025-09-26T18:25:31.231478] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-26T18:25:31.233044] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DOW took 34.0s. Estimated remaining: 3h 47m 45s. Rate: 7.6 symbols/min [2025-09-26T18:25:31.418969] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:31.470116] [DEBUG] [LOCAL ] DRI: Loaded 48216 existing records from primary storage. [2025-09-26T18:25:31.470279] [INFO ] [MAIN ] DRI: Loaded 48216 existing records. [2025-09-26T18:25:31.680462] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:31.680972] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-26T18:25:31.681051] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-26T18:25:31.695104] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-26T18:25:31.716447] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-26T18:25:31.769355] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T18:25:31.855009] [INFO ] [REMOTE ] DOV: Full fetch complete (65145 records). [2025-09-26T18:25:31.866201] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-26T18:25:32.442912] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:32.480463] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-26T18:25:32.598595] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:25:32.684913] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-26T18:25:32.683207] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-26T18:25:32.695131] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-26T18:25:32.696632] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-26T18:25:32.696736] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-26T18:25:32.698323] [DEBUG] [LOCAL ] DOV: Trimmed 65145 records to 46376 (keeping 200 days of data) [2025-09-26T18:25:32.757552] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-26T18:25:33.003737] [DEBUG] [LOCAL ] DOV: Primary data saved (46376 records). [2025-09-26T18:25:33.003917] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-26T18:25:33.004008] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DOV took 38.0s. Estimated remaining: 3h 47m 20s. Rate: 7.6 symbols/min [2025-09-26T18:25:33.195581] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:33.207070] [DEBUG] [LOCAL ] DRLL: Loaded 9694 existing records from primary storage. [2025-09-26T18:25:33.207236] [INFO ] [MAIN ] DRLL: Loaded 9694 existing records. [2025-09-26T18:25:33.403333] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:33.403630] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-26T18:25:33.403733] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-26T18:25:33.404191] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-26T18:25:33.404266] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-26T18:25:33.565578] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-26T18:25:33.812387] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:34.075460] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T18:25:34.205419] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T18:25:34.356753] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-26T18:25:34.949810] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:25:35.156748] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-26T18:25:35.956754] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-26T18:25:36.277265] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T18:25:36.389362] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:25:36.756726] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-26T18:25:37.215796] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T18:25:37.556701] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-26T18:25:37.608726] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T18:25:38.356779] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-26T18:25:39.145216] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T18:25:39.156695] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-26T18:25:39.759174] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:25:39.777342] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:25:39.956760] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-26T18:25:40.756732] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-26T18:25:41.556718] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-26T18:25:41.710698] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T18:25:42.198054] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T18:25:42.356709] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-26T18:25:42.518257] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-26T18:25:43.156747] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-26T18:25:43.956706] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-26T18:25:44.386609] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T18:25:44.479912] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:25:44.513560] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T18:25:44.756734] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-26T18:25:45.556703] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-26T18:25:45.653410] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T18:25:46.356762] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-26T18:25:47.156701] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-26T18:25:47.198183] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T18:25:47.965961] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-26T18:25:47.985552] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:25:48.547861] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:25:48.756775] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-26T18:25:49.046210] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T18:25:49.556748] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-26T18:25:50.356706] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-26T18:25:50.466194] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T18:25:50.698002] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T18:25:50.868293] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T18:25:51.156761] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-26T18:25:51.956786] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-26T18:25:52.711999] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-26T18:25:52.756704] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-26T18:25:52.955573] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T18:25:53.556753] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-26T18:25:54.356731] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-26T18:25:54.512426] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T18:25:54.515099] [INFO ] [REMOTE ] DRLL: Full fetch complete (15734 records). [2025-09-26T18:25:54.515278] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-26T18:25:54.926487] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-26T18:25:54.926716] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-26T18:25:54.927144] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-26T18:25:54.927628] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-26T18:25:54.928766] [DEBUG] [LOCAL ] DRLL: Trimmed 15734 records to 9737 (keeping 200 days of data) [2025-09-26T18:25:54.991593] [DEBUG] [LOCAL ] DRLL: Primary data saved (9737 records). [2025-09-26T18:25:55.006897] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-26T18:25:55.019226] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRLL took 22.0s. Estimated remaining: 3h 47m 50s. Rate: 7.6 symbols/min [2025-09-26T18:25:55.089943] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-26T18:25:55.161919] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-26T18:25:55.215579] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:25:55.246575] [DEBUG] [LOCAL ] DSL: Loaded 28428 existing records from primary storage. [2025-09-26T18:25:55.246750] [INFO ] [MAIN ] DSL: Loaded 28428 existing records. [2025-09-26T18:25:55.441870] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:25:55.442200] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-26T18:25:55.442273] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-26T18:25:55.443252] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-26T18:25:55.443318] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-26T18:25:55.850174] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:25:55.870887] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:25:55.956698] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-26T18:25:56.727602] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:25:56.756735] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-26T18:25:57.286951] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:25:57.556721] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-26T18:25:57.711546] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T18:25:58.356733] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-26T18:25:59.053505] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T18:25:59.063837] [INFO ] [REMOTE ] DRH: Full fetch complete (71865 records). [2025-09-26T18:25:59.064045] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-26T18:25:59.161884] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-26T18:25:59.500863] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-26T18:25:59.501025] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-26T18:25:59.501984] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-26T18:25:59.502095] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-26T18:25:59.504223] [DEBUG] [LOCAL ] DRH: Trimmed 71865 records to 51205 (keeping 200 days of data) [2025-09-26T18:25:59.539384] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T18:25:59.887198] [DEBUG] [LOCAL ] DRH: Primary data saved (51205 records). [2025-09-26T18:25:59.887396] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-26T18:25:59.887500] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRH took 31.3s. Estimated remaining: 3h 47m 34s. Rate: 7.6 symbols/min [2025-09-26T18:25:59.961813] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-26T18:26:00.083097] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:00.083442] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-09-26T18:26:00.083735] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-09-26T18:26:00.084059] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-26T18:26:00.084231] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-26T18:26:00.089827] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-26T18:26:00.099522] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-26T18:26:00.106097] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T18:26:00.489278] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:00.756771] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-26T18:26:01.526487] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T18:26:01.566429] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-26T18:26:01.575693] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T18:26:02.356764] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-26T18:26:02.536198] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T18:26:03.156748] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-26T18:26:03.335410] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T18:26:03.956727] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-26T18:26:04.756734] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-26T18:26:05.273049] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T18:26:05.284281] [INFO ] [REMOTE ] DRD: Full fetch complete (49385 records). [2025-09-26T18:26:05.284464] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-26T18:26:05.569705] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-26T18:26:05.740706] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:26:05.773104] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-26T18:26:05.773725] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-26T18:26:05.774811] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-26T18:26:05.774938] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-26T18:26:05.777016] [DEBUG] [LOCAL ] DRD: Trimmed 49385 records to 37397 (keeping 200 days of data) [2025-09-26T18:26:06.021826] [DEBUG] [LOCAL ] DRD: Primary data saved (37397 records). [2025-09-26T18:26:06.021992] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-26T18:26:06.022084] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DRD took 42.1s. Estimated remaining: 3h 47m 21s. Rate: 7.6 symbols/min [2025-09-26T18:26:06.210450] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:06.229024] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-26T18:26:06.231033] [DEBUG] [LOCAL ] DSMC: Loaded 1956 existing records from primary storage. [2025-09-26T18:26:06.231242] [INFO ] [MAIN ] DSMC: Loaded 1956 existing records. [2025-09-26T18:26:06.361778] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-26T18:26:06.439777] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:06.440119] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-26T18:26:06.440177] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-26T18:26:06.440458] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-26T18:26:06.440521] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-26T18:26:06.847562] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:26:06.889257] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:07.156726] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-26T18:26:07.956734] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-26T18:26:08.323372] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:26:08.333537] [INFO ] [REMOTE ] DRI: Full fetch complete (69620 records). [2025-09-26T18:26:08.333745] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-26T18:26:08.466096] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T18:26:08.770128] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-26T18:26:08.795011] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-26T18:26:08.795135] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-26T18:26:08.796267] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-26T18:26:08.796342] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-26T18:26:08.798122] [DEBUG] [LOCAL ] DRI: Trimmed 69620 records to 48554 (keeping 200 days of data) [2025-09-26T18:26:09.111841] [DEBUG] [LOCAL ] DRI: Primary data saved (48554 records). [2025-09-26T18:26:09.112021] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-26T18:26:09.112809] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRI took 37.9s. Estimated remaining: 3h 47m 0s. Rate: 7.6 symbols/min [2025-09-26T18:26:09.301691] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:09.326227] [DEBUG] [LOCAL ] DSU: Loaded 22429 existing records from primary storage. [2025-09-26T18:26:09.326375] [INFO ] [MAIN ] DSU: Loaded 22429 existing records. [2025-09-26T18:26:09.532413] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:09.551972] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-26T18:26:09.554600] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-26T18:26:09.556720] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-26T18:26:09.556774] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-26T18:26:09.556668] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:26:09.557881] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-26T18:26:09.977009] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:09.985781] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T18:26:10.230428] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:26:10.356768] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-26T18:26:10.797629] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T18:26:11.156777] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-26T18:26:11.603088] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T18:26:11.956728] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-26T18:26:12.756794] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-26T18:26:12.950589] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:26:13.556772] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-26T18:26:14.025171] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T18:26:14.200371] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T18:26:14.356746] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-26T18:26:15.156724] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-26T18:26:15.536302] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T18:26:15.592064] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T18:26:15.956787] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-26T18:26:16.756745] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-26T18:26:17.001503] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:26:17.556723] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-26T18:26:17.991913] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T18:26:18.186484] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T18:26:18.356746] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-26T18:26:19.156708] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-26T18:26:19.418260] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T18:26:19.421705] [INFO ] [REMOTE ] DSM: Full fetch complete (24807 records). [2025-09-26T18:26:19.421811] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-26T18:26:19.547897] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-26T18:26:19.833017] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-26T18:26:19.833119] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-26T18:26:19.833567] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-26T18:26:19.833616] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-26T18:26:19.834552] [DEBUG] [LOCAL ] DSM: Trimmed 24807 records to 15895 (keeping 200 days of data) [2025-09-26T18:26:19.934122] [DEBUG] [LOCAL ] DSM: Primary data saved (15895 records). [2025-09-26T18:26:19.934301] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-26T18:26:19.934418] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSM took 20.0s. Estimated remaining: 3h 46m 60s. Rate: 7.6 symbols/min [2025-09-26T18:26:19.965270] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-26T18:26:20.126749] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:20.150444] [DEBUG] [LOCAL ] DSX: Loaded 24488 existing records from primary storage. [2025-09-26T18:26:20.150578] [INFO ] [MAIN ] DSX: Loaded 24488 existing records. [2025-09-26T18:26:20.336046] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:20.336294] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-26T18:26:20.336343] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-26T18:26:20.337117] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-26T18:26:20.337205] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-26T18:26:20.717978] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:20.756762] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-26T18:26:21.231980] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:26:21.556737] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-26T18:26:22.275972] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:26:22.356709] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-26T18:26:22.706457] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T18:26:23.156721] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-26T18:26:23.210585] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T18:26:23.956755] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-26T18:26:24.112017] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T18:26:24.756732] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-26T18:26:24.765089] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:26:25.556723] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-26T18:26:25.920910] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T18:26:26.356758] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-26T18:26:26.701403] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T18:26:27.011779] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:26:27.156725] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-26T18:26:27.956757] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-26T18:26:28.395807] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:26:28.756814] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-26T18:26:28.865930] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T18:26:29.556779] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-26T18:26:29.604854] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T18:26:30.356759] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-26T18:26:30.904621] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T18:26:30.911009] [INFO ] [REMOTE ] DSL: Full fetch complete (41320 records). [2025-09-26T18:26:30.911267] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-26T18:26:31.165934] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-26T18:26:31.351185] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-26T18:26:31.351436] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-26T18:26:31.352114] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-26T18:26:31.352382] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-26T18:26:31.372505] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T18:26:31.378970] [DEBUG] [LOCAL ] DSL: Trimmed 41320 records to 28651 (keeping 200 days of data) [2025-09-26T18:26:31.578361] [DEBUG] [LOCAL ] DSL: Primary data saved (28651 records). [2025-09-26T18:26:31.578517] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-26T18:26:31.578773] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSL took 36.6s. Estimated remaining: 3h 47m 2s. Rate: 7.6 symbols/min [2025-09-26T18:26:31.765133] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:31.827601] [DEBUG] [LOCAL ] DT: Loaded 53323 existing records from primary storage. [2025-09-26T18:26:31.827846] [INFO ] [MAIN ] DT: Loaded 53323 existing records. [2025-09-26T18:26:31.961811] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-26T18:26:32.031313] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:32.031623] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-26T18:26:32.031727] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-26T18:26:32.033115] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-26T18:26:32.033193] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-26T18:26:32.371855] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T18:26:32.461564] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:32.756728] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-26T18:26:33.233017] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:26:33.556706] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-26T18:26:33.871999] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-26T18:26:34.356770] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-26T18:26:34.733241] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T18:26:35.137505] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:26:35.156674] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-26T18:26:35.956735] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-26T18:26:36.756736] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-26T18:26:37.124704] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T18:26:37.455788] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:26:37.556748] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-26T18:26:37.615070] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T18:26:38.356748] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-26T18:26:39.037582] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T18:26:39.156713] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-26T18:26:39.456541] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T18:26:39.956818] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-26T18:26:40.392303] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T18:26:40.756724] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-26T18:26:40.802452] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T18:26:41.322236] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T18:26:41.323322] [INFO ] [REMOTE ] DSMC: Full fetch complete (2870 records). [2025-09-26T18:26:41.323401] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-26T18:26:41.323998] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:26:41.324124] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:26:41.324183] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:26:41.324269] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-26T18:26:41.324365] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-09-26T18:26:41.324438] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-09-26T18:26:41.325438] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-09-26T18:26:41.325591] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSMC took 35.3s. Estimated remaining: 3h 46m 59s. Rate: 7.6 symbols/min [2025-09-26T18:26:41.513874] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:41.528093] [DEBUG] [LOCAL ] DTB: Loaded 4784 existing records from primary storage. [2025-09-26T18:26:41.528227] [INFO ] [MAIN ] DTB: Loaded 4784 existing records. [2025-09-26T18:26:41.561821] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-26T18:26:41.730759] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:26:41.731008] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-26T18:26:41.731057] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-26T18:26:41.731349] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-26T18:26:41.731410] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-26T18:26:42.120307] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:42.356750] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-26T18:26:42.981390] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:26:42.987488] [INFO ] [REMOTE ] DSU: Full fetch complete (32594 records). [2025-09-26T18:26:42.987623] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-26T18:26:43.161340] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T18:26:43.161422] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-26T18:26:43.453193] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-26T18:26:43.453287] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-26T18:26:43.453873] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-26T18:26:43.453942] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-26T18:26:43.455701] [DEBUG] [LOCAL ] DSU: Trimmed 32594 records to 22684 (keeping 200 days of data) [2025-09-26T18:26:43.608786] [DEBUG] [LOCAL ] DSU: Primary data saved (22684 records). [2025-09-26T18:26:43.608927] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-26T18:26:43.609037] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DSU took 34.5s. Estimated remaining: 3h 46m 36s. Rate: 7.6 symbols/min [2025-09-26T18:26:43.798968] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:43.799172] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-09-26T18:26:43.799231] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-09-26T18:26:43.799385] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-26T18:26:43.799431] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-26T18:26:43.799475] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-09-26T18:26:43.799513] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-26T18:26:43.986798] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-26T18:26:44.195803] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:44.756751] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-26T18:26:45.255614] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T18:26:45.421821] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-26T18:26:45.556727] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-26T18:26:46.337206] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:26:46.356700] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-26T18:26:46.936964] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T18:26:47.092417] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T18:26:47.156759] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-26T18:26:47.956732] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-26T18:26:48.544403] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T18:26:48.756737] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-26T18:26:48.815495] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T18:26:49.321670] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T18:26:49.556736] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-26T18:26:50.356721] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-26T18:26:51.123143] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:26:51.156728] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-26T18:26:51.501226] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-26T18:26:51.700693] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T18:26:51.956722] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-26T18:26:52.756769] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-26T18:26:53.118243] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-26T18:26:53.237285] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T18:26:53.556739] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-26T18:26:54.356795] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-26T18:26:54.949622] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:26:55.156769] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-26T18:26:55.282313] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:26:55.778483] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T18:26:55.956724] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-26T18:26:56.756727] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-26T18:26:57.396485] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T18:26:57.407716] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T18:26:57.411265] [INFO ] [REMOTE ] DSX: Full fetch complete (36939 records). [2025-09-26T18:26:57.411486] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-26T18:26:57.568563] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-26T18:26:57.833940] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-26T18:26:57.834039] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-26T18:26:57.834665] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-26T18:26:57.834736] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-26T18:26:57.835834] [DEBUG] [LOCAL ] DSX: Trimmed 36939 records to 24642 (keeping 200 days of data) [2025-09-26T18:26:58.002699] [DEBUG] [LOCAL ] DSX: Primary data saved (24642 records). [2025-09-26T18:26:58.002869] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-26T18:26:58.002984] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSX took 38.1s. Estimated remaining: 3h 46m 45s. Rate: 7.6 symbols/min [2025-09-26T18:26:58.202191] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:58.202434] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-26T18:26:58.202492] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-26T18:26:58.202700] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-26T18:26:58.202756] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-26T18:26:58.202803] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-26T18:26:58.202837] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-26T18:26:58.361809] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-26T18:26:58.603102] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:26:59.156703] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-26T18:26:59.207702] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T18:26:59.209612] [INFO ] [REMOTE ] DTB: Full fetch complete (6866 records). [2025-09-26T18:26:59.209736] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-26T18:26:59.591821] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-26T18:26:59.591906] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-26T18:26:59.592115] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-26T18:26:59.592157] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-26T18:26:59.592595] [DEBUG] [LOCAL ] DTB: Trimmed 6866 records to 4817 (keeping 200 days of data) [2025-09-26T18:26:59.625540] [DEBUG] [LOCAL ] DTB: Primary data saved (4817 records). [2025-09-26T18:26:59.625704] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-26T18:26:59.625827] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTB took 18.3s. Estimated remaining: 3h 46m 20s. Rate: 7.6 symbols/min [2025-09-26T18:26:59.827016] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:26:59.835623] [DEBUG] [LOCAL ] DTG: Loaded 5918 existing records from primary storage. [2025-09-26T18:26:59.835768] [INFO ] [MAIN ] DTG: Loaded 5918 existing records. [2025-09-26T18:26:59.956788] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-26T18:27:00.033172] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:00.033806] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-26T18:27:00.034325] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-26T18:27:00.034791] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-26T18:27:00.034857] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-26T18:27:00.189850] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-26T18:27:00.477691] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:00.756731] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-26T18:27:00.771584] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T18:27:01.362044] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-26T18:27:01.556739] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-26T18:27:02.057312] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T18:27:02.356731] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-26T18:27:02.607534] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-26T18:27:02.970187] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T18:27:03.156730] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-26T18:27:03.780275] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T18:27:03.956734] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-26T18:27:04.756722] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-26T18:27:05.400601] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T18:27:05.556695] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-26T18:27:05.717727] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T18:27:05.976592] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-26T18:27:06.356723] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-26T18:27:07.083015] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T18:27:07.156801] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-26T18:27:07.956745] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-26T18:27:08.570010] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T18:27:08.756732] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-26T18:27:08.841083] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T18:27:08.851946] [INFO ] [REMOTE ] DT: Full fetch complete (76246 records). [2025-09-26T18:27:08.852124] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-26T18:27:08.854541] [FATAL] [VALIDATOR ] DT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:27:08.854680] [FATAL] [MAIN ] DT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:27:08.854762] [WARN ] [MAIN ] DT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:27:08.854842] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-26T18:27:08.854916] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-09-26T18:27:08.854958] [INFO ] [LOCAL ] DT: Starting deletion of derivative data. [2025-09-26T18:27:08.855386] [DEBUG] [LOCAL ] DT: Deleted derivative data file. [2025-09-26T18:27:08.855495] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 37.3s. Estimated remaining: 3h 46m 16s. Rate: 7.6 symbols/min [2025-09-26T18:27:09.041358] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:09.041584] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-26T18:27:09.041635] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-26T18:27:09.041808] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-26T18:27:09.041851] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-26T18:27:09.041894] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-26T18:27:09.041926] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-26T18:27:09.205261] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T18:27:09.445213] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:09.556740] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-26T18:27:09.763624] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:09.764006] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-26T18:27:10.356734] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-09-26T18:27:10.556469] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:10.556835] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-09-26T18:27:11.156723] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-26T18:27:11.956738] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-02. [2025-09-26T18:27:12.165568] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:12.165952] [WARN ] [REMOTE ] DTK: No data returned for month 2025-02 [2025-09-26T18:27:12.756702] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-03. [2025-09-26T18:27:12.951844] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:27:12.978992] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:12.979353] [WARN ] [REMOTE ] DTK: No data returned for month 2025-03 [2025-09-26T18:27:13.556720] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-26T18:27:14.252445] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T18:27:14.356774] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-04. [2025-09-26T18:27:14.591576] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:14.592099] [WARN ] [REMOTE ] DTK: No data returned for month 2025-04 [2025-09-26T18:27:15.156757] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-26T18:27:15.632017] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T18:27:15.956792] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-26T18:27:16.612281] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:27:16.756771] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-26T18:27:17.515005] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-26T18:27:17.516807] [INFO ] [REMOTE ] DTG: Full fetch complete (8996 records). [2025-09-26T18:27:17.516888] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-26T18:27:17.561902] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-05. [2025-09-26T18:27:17.866009] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:17.907974] [WARN ] [REMOTE ] DTK: No data returned for month 2025-05 [2025-09-26T18:27:17.917818] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-26T18:27:17.917925] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-26T18:27:17.918252] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-26T18:27:17.918313] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-26T18:27:17.918856] [DEBUG] [LOCAL ] DTG: Trimmed 8996 records to 5952 (keeping 200 days of data) [2025-09-26T18:27:17.956782] [DEBUG] [LOCAL ] DTG: Primary data saved (5952 records). [2025-09-26T18:27:17.956911] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-26T18:27:17.957011] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTG took 18.3s. Estimated remaining: 3h 46m 11s. Rate: 7.6 symbols/min [2025-09-26T18:27:18.137452] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:18.199061] [DEBUG] [LOCAL ] DTM: Loaded 44667 existing records from primary storage. [2025-09-26T18:27:18.199215] [INFO ] [MAIN ] DTM: Loaded 44667 existing records. [2025-09-26T18:27:18.368477] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-06. [2025-09-26T18:27:18.390576] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:18.390878] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-26T18:27:18.390928] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-26T18:27:18.392130] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-26T18:27:18.392193] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-26T18:27:18.669949] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:18.697811] [WARN ] [REMOTE ] DTK: No data returned for month 2025-06 [2025-09-26T18:27:18.789751] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:19.156731] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-26T18:27:19.583202] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-26T18:27:19.956733] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-07. [2025-09-26T18:27:20.349441] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:20.349798] [WARN ] [REMOTE ] DTK: No data returned for month 2025-07 [2025-09-26T18:27:20.756731] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-26T18:27:21.556719] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-26T18:27:22.004882] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T18:27:22.356730] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-08. [2025-09-26T18:27:22.410235] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:27:22.557810] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:27:22.558195] [WARN ] [REMOTE ] DTK: No data returned for month 2025-08 [2025-09-26T18:27:23.156770] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-09. [2025-09-26T18:27:23.956770] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-26T18:27:24.007237] [INFO ] [REMOTE ] DTK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T18:27:24.008991] [INFO ] [REMOTE ] DTK: Full fetch complete (758 records). [2025-09-26T18:27:24.009076] [DEBUG] [VALIDATOR ] DTK: Validating primary data. [2025-09-26T18:27:24.009484] [FATAL] [VALIDATOR ] DTK: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:27:24.009571] [FATAL] [MAIN ] DTK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:27:24.009616] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:27:24.009692] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-26T18:27:24.009818] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-26T18:27:24.009902] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-26T18:27:24.010015] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-26T18:27:24.010122] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTK took 15.2s. Estimated remaining: 3h 45m 58s. Rate: 7.6 symbols/min [2025-09-26T18:27:24.207000] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:24.216021] [DEBUG] [LOCAL ] DTW: Loaded 4905 existing records from primary storage. [2025-09-26T18:27:24.216144] [INFO ] [MAIN ] DTW: Loaded 4905 existing records. [2025-09-26T18:27:24.412442] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:24.412742] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-26T18:27:24.412802] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-26T18:27:24.413121] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-26T18:27:24.413181] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-26T18:27:24.761890] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-26T18:27:24.890294] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:25.554444] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T18:27:25.563499] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-26T18:27:26.177214] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T18:27:26.226759] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T18:27:26.356704] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-26T18:27:27.057224] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T18:27:27.156778] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-26T18:27:27.729946] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T18:27:27.956740] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-26T18:27:28.462779] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T18:27:28.756719] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-26T18:27:29.556722] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-26T18:27:29.902428] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-26T18:27:30.312224] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T18:27:30.356694] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-26T18:27:31.156726] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-26T18:27:31.956721] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-26T18:27:31.976629] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T18:27:32.006606] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T18:27:32.756774] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-26T18:27:33.556697] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-26T18:27:33.814707] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T18:27:33.824258] [INFO ] [REMOTE ] DTE: Full fetch complete (69104 records). [2025-09-26T18:27:33.824397] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-26T18:27:33.941145] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-26T18:27:34.256355] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-26T18:27:34.256508] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-26T18:27:34.257446] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-26T18:27:34.257516] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-26T18:27:34.258984] [DEBUG] [LOCAL ] DTE: Trimmed 69104 records to 48557 (keeping 200 days of data) [2025-09-26T18:27:34.363994] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-26T18:27:34.603125] [DEBUG] [LOCAL ] DTE: Primary data saved (48557 records). [2025-09-26T18:27:34.603423] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-26T18:27:34.603526] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTE took 51.0s. Estimated remaining: 3h 45m 57s. Rate: 7.6 symbols/min [2025-09-26T18:27:34.729094] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T18:27:34.737793] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-26T18:27:34.882689] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:34.943891] [DEBUG] [LOCAL ] DUK: Loaded 53849 existing records from primary storage. [2025-09-26T18:27:34.944047] [INFO ] [MAIN ] DUK: Loaded 53849 existing records. [2025-09-26T18:27:35.156912] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-26T18:27:35.156768] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:35.158407] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-26T18:27:35.158521] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-26T18:27:35.160024] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-26T18:27:35.160122] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-26T18:27:35.560161] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:35.661977] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-26T18:27:35.956771] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-26T18:27:36.756769] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-26T18:27:37.553663] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:27:37.563742] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-26T18:27:38.070257] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T18:27:38.071191] [INFO ] [REMOTE ] DTF: Full fetch complete (2111 records). [2025-09-26T18:27:38.071261] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-26T18:27:38.265557] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T18:27:38.265878] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:27:38.266130] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:27:38.266288] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-26T18:27:38.266461] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-26T18:27:38.266535] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-26T18:27:38.266735] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-26T18:27:38.266823] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTF took 40.3s. Estimated remaining: 3h 45m 38s. Rate: 7.6 symbols/min [2025-09-26T18:27:38.361921] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-26T18:27:38.459336] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:38.498758] [DEBUG] [LOCAL ] DUKB: Loaded 6389 existing records from primary storage. [2025-09-26T18:27:38.500766] [INFO ] [MAIN ] DUKB: Loaded 6389 existing records. [2025-09-26T18:27:38.500628] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T18:27:38.711447] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:38.711782] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-26T18:27:38.711840] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-26T18:27:38.712320] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-26T18:27:38.712385] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-26T18:27:39.109427] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:39.156739] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-26T18:27:39.956697] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-26T18:27:40.043227] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T18:27:40.077857] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T18:27:40.756755] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-26T18:27:41.253784] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T18:27:41.523439] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:27:41.556742] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-26T18:27:42.179437] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:27:42.356729] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-26T18:27:43.156754] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-26T18:27:43.944145] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T18:27:43.956672] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-26T18:27:44.515125] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T18:27:44.756803] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-26T18:27:45.256840] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T18:27:45.257130] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:27:45.556743] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-26T18:27:46.356723] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-26T18:27:47.129905] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:27:47.156707] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-26T18:27:47.204372] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T18:27:47.753190] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T18:27:47.956764] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-26T18:27:48.756753] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-26T18:27:49.488349] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T18:27:49.556717] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-26T18:27:49.747925] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:27:49.756864] [INFO ] [REMOTE ] DTM: Full fetch complete (64852 records). [2025-09-26T18:27:49.757017] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-26T18:27:50.207235] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T18:27:50.234468] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-26T18:27:50.234951] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-26T18:27:50.235781] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-26T18:27:50.235848] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-26T18:27:50.237394] [DEBUG] [LOCAL ] DTM: Trimmed 64852 records to 45043 (keeping 200 days of data) [2025-09-26T18:27:50.356808] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-26T18:27:50.543545] [DEBUG] [LOCAL ] DTM: Primary data saved (45043 records). [2025-09-26T18:27:50.543773] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-26T18:27:50.543898] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DTM took 32.6s. Estimated remaining: 3h 45m 42s. Rate: 7.6 symbols/min [2025-09-26T18:27:50.734973] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:50.787684] [DEBUG] [LOCAL ] DV: Loaded 51659 existing records from primary storage. [2025-09-26T18:27:50.787835] [INFO ] [MAIN ] DV: Loaded 51659 existing records. [2025-09-26T18:27:50.914597] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T18:27:50.993458] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:50.993766] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-26T18:27:50.993834] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-26T18:27:50.995116] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-26T18:27:50.995187] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-26T18:27:51.161922] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-26T18:27:51.378970] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:51.797144] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T18:27:51.956732] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-26T18:27:52.756733] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-26T18:27:53.363611] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:27:53.556732] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-26T18:27:53.736182] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T18:27:54.199171] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:27:54.356738] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-26T18:27:55.130849] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T18:27:55.133289] [INFO ] [REMOTE ] DTW: Full fetch complete (7683 records). [2025-09-26T18:27:55.133364] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-26T18:27:55.164616] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-26T18:27:55.513625] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-26T18:27:55.513739] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-26T18:27:55.513942] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-26T18:27:55.513981] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-26T18:27:55.514570] [DEBUG] [LOCAL ] DTW: Trimmed 7683 records to 4923 (keeping 200 days of data) [2025-09-26T18:27:55.546424] [DEBUG] [LOCAL ] DTW: Primary data saved (4923 records). [2025-09-26T18:27:55.546581] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-26T18:27:55.546706] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DTW took 31.5s. Estimated remaining: 3h 45m 26s. Rate: 7.6 symbols/min [2025-09-26T18:27:55.727892] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:55.773220] [DEBUG] [LOCAL ] DVA: Loaded 41631 existing records from primary storage. [2025-09-26T18:27:55.773372] [INFO ] [MAIN ] DVA: Loaded 41631 existing records. [2025-09-26T18:27:55.957705] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-26T18:27:55.988080] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:27:55.989769] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-26T18:27:55.989844] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-26T18:27:55.991189] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-26T18:27:55.991263] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-26T18:27:56.434495] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:56.584381] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T18:27:56.756729] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-26T18:27:56.849601] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T18:27:57.556733] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-26T18:27:58.341451] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:27:58.358481] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-26T18:27:58.360818] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-26T18:27:58.364314] [INFO ] [REMOTE ] DUKB: Full fetch complete (9519 records). [2025-09-26T18:27:58.364468] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-26T18:27:58.749064] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-26T18:27:58.749151] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-26T18:27:58.749430] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-26T18:27:58.749472] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-26T18:27:58.750058] [DEBUG] [LOCAL ] DUKB: Trimmed 9519 records to 6414 (keeping 200 days of data) [2025-09-26T18:27:58.792052] [DEBUG] [LOCAL ] DUKB: Primary data saved (6414 records). [2025-09-26T18:27:58.792205] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-26T18:27:58.792301] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUKB took 20.5s. Estimated remaining: 3h 45m 6s. Rate: 7.6 symbols/min [2025-09-26T18:27:58.970095] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:27:58.970266] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-09-26T18:27:58.970304] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-09-26T18:27:58.970454] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-26T18:27:58.970535] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-26T18:27:58.970600] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-09-26T18:27:58.970635] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-26T18:27:59.168010] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-26T18:27:59.348989] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:27:59.956708] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-26T18:28:00.064967] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T18:28:00.756817] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-26T18:28:01.334394] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T18:28:01.403862] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T18:28:01.556697] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-26T18:28:02.356724] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-26T18:28:02.925971] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T18:28:03.156725] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-26T18:28:03.266150] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T18:28:03.956728] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-26T18:28:04.255736] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T18:28:04.417123] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T18:28:04.756764] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-26T18:28:05.556736] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-26T18:28:05.739777] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:28:05.907153] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T18:28:06.356725] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-26T18:28:07.156778] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-26T18:28:07.326231] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T18:28:07.956769] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-26T18:28:08.007370] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T18:28:08.756720] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-26T18:28:09.106689] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T18:28:09.556722] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-26T18:28:09.794259] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T18:28:10.356755] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-26T18:28:10.506975] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T18:28:11.156715] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-26T18:28:11.565723] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T18:28:11.956773] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-26T18:28:12.463966] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-26T18:28:12.506351] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:28:12.756777] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-26T18:28:13.556777] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-26T18:28:13.869534] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T18:28:14.356711] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-26T18:28:14.655365] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T18:28:14.833898] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T18:28:15.156780] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-26T18:28:15.711699] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:28:15.956728] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-26T18:28:16.756780] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-26T18:28:17.060008] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T18:28:17.071251] [INFO ] [REMOTE ] DUK: Full fetch complete (77405 records). [2025-09-26T18:28:17.071431] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-26T18:28:17.514232] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-26T18:28:17.514383] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-26T18:28:17.515457] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-26T18:28:17.515549] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-26T18:28:17.541570] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T18:28:17.540303] [DEBUG] [LOCAL ] DUK: Trimmed 77405 records to 54238 (keeping 200 days of data) [2025-09-26T18:28:17.609934] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-26T18:28:17.908267] [DEBUG] [LOCAL ] DUK: Primary data saved (54238 records). [2025-09-26T18:28:17.908427] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-26T18:28:17.908519] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUK took 43.3s. Estimated remaining: 3h 45m 27s. Rate: 7.6 symbols/min [2025-09-26T18:28:18.104591] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:18.104904] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-09-26T18:28:18.105042] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-09-26T18:28:18.105303] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-26T18:28:18.105373] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-26T18:28:18.105454] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-09-26T18:28:18.105667] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-26T18:28:18.308865] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T18:28:18.357276] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-26T18:28:18.556341] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:18.902509] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T18:28:19.156727] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-26T18:28:19.956778] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-26T18:28:20.449625] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-26T18:28:20.756760] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-26T18:28:20.996749] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T18:28:21.556729] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-26T18:28:21.870403] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T18:28:22.356713] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-26T18:28:22.561370] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T18:28:22.570025] [INFO ] [REMOTE ] DVA: Full fetch complete (59731 records). [2025-09-26T18:28:22.570223] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-26T18:28:23.012087] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-26T18:28:23.012242] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-26T18:28:23.013107] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-26T18:28:23.013328] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-26T18:28:23.015082] [DEBUG] [LOCAL ] DVA: Trimmed 59731 records to 41877 (keeping 200 days of data) [2025-09-26T18:28:23.139140] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:28:23.157673] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-26T18:28:23.320005] [DEBUG] [LOCAL ] DVA: Primary data saved (41877 records). [2025-09-26T18:28:23.320166] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-26T18:28:23.320289] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DVA took 27.8s. Estimated remaining: 3h 45m 12s. Rate: 7.6 symbols/min [2025-09-26T18:28:23.539790] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:23.601494] [DEBUG] [LOCAL ] DXC: Loaded 50066 existing records from primary storage. [2025-09-26T18:28:23.601679] [INFO ] [MAIN ] DXC: Loaded 50066 existing records. [2025-09-26T18:28:23.792729] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:23.793067] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-26T18:28:23.793131] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-26T18:28:23.794488] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-26T18:28:23.794570] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-26T18:28:23.961863] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-26T18:28:24.205701] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:24.314072] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T18:28:24.679875] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T18:28:24.756740] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-26T18:28:25.556726] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-26T18:28:25.749266] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:28:25.760410] [INFO ] [REMOTE ] DV: Full fetch complete (73326 records). [2025-09-26T18:28:25.760628] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-26T18:28:26.210833] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-26T18:28:26.211001] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-26T18:28:26.212077] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-26T18:28:26.212179] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-26T18:28:26.214363] [DEBUG] [LOCAL ] DV: Trimmed 73326 records to 52038 (keeping 200 days of data) [2025-09-26T18:28:26.244847] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T18:28:26.357722] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-26T18:28:26.570829] [DEBUG] [LOCAL ] DV: Primary data saved (52038 records). [2025-09-26T18:28:26.570980] [INFO ] [MAIN ] DV: Full history saved. [2025-09-26T18:28:26.571073] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DV took 36.0s. Estimated remaining: 3h 44m 53s. Rate: 7.6 symbols/min [2025-09-26T18:28:26.762340] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:26.802041] [DEBUG] [LOCAL ] DXYZ: Loaded 36924 existing records from primary storage. [2025-09-26T18:28:26.802208] [INFO ] [MAIN ] DXYZ: Loaded 36924 existing records. [2025-09-26T18:28:27.004115] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:27.004367] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-26T18:28:27.004417] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-26T18:28:27.005375] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-26T18:28:27.005441] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-26T18:28:27.167186] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-26T18:28:27.410764] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:27.751787] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T18:28:27.956745] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-26T18:28:28.076686] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T18:28:28.756764] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-26T18:28:29.105102] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T18:28:29.556741] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-26T18:28:29.863235] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T18:28:30.356779] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-26T18:28:30.667621] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.71 seconds). [2025-09-26T18:28:31.156717] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-26T18:28:31.229701] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T18:28:31.454265] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T18:28:31.956727] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-26T18:28:32.756776] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-26T18:28:33.074852] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T18:28:33.167458] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T18:28:33.556732] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-26T18:28:34.356772] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-26T18:28:34.821229] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-26T18:28:34.832375] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-09-26T18:28:34.832538] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-26T18:28:35.164321] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-26T18:28:35.271250] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-26T18:28:35.271393] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-26T18:28:35.272386] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-26T18:28:35.272571] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-26T18:28:35.312762] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54479 (keeping 200 days of data) [2025-09-26T18:28:35.312583] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T18:28:35.700379] [DEBUG] [LOCAL ] DVN: Primary data saved (54479 records). [2025-09-26T18:28:35.700683] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-26T18:28:35.701071] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DVN took 36.9s. Estimated remaining: 3h 44m 48s. Rate: 7.6 symbols/min [2025-09-26T18:28:35.891791] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:35.932688] [DEBUG] [LOCAL ] DY: Loaded 29924 existing records from primary storage. [2025-09-26T18:28:35.932830] [INFO ] [MAIN ] DY: Loaded 29924 existing records. [2025-09-26T18:28:35.968167] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-26T18:28:36.134087] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:36.134386] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-26T18:28:36.134444] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-26T18:28:36.135347] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-26T18:28:36.135426] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-26T18:28:36.528299] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:36.663952] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:28:36.760352] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-26T18:28:36.766923] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-26T18:28:37.375030] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T18:28:37.556734] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-26T18:28:38.182696] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T18:28:38.356722] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-26T18:28:39.156733] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-26T18:28:39.257727] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T18:28:39.673504] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T18:28:39.956732] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-26T18:28:40.761836] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-26T18:28:40.784844] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T18:28:41.270774] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T18:28:41.556731] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-26T18:28:42.356727] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-26T18:28:42.873524] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-26T18:28:43.161877] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-26T18:28:43.185624] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T18:28:43.956707] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-26T18:28:44.389025] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T18:28:44.756739] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-26T18:28:44.787227] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:28:45.182454] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:28:45.556742] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-26T18:28:46.356733] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-26T18:28:46.554576] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:28:46.657050] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T18:28:46.668026] [INFO ] [REMOTE ] DX: Full fetch complete (75365 records). [2025-09-26T18:28:46.668190] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-26T18:28:47.107226] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-26T18:28:47.107411] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-26T18:28:47.108472] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-26T18:28:47.108542] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-26T18:28:47.110407] [DEBUG] [LOCAL ] DX: Trimmed 75365 records to 53228 (keeping 200 days of data) [2025-09-26T18:28:47.174693] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-26T18:28:47.462494] [DEBUG] [LOCAL ] DX: Primary data saved (53228 records). [2025-09-26T18:28:47.462675] [INFO ] [MAIN ] DX: Full history saved. [2025-09-26T18:28:47.462792] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DX took 29.6s. Estimated remaining: 3h 44m 50s. Rate: 7.6 symbols/min [2025-09-26T18:28:47.646436] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:47.682586] [DEBUG] [LOCAL ] E: Loaded 33635 existing records from primary storage. [2025-09-26T18:28:47.682795] [INFO ] [MAIN ] E: Loaded 33635 existing records. [2025-09-26T18:28:47.878725] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:47.879072] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-26T18:28:47.879139] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-26T18:28:47.880200] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-26T18:28:47.880267] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-26T18:28:47.961072] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-26T18:28:48.384444] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:48.410728] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T18:28:48.441162] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:28:48.756728] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-26T18:28:49.556735] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-26T18:28:49.967916] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-26T18:28:49.981227] [INFO ] [REMOTE ] DXC: Full fetch complete (68912 records). [2025-09-26T18:28:49.981412] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-26T18:28:50.332883] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:28:50.360032] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-26T18:28:50.454124] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-26T18:28:50.454211] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-26T18:28:50.455018] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-26T18:28:50.455085] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-26T18:28:50.456876] [DEBUG] [LOCAL ] DXC: Trimmed 68912 records to 50456 (keeping 200 days of data) [2025-09-26T18:28:50.771053] [DEBUG] [LOCAL ] DXC: Primary data saved (50456 records). [2025-09-26T18:28:50.771472] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-26T18:28:50.771596] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DXC took 27.5s. Estimated remaining: 3h 44m 30s. Rate: 7.6 symbols/min [2025-09-26T18:28:50.885338] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:28:51.007425] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:28:51.052906] [DEBUG] [LOCAL ] EAF: Loaded 43973 existing records from primary storage. [2025-09-26T18:28:51.053059] [INFO ] [MAIN ] EAF: Loaded 43973 existing records. [2025-09-26T18:28:51.162534] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-26T18:28:51.245747] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:28:51.246031] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-26T18:28:51.246095] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-26T18:28:51.247204] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-26T18:28:51.247283] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-26T18:28:51.633777] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:28:51.956711] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-26T18:28:52.337717] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T18:28:52.406497] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:28:52.756741] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-26T18:28:53.009406] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T18:28:53.556725] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-26T18:28:54.234297] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T18:28:54.356729] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-26T18:28:55.156714] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-26T18:28:55.258081] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:28:55.461849] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T18:28:55.956723] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-26T18:28:56.528308] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T18:28:56.756722] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-26T18:28:57.556702] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-26T18:28:58.014734] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-26T18:28:58.072615] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T18:28:58.356738] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-26T18:28:58.584201] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T18:28:59.156744] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-26T18:28:59.956782] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-26T18:29:00.081213] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T18:29:00.093634] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57854 records). [2025-09-26T18:29:00.093885] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-26T18:29:00.270803] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:29:00.692915] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-26T18:29:00.693034] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-26T18:29:00.693915] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-26T18:29:00.693985] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-26T18:29:00.697624] [DEBUG] [LOCAL ] DXYZ: Trimmed 57854 records to 37246 (keeping 200 days of data) [2025-09-26T18:29:00.761730] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-26T18:29:00.942414] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37246 records). [2025-09-26T18:29:00.942572] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-26T18:29:00.942687] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. DXYZ took 34.4s. Estimated remaining: 3h 44m 28s. Rate: 7.6 symbols/min [2025-09-26T18:29:01.129904] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:01.130279] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-09-26T18:29:01.130378] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-09-26T18:29:01.130824] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-26T18:29:01.131014] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-26T18:29:01.131194] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-09-26T18:29:01.131313] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-26T18:29:01.397625] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T18:29:01.561886] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-26T18:29:01.621060] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:02.099590] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T18:29:02.356757] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-26T18:29:02.442863] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T18:29:03.156725] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-26T18:29:03.764790] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:29:03.956751] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-26T18:29:04.206793] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T18:29:04.756770] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-26T18:29:05.530752] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:29:05.556677] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-26T18:29:06.361852] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-26T18:29:06.378854] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T18:29:06.386192] [INFO ] [REMOTE ] DY: Full fetch complete (44906 records). [2025-09-26T18:29:06.386354] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-26T18:29:06.796579] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-26T18:29:06.796720] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-26T18:29:06.797428] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-26T18:29:06.797544] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-26T18:29:06.798689] [DEBUG] [LOCAL ] DY: Trimmed 44906 records to 30160 (keeping 200 days of data) [2025-09-26T18:29:06.995682] [DEBUG] [LOCAL ] DY: Primary data saved (30160 records). [2025-09-26T18:29:06.995861] [INFO ] [MAIN ] DY: Full history saved. [2025-09-26T18:29:06.995987] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. DY took 31.3s. Estimated remaining: 3h 44m 15s. Rate: 7.6 symbols/min [2025-09-26T18:29:07.170672] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-26T18:29:07.192780] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:07.224072] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T18:29:07.261489] [DEBUG] [LOCAL ] EARN: Loaded 30444 existing records from primary storage. [2025-09-26T18:29:07.261668] [INFO ] [MAIN ] EARN: Loaded 30444 existing records. [2025-09-26T18:29:07.379830] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T18:29:07.470098] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:07.470390] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-26T18:29:07.470494] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-26T18:29:07.471396] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-26T18:29:07.471466] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-26T18:29:07.873624] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:07.956740] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-26T18:29:08.756780] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-26T18:29:08.914878] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T18:29:09.556717] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-26T18:29:09.772587] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T18:29:10.067450] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T18:29:10.356728] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-26T18:29:11.161831] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-26T18:29:11.177324] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T18:29:11.665224] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T18:29:11.769198] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T18:29:11.956738] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-26T18:29:12.756755] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-26T18:29:13.502459] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T18:29:13.502279] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T18:29:13.556722] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-26T18:29:14.356726] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-26T18:29:15.145689] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T18:29:15.156670] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-26T18:29:15.561905] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T18:29:15.956744] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-26T18:29:16.301755] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T18:29:16.344904] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-26T18:29:16.756770] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-26T18:29:17.556731] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-26T18:29:18.356709] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-26T18:29:18.396194] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T18:29:19.036268] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:29:19.095894] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-26T18:29:19.156759] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-26T18:29:19.956724] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-26T18:29:20.548561] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T18:29:20.554415] [INFO ] [REMOTE ] EAF: Full fetch complete (64391 records). [2025-09-26T18:29:20.554533] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-26T18:29:20.762180] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-26T18:29:20.950736] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-26T18:29:20.950826] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-26T18:29:20.951609] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-26T18:29:20.951698] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-26T18:29:20.953090] [DEBUG] [LOCAL ] EAF: Trimmed 64391 records to 44158 (keeping 200 days of data) [2025-09-26T18:29:21.209865] [DEBUG] [LOCAL ] EAF: Primary data saved (44158 records). [2025-09-26T18:29:21.210013] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-26T18:29:21.210108] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. EAF took 30.4s. Estimated remaining: 3h 44m 23s. Rate: 7.6 symbols/min [2025-09-26T18:29:21.374380] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-26T18:29:21.414700] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:21.442785] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T18:29:21.498038] [DEBUG] [LOCAL ] EAT: Loaded 50179 existing records from primary storage. [2025-09-26T18:29:21.498197] [INFO ] [MAIN ] EAT: Loaded 50179 existing records. [2025-09-26T18:29:21.565783] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-26T18:29:21.699156] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:21.699506] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-26T18:29:21.699570] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-26T18:29:21.700968] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-26T18:29:21.701031] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-26T18:29:22.079346] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:22.176907] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T18:29:22.356731] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-26T18:29:23.156773] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-26T18:29:23.701501] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T18:29:23.709150] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T18:29:23.956736] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-26T18:29:24.581545] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T18:29:24.756773] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-26T18:29:25.420085] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-26T18:29:25.421689] [INFO ] [REMOTE ] EAI: Full fetch complete (6148 records). [2025-09-26T18:29:25.421776] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-26T18:29:25.561838] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-26T18:29:25.822076] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-26T18:29:25.822168] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-26T18:29:25.822389] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-26T18:29:25.822451] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-26T18:29:25.822926] [DEBUG] [LOCAL ] EAI: Trimmed 6148 records to 4008 (keeping 200 days of data) [2025-09-26T18:29:25.849125] [DEBUG] [LOCAL ] EAI: Primary data saved (4008 records). [2025-09-26T18:29:25.849287] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-26T18:29:25.849372] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAI took 24.9s. Estimated remaining: 3h 44m 7s. Rate: 7.6 symbols/min [2025-09-26T18:29:26.029154] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:26.072077] [DEBUG] [LOCAL ] EB: Loaded 37828 existing records from primary storage. [2025-09-26T18:29:26.072239] [INFO ] [MAIN ] EB: Loaded 37828 existing records. [2025-09-26T18:29:26.262192] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:26.262464] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-26T18:29:26.262514] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-26T18:29:26.263431] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-26T18:29:26.263495] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-26T18:29:26.361900] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-26T18:29:26.669093] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:27.156703] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-26T18:29:27.440437] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T18:29:27.493767] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T18:29:27.956767] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-26T18:29:28.526473] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T18:29:28.756747] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-26T18:29:29.499006] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T18:29:29.556688] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-26T18:29:29.605153] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T18:29:30.356727] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-26T18:29:31.156695] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-26T18:29:31.274850] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T18:29:31.522234] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T18:29:31.528416] [INFO ] [REMOTE ] E: Full fetch complete (48384 records). [2025-09-26T18:29:31.528556] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-26T18:29:31.951062] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-26T18:29:31.951152] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-26T18:29:31.951845] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-26T18:29:31.951912] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-26T18:29:31.953011] [DEBUG] [LOCAL ] E: Trimmed 48384 records to 33848 (keeping 200 days of data) [2025-09-26T18:29:31.956720] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-26T18:29:32.178969] [DEBUG] [LOCAL ] E: Primary data saved (33848 records). [2025-09-26T18:29:32.179156] [INFO ] [MAIN ] E: Full history saved. [2025-09-26T18:29:32.179279] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. E took 44.7s. Estimated remaining: 3h 43m 55s. Rate: 7.6 symbols/min [2025-09-26T18:29:32.728639] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:29:32.756695] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-26T18:29:33.556713] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-26T18:29:33.991591] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T18:29:34.026826] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:29:34.356758] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-26T18:29:35.124740] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T18:29:35.156724] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-26T18:29:35.956756] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-26T18:29:36.418658] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T18:29:36.693991] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T18:29:36.756751] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-26T18:29:36.958407] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T18:29:36.963165] [INFO ] [REMOTE ] EARN: Full fetch complete (46087 records). [2025-09-26T18:29:36.963270] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-26T18:29:37.362431] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-26T18:29:37.362570] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-26T18:29:37.363472] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-26T18:29:37.363556] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-26T18:29:37.365202] [DEBUG] [LOCAL ] EARN: Trimmed 46087 records to 30576 (keeping 200 days of data) [2025-09-26T18:29:37.548111] [DEBUG] [LOCAL ] EARN: Primary data saved (30576 records). [2025-09-26T18:29:37.548277] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-26T18:29:37.548455] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EARN took 30.6s. Estimated remaining: 3h 43m 40s. Rate: 7.6 symbols/min [2025-09-26T18:29:37.556754] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-26T18:29:38.323034] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T18:29:38.356679] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-26T18:29:38.770963] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T18:29:39.156721] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-26T18:29:39.861234] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T18:29:39.956729] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-26T18:29:40.127525] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:29:40.756744] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-26T18:29:41.446255] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:29:41.556755] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-26T18:29:41.677897] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T18:29:42.356774] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-26T18:29:43.111833] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T18:29:43.156692] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-26T18:29:44.131199] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T18:29:44.140545] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-26T18:29:45.158335] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T18:29:45.168715] [INFO ] [REMOTE ] EAT: Full fetch complete (71813 records). [2025-09-26T18:29:45.168848] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-26T18:29:45.520099] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T18:29:45.565999] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-26T18:29:45.651573] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-26T18:29:45.651841] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-26T18:29:45.653254] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-26T18:29:45.653335] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-26T18:29:45.655290] [DEBUG] [LOCAL ] EAT: Trimmed 71813 records to 50542 (keeping 200 days of data) [2025-09-26T18:29:45.977267] [DEBUG] [LOCAL ] EAT: Primary data saved (50542 records). [2025-09-26T18:29:45.977451] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-26T18:29:45.977583] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EAT took 24.8s. Estimated remaining: 3h 43m 34s. Rate: 7.6 symbols/min [2025-09-26T18:29:47.151271] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T18:29:47.157961] [INFO ] [REMOTE ] EB: Full fetch complete (56310 records). [2025-09-26T18:29:47.158132] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-26T18:29:47.159039] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:29:47.159183] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:29:47.159263] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:29:47.159353] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-26T18:29:47.159463] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-09-26T18:29:47.159521] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-09-26T18:29:47.160013] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-09-26T18:29:47.160115] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EB took 21.3s. Estimated remaining: 3h 43m 9s. Rate: 7.6 symbols/min [2025-09-26T18:29:47.792297] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:47.887323] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:47.957127] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:47.970694] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:29:47.993807] [DEBUG] [LOCAL ] EBF: Loaded 19533 existing records from primary storage. [2025-09-26T18:29:47.994034] [INFO ] [MAIN ] EBF: Loaded 19533 existing records. [2025-09-26T18:29:48.175697] [DEBUG] [LOCAL ] EBR: Loaded 43438 existing records from primary storage. [2025-09-26T18:29:48.176716] [INFO ] [MAIN ] EBR: Loaded 43438 existing records. [2025-09-26T18:29:48.258220] [DEBUG] [LOCAL ] EBS: Loaded 47102 existing records from primary storage. [2025-09-26T18:29:48.315402] [INFO ] [MAIN ] EBS: Loaded 47102 existing records. [2025-09-26T18:29:48.347615] [DEBUG] [LOCAL ] EC: Loaded 49689 existing records from primary storage. [2025-09-26T18:29:48.367582] [INFO ] [MAIN ] EC: Loaded 49689 existing records. [2025-09-26T18:29:48.411377] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:48.534189] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-26T18:29:48.557337] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-26T18:29:48.704276] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-26T18:29:48.734259] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-26T18:29:48.819517] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:48.998441] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:48.984275] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-26T18:29:49.014693] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-26T18:29:49.031116] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-26T18:29:49.111376] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-26T18:29:49.136191] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-26T18:29:49.158419] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-26T18:29:49.180388] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-26T18:29:49.180570] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-26T18:29:49.228523] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:29:49.365155] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-26T18:29:49.422560] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-26T18:29:49.523730] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-26T18:29:49.534548] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-26T18:29:50.194415] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:50.227497] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-26T18:29:50.526978] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:50.536341] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-26T18:29:50.541056] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:50.556189] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-26T18:29:50.676924] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:29:50.677301] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-26T18:29:51.224257] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T18:29:51.228270] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-26T18:29:51.955638] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-26T18:29:51.960056] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-26T18:29:52.121916] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:29:52.133456] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-26T18:29:52.199376] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T18:29:52.211043] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-26T18:29:52.263704] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T18:29:52.274794] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-26T18:29:52.752073] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T18:29:52.759619] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-26T18:29:53.459605] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T18:29:53.560427] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-26T18:29:53.565920] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:29:53.599499] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T18:29:53.952321] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:29:54.356742] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-26T18:29:54.964451] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:29:55.141313] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T18:29:55.156676] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-26T18:29:55.956694] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-26T18:29:56.317827] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:29:56.756726] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-26T18:29:57.324791] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:29:57.467287] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T18:29:57.556728] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-26T18:29:58.356739] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-26T18:29:58.906831] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T18:29:59.156719] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-26T18:29:59.815434] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:29:59.956723] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-26T18:30:00.557422] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:30:00.756746] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-26T18:30:01.556745] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-26T18:30:01.875587] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T18:30:02.356796] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-26T18:30:02.591575] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T18:30:02.899968] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:30:03.156764] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-26T18:30:03.956718] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-26T18:30:04.425710] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T18:30:04.756781] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-26T18:30:05.111372] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T18:30:05.476709] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-26T18:30:05.556720] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-26T18:30:06.304729] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T18:30:06.356683] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-26T18:30:06.372511] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-26T18:30:06.376281] [INFO ] [REMOTE ] EBF: Full fetch complete (27269 records). [2025-09-26T18:30:06.376366] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-26T18:30:06.376969] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:30:06.377057] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:30:06.377104] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:30:06.377207] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-26T18:30:06.377322] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-09-26T18:30:06.377394] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-09-26T18:30:06.377893] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-09-26T18:30:06.378027] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. EBF took 19.2s. Estimated remaining: 3h 43m 29s. Rate: 7.6 symbols/min [2025-09-26T18:30:06.567736] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:06.567942] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-09-26T18:30:06.568015] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-09-26T18:30:06.568264] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-26T18:30:06.568315] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-26T18:30:06.568387] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-09-26T18:30:06.568432] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-26T18:30:06.958541] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:07.156773] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-26T18:30:07.956727] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-26T18:30:08.111460] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:30:08.494324] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T18:30:08.756784] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-26T18:30:09.392111] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T18:30:09.556733] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-26T18:30:10.356760] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-26T18:30:10.685807] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T18:30:10.755189] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T18:30:11.156755] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-26T18:30:11.913369] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T18:30:11.956776] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-26T18:30:12.657124] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:30:12.756862] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-26T18:30:12.861238] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:30:13.556742] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-26T18:30:14.005073] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T18:30:14.356784] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-26T18:30:14.563926] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T18:30:15.156785] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-26T18:30:15.956762] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-26T18:30:16.096890] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T18:30:16.106732] [INFO ] [REMOTE ] EC: Full fetch complete (71622 records). [2025-09-26T18:30:16.106955] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-26T18:30:16.107967] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:30:16.108111] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:30:16.108201] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:30:16.108290] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-26T18:30:16.108435] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-09-26T18:30:16.108498] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-09-26T18:30:16.108952] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-09-26T18:30:16.109074] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. EC took 28.9s. Estimated remaining: 3h 43m 26s. Rate: 7.6 symbols/min [2025-09-26T18:30:16.303877] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:16.323296] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T18:30:16.370499] [DEBUG] [LOCAL ] ECC: Loaded 43726 existing records from primary storage. [2025-09-26T18:30:16.370674] [INFO ] [MAIN ] ECC: Loaded 43726 existing records. [2025-09-26T18:30:16.583835] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:30:16.584123] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-26T18:30:16.584182] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-26T18:30:16.585510] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-26T18:30:16.585579] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-26T18:30:16.761952] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-26T18:30:17.085022] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:17.496704] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T18:30:17.556737] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-26T18:30:18.356760] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-26T18:30:19.156774] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-26T18:30:19.625907] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:30:19.737224] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-09-26T18:30:19.956752] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-26T18:30:20.243958] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-26T18:30:20.718632] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T18:30:20.756713] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-26T18:30:20.839327] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T18:30:21.556739] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-26T18:30:21.920281] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T18:30:22.356759] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-26T18:30:22.917762] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T18:30:23.156784] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-26T18:30:23.500762] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:30:23.956736] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-26T18:30:24.756765] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-26T18:30:24.840532] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:30:25.499487] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T18:30:25.556742] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-26T18:30:26.153051] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:30:26.356739] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-26T18:30:26.640534] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:30:27.156773] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-26T18:30:27.946325] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T18:30:27.955724] [INFO ] [REMOTE ] EBR: Full fetch complete (62757 records). [2025-09-26T18:30:27.955899] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-26T18:30:27.956730] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-26T18:30:28.442331] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-26T18:30:28.442526] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-26T18:30:28.443439] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-26T18:30:28.443576] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-26T18:30:28.445695] [DEBUG] [LOCAL ] EBR: Trimmed 62757 records to 43731 (keeping 200 days of data) [2025-09-26T18:30:28.594141] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T18:30:28.756870] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-26T18:30:28.762453] [DEBUG] [LOCAL ] EBR: Primary data saved (43731 records). [2025-09-26T18:30:28.762614] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-26T18:30:28.762762] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EBR took 41.6s. Estimated remaining: 3h 43m 29s. Rate: 7.6 symbols/min [2025-09-26T18:30:28.954404] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:28.954601] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-26T18:30:28.954662] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-26T18:30:28.954833] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-26T18:30:28.954878] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-26T18:30:28.954922] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-26T18:30:28.954958] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-26T18:30:29.362310] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:29.380276] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:30:29.388384] [INFO ] [REMOTE ] ECAT: Full fetch complete (42746 records). [2025-09-26T18:30:29.388545] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-26T18:30:29.568253] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-26T18:30:29.821426] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-26T18:30:29.821524] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-26T18:30:29.822308] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-26T18:30:29.822377] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-26T18:30:29.823695] [DEBUG] [LOCAL ] ECAT: Trimmed 42746 records to 30092 (keeping 200 days of data) [2025-09-26T18:30:30.016985] [DEBUG] [LOCAL ] ECAT: Primary data saved (30092 records). [2025-09-26T18:30:30.017194] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-26T18:30:30.017299] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. ECAT took 23.6s. Estimated remaining: 3h 43m 5s. Rate: 7.6 symbols/min [2025-09-26T18:30:30.202931] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:30.203147] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-26T18:30:30.203203] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-26T18:30:30.203346] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-26T18:30:30.203389] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-26T18:30:30.203431] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-26T18:30:30.203463] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-26T18:30:30.361446] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-26T18:30:30.615493] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:30.718272] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:30:30.731165] [INFO ] [REMOTE ] EBS: Full fetch complete (67358 records). [2025-09-26T18:30:30.731303] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-26T18:30:30.979746] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T18:30:31.159606] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-26T18:30:31.205577] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-26T18:30:31.205797] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-26T18:30:31.206836] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-26T18:30:31.206909] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-26T18:30:31.209003] [DEBUG] [LOCAL ] EBS: Trimmed 67358 records to 47455 (keeping 200 days of data) [2025-09-26T18:30:31.441863] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T18:30:31.529407] [DEBUG] [LOCAL ] EBS: Primary data saved (47455 records). [2025-09-26T18:30:31.529575] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-26T18:30:31.529701] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. EBS took 44.4s. Estimated remaining: 3h 42m 41s. Rate: 7.6 symbols/min [2025-09-26T18:30:31.623862] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T18:30:31.724530] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:31.724755] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-26T18:30:31.724805] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-26T18:30:31.724981] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-26T18:30:31.725025] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-26T18:30:31.725069] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-26T18:30:31.725108] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-26T18:30:31.961967] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-26T18:30:32.122871] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:32.756768] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-26T18:30:33.207640] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T18:30:33.557562] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T18:30:33.557700] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-26T18:30:33.965883] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-26T18:30:34.356735] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-26T18:30:35.156740] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-26T18:30:35.666130] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-26T18:30:35.697627] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:30:35.956740] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-26T18:30:36.756732] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-26T18:30:37.212787] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T18:30:37.556733] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-26T18:30:37.841974] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T18:30:37.898265] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T18:30:38.356791] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-26T18:30:38.633633] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-26T18:30:39.156773] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-26T18:30:39.602348] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T18:30:39.956788] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-26T18:30:40.213541] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-26T18:30:40.756780] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-26T18:30:41.556753] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-26T18:30:42.029078] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T18:30:42.356806] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-26T18:30:42.588546] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T18:30:42.597839] [INFO ] [REMOTE ] ECC: Full fetch complete (60950 records). [2025-09-26T18:30:42.598033] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-26T18:30:42.689830] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-26T18:30:43.028712] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-26T18:30:43.028822] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-26T18:30:43.029704] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-26T18:30:43.029774] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-26T18:30:43.031235] [DEBUG] [LOCAL ] ECC: Trimmed 60950 records to 44025 (keeping 200 days of data) [2025-09-26T18:30:43.203134] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-26T18:30:43.304038] [DEBUG] [LOCAL ] ECC: Primary data saved (44025 records). [2025-09-26T18:30:43.304205] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-26T18:30:43.304306] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECC took 27.2s. Estimated remaining: 3h 42m 43s. Rate: 7.6 symbols/min [2025-09-26T18:30:43.498847] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:43.499045] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-26T18:30:43.499083] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-26T18:30:43.499237] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-26T18:30:43.499283] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-26T18:30:43.499329] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-26T18:30:43.499364] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-26T18:30:43.668406] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T18:30:43.892897] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:43.956773] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-26T18:30:44.233682] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-26T18:30:44.756757] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-26T18:30:45.194987] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-26T18:30:45.556750] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-26T18:30:46.302892] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T18:30:46.356799] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-26T18:30:46.711122] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T18:30:47.156744] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-26T18:30:47.758500] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T18:30:47.956750] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-26T18:30:48.506704] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:30:48.756759] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-26T18:30:49.188346] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-26T18:30:49.556787] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-26T18:30:49.990958] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T18:30:49.991800] [INFO ] [REMOTE ] ECCC: Full fetch complete (1284 records). [2025-09-26T18:30:49.991870] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-26T18:30:50.232296] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-26T18:30:50.232540] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:30:50.232670] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:30:50.232773] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-26T18:30:50.232850] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-26T18:30:50.232888] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-26T18:30:50.232929] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-26T18:30:50.233012] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCC took 21.5s. Estimated remaining: 3h 42m 32s. Rate: 7.6 symbols/min [2025-09-26T18:30:50.359253] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-26T18:30:50.446091] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:30:50.446672] [DEBUG] [LOCAL ] ECG: No existing data file found in primary storage. [2025-09-26T18:30:50.446920] [WARN ] [MAIN ] ECG: No existing data found, performing full refresh instead. [2025-09-26T18:30:50.447180] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-26T18:30:50.447247] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-26T18:30:50.447298] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-09-26T18:30:50.447334] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-26T18:30:50.761546] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T18:30:50.841689] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:30:51.156738] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-26T18:30:51.610818] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T18:30:51.956739] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-26T18:30:52.756729] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-26T18:30:53.476145] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T18:30:53.526878] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T18:30:53.556756] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-26T18:30:54.180459] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T18:30:54.356736] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-26T18:30:54.801579] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-26T18:30:55.156720] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-26T18:30:55.956773] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-26T18:30:56.603850] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T18:30:56.644103] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:30:56.756746] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-26T18:30:57.556736] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-26T18:30:58.156814] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T18:30:58.191443] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T18:30:58.356733] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-26T18:30:58.880632] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T18:30:59.156719] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-26T18:30:59.956752] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-26T18:31:00.642537] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:31:00.682937] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T18:31:00.756742] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-26T18:31:01.209608] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T18:31:01.556760] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-26T18:31:01.932314] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-26T18:31:02.356740] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-26T18:31:02.837319] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T18:31:03.156798] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-26T18:31:03.613524] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-26T18:31:03.956753] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-26T18:31:04.429251] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T18:31:04.756768] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-26T18:31:05.105819] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T18:31:05.556734] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-26T18:31:05.921558] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-26T18:31:06.356755] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-26T18:31:07.028989] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-26T18:31:07.029957] [INFO ] [REMOTE ] ECCW: Full fetch complete (1420 records). [2025-09-26T18:31:07.030074] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-26T18:31:07.161869] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-26T18:31:07.240006] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-26T18:31:07.240277] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:31:07.240371] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:31:07.240474] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-26T18:31:07.240562] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-26T18:31:07.240614] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-26T18:31:07.240723] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-26T18:31:07.240871] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCW took 35.7s. Estimated remaining: 3h 42m 47s. Rate: 7.6 symbols/min [2025-09-26T18:31:07.431918] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:07.432254] [DEBUG] [LOCAL ] ECL: No existing data file found in primary storage. [2025-09-26T18:31:07.432308] [WARN ] [MAIN ] ECL: No existing data found, performing full refresh instead. [2025-09-26T18:31:07.432553] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-26T18:31:07.432620] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-26T18:31:07.432715] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-09-26T18:31:07.432759] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-26T18:31:07.890127] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:07.956741] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-26T18:31:08.756719] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-26T18:31:08.943777] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T18:31:09.400578] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T18:31:09.402181] [INFO ] [REMOTE ] ECCU: Full fetch complete (4460 records). [2025-09-26T18:31:09.402278] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-26T18:31:09.561843] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-26T18:31:09.617849] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-26T18:31:09.618673] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:31:09.618799] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:31:09.618870] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-26T18:31:09.619477] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-26T18:31:09.619637] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-26T18:31:09.619737] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-26T18:31:09.619806] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECCU took 39.6s. Estimated remaining: 3h 42m 25s. Rate: 7.6 symbols/min [2025-09-26T18:31:09.817904] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:09.853578] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T18:31:09.880673] [DEBUG] [LOCAL ] ECO: Loaded 18686 existing records from primary storage. [2025-09-26T18:31:09.880834] [INFO ] [MAIN ] ECO: Loaded 18686 existing records. [2025-09-26T18:31:10.079212] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:10.079523] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-26T18:31:10.079595] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-26T18:31:10.080795] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-26T18:31:10.080864] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-26T18:31:10.169344] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T18:31:10.198074] [INFO ] [REMOTE ] ECCX: Full fetch complete (1503 records). [2025-09-26T18:31:10.201927] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-26T18:31:10.361879] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-26T18:31:10.643454] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-26T18:31:10.644152] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:31:10.665097] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:31:10.690089] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-26T18:31:10.690721] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-26T18:31:10.705509] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-26T18:31:10.706877] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-26T18:31:10.707014] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECCX took 27.4s. Estimated remaining: 3h 42m 0s. Rate: 7.6 symbols/min [2025-09-26T18:31:10.735519] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:10.912364] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:10.970781] [DEBUG] [LOCAL ] ECVT: Loaded 43297 existing records from primary storage. [2025-09-26T18:31:10.970947] [INFO ] [MAIN ] ECVT: Loaded 43297 existing records. [2025-09-26T18:31:11.164431] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-26T18:31:11.164682] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:11.165932] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-26T18:31:11.165990] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-26T18:31:11.167352] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-26T18:31:11.167417] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-26T18:31:11.555412] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:11.956755] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-26T18:31:12.112344] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T18:31:12.279668] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T18:31:12.756763] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-26T18:31:13.191666] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:31:13.556728] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-26T18:31:14.134039] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T18:31:14.356800] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-26T18:31:14.363225] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T18:31:15.156769] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-26T18:31:15.956765] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-26T18:31:16.335319] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T18:31:16.367912] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T18:31:16.756779] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-26T18:31:17.382016] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T18:31:17.556772] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-26T18:31:18.356745] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-26T18:31:18.919327] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T18:31:18.979324] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T18:31:19.156781] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-26T18:31:19.393500] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T18:31:19.956738] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-26T18:31:20.304481] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T18:31:20.728016] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T18:31:20.756764] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-26T18:31:21.556724] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-26T18:31:22.131590] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T18:31:22.356778] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-26T18:31:23.079021] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:31:23.156713] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-26T18:31:23.748677] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T18:31:23.755140] [INFO ] [REMOTE ] ECG: Full fetch complete (51394 records). [2025-09-26T18:31:23.755282] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-26T18:31:23.964191] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-26T18:31:24.161903] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-26T18:31:24.161995] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-26T18:31:24.162725] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-26T18:31:24.162794] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-26T18:31:24.164054] [DEBUG] [LOCAL ] ECG: Trimmed 51394 records to 34619 (keeping 200 days of data) [2025-09-26T18:31:24.397731] [DEBUG] [LOCAL ] ECG: Primary data saved (34619 records). [2025-09-26T18:31:24.397915] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-26T18:31:24.398070] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECG took 34.2s. Estimated remaining: 3h 42m 7s. Rate: 7.6 symbols/min [2025-09-26T18:31:24.584206] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:24.643782] [DEBUG] [LOCAL ] ED: Loaded 53169 existing records from primary storage. [2025-09-26T18:31:24.643926] [INFO ] [MAIN ] ED: Loaded 53169 existing records. [2025-09-26T18:31:24.767132] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-26T18:31:24.842361] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:24.842694] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-26T18:31:24.842921] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-26T18:31:24.853532] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-26T18:31:24.873468] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-26T18:31:24.875920] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:31:25.084567] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:31:25.324692] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:25.556722] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-26T18:31:26.356743] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-26T18:31:26.504367] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:31:26.901589] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:31:27.156731] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-26T18:31:27.171285] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T18:31:27.956762] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-26T18:31:28.766974] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-26T18:31:28.772845] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T18:31:28.814756] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T18:31:29.556726] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-26T18:31:30.160347] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:31:30.356775] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-26T18:31:31.156753] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-26T18:31:31.201120] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:31:31.211684] [INFO ] [REMOTE ] ECL: Full fetch complete (67826 records). [2025-09-26T18:31:31.211894] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-26T18:31:31.621105] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-26T18:31:31.621231] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-26T18:31:31.622755] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-26T18:31:31.622838] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-26T18:31:31.627231] [DEBUG] [LOCAL ] ECL: Trimmed 67826 records to 47489 (keeping 200 days of data) [2025-09-26T18:31:31.968860] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-26T18:31:32.002609] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:31:32.114825] [DEBUG] [LOCAL ] ECL: Primary data saved (47489 records). [2025-09-26T18:31:32.115035] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-26T18:31:32.115132] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECL took 24.9s. Estimated remaining: 3h 41m 58s. Rate: 7.6 symbols/min [2025-09-26T18:31:32.296140] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:32.325630] [DEBUG] [LOCAL ] EDD: Loaded 27227 existing records from primary storage. [2025-09-26T18:31:32.325866] [INFO ] [MAIN ] EDD: Loaded 27227 existing records. [2025-09-26T18:31:32.528413] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T18:31:32.570534] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:32.570892] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-26T18:31:32.570947] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-26T18:31:32.571892] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-26T18:31:32.571955] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-26T18:31:32.757875] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-26T18:31:32.945417] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:32.962177] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T18:31:33.556750] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-26T18:31:34.325071] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T18:31:34.356741] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-26T18:31:34.525049] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T18:31:35.043185] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-26T18:31:35.156769] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-26T18:31:35.956780] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-26T18:31:36.756775] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-26T18:31:36.853033] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T18:31:37.209453] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T18:31:37.556748] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-26T18:31:37.684903] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:31:38.356788] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-26T18:31:38.927199] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:31:39.156816] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-26T18:31:39.664560] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T18:31:39.956773] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-26T18:31:40.374015] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:31:40.756772] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-26T18:31:41.099685] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T18:31:41.103863] [INFO ] [REMOTE ] ECO: Full fetch complete (29119 records). [2025-09-26T18:31:41.103976] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-26T18:31:41.104527] [FATAL] [VALIDATOR ] ECO: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:31:41.104618] [FATAL] [MAIN ] ECO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:31:41.104706] [WARN ] [MAIN ] ECO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:31:41.104759] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-26T18:31:41.104822] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-09-26T18:31:41.104860] [INFO ] [LOCAL ] ECO: Starting deletion of derivative data. [2025-09-26T18:31:41.105330] [DEBUG] [LOCAL ] ECO: Deleted derivative data file. [2025-09-26T18:31:41.105443] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. ECO took 31.5s. Estimated remaining: 3h 41m 53s. Rate: 7.6 symbols/min [2025-09-26T18:31:41.298176] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:41.312827] [DEBUG] [LOCAL ] EDF: Loaded 13569 existing records from primary storage. [2025-09-26T18:31:41.312980] [INFO ] [MAIN ] EDF: Loaded 13569 existing records. [2025-09-26T18:31:41.521958] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:31:41.522331] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-26T18:31:41.522405] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-26T18:31:41.523050] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-26T18:31:41.523143] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-26T18:31:41.560368] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-26T18:31:41.754044] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:31:41.960234] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:42.356726] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-26T18:31:43.156715] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-26T18:31:43.390511] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T18:31:43.520059] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T18:31:43.956727] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-26T18:31:44.351737] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T18:31:44.756740] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-26T18:31:44.947974] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T18:31:45.556744] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-26T18:31:46.191805] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T18:31:46.204226] [INFO ] [REMOTE ] ECVT: Full fetch complete (59971 records). [2025-09-26T18:31:46.204435] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-26T18:31:46.370543] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-26T18:31:46.643349] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-26T18:31:46.643452] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-26T18:31:46.644251] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-26T18:31:46.644320] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-26T18:31:46.645841] [DEBUG] [LOCAL ] ECVT: Trimmed 59971 records to 43587 (keeping 200 days of data) [2025-09-26T18:31:46.873798] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:31:46.935099] [DEBUG] [LOCAL ] ECVT: Primary data saved (43587 records). [2025-09-26T18:31:46.935250] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-26T18:31:46.935344] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ECVT took 36.2s. Estimated remaining: 3h 41m 40s. Rate: 7.6 symbols/min [2025-09-26T18:31:47.148051] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:47.148365] [DEBUG] [LOCAL ] EDN: No existing data file found in primary storage. [2025-09-26T18:31:47.148424] [WARN ] [MAIN ] EDN: No existing data found, performing full refresh instead. [2025-09-26T18:31:47.148589] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-26T18:31:47.148665] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-26T18:31:47.148736] [DEBUG] [LOCAL ] EDN: No primary data file found to delete. [2025-09-26T18:31:47.148771] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-26T18:31:47.161852] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-26T18:31:47.468490] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T18:31:47.581667] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:31:47.956738] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-26T18:31:48.756707] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-26T18:31:48.816511] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T18:31:49.156125] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-26T18:31:49.556724] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-26T18:31:49.660720] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T18:31:50.356730] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-26T18:31:51.156730] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-26T18:31:51.631451] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T18:31:51.818311] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T18:31:51.911705] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-26T18:31:51.956744] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-26T18:31:52.756798] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-26T18:31:52.942240] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:31:53.556743] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-26T18:31:54.315477] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T18:31:54.356680] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-26T18:31:54.574939] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T18:31:55.008914] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T18:31:55.156768] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-26T18:31:55.956710] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-26T18:31:56.340977] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T18:31:56.477519] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T18:31:56.756735] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-26T18:31:57.556732] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-26T18:31:57.963439] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T18:31:58.356761] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-26T18:31:58.998722] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T18:31:59.156711] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-26T18:31:59.216844] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T18:31:59.223951] [INFO ] [REMOTE ] EDF: Full fetch complete (21004 records). [2025-09-26T18:31:59.224072] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-26T18:31:59.646304] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-26T18:31:59.646397] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-26T18:31:59.646893] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-26T18:31:59.646958] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-26T18:31:59.647743] [DEBUG] [LOCAL ] EDF: Trimmed 21004 records to 13627 (keeping 200 days of data) [2025-09-26T18:31:59.743074] [DEBUG] [LOCAL ] EDF: Primary data saved (13627 records). [2025-09-26T18:31:59.743232] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-26T18:31:59.743360] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDF took 18.6s. Estimated remaining: 3h 41m 44s. Rate: 7.6 symbols/min [2025-09-26T18:31:59.963203] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:31:59.961296] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-26T18:32:00.025718] [DEBUG] [LOCAL ] EDU: Loaded 45333 existing records from primary storage. [2025-09-26T18:32:00.025889] [INFO ] [MAIN ] EDU: Loaded 45333 existing records. [2025-09-26T18:32:00.225991] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:32:00.226291] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-26T18:32:00.226355] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-26T18:32:00.226614] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-26T18:32:00.226717] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-26T18:32:00.658806] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:00.737135] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T18:32:00.764040] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-26T18:32:00.769203] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T18:32:01.556743] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-26T18:32:02.356771] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-26T18:32:02.474332] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T18:32:03.156761] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-26T18:32:03.412209] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T18:32:03.418432] [INFO ] [REMOTE ] EDD: Full fetch complete (39019 records). [2025-09-26T18:32:03.418573] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-26T18:32:03.932076] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-26T18:32:03.958216] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-26T18:32:03.980568] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-26T18:32:03.981954] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-26T18:32:03.982861] [INFO ] [REMOTE ] ED: Full fetch complete (76346 records). [2025-09-26T18:32:03.982707] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-26T18:32:03.983220] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-26T18:32:03.983341] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-26T18:32:04.026986] [DEBUG] [LOCAL ] EDD: Trimmed 39019 records to 27470 (keeping 200 days of data) [2025-09-26T18:32:04.299253] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:32:04.581920] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-26T18:32:04.582326] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-26T18:32:04.584070] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-26T18:32:04.584479] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-26T18:32:04.589893] [DEBUG] [LOCAL ] ED: Trimmed 76346 records to 53539 (keeping 200 days of data) [2025-09-26T18:32:04.757203] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-26T18:32:04.777293] [DEBUG] [LOCAL ] EDD: Primary data saved (27470 records). [2025-09-26T18:32:04.778175] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-26T18:32:04.778308] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EDD took 32.7s. Estimated remaining: 3h 41m 29s. Rate: 7.6 symbols/min [2025-09-26T18:32:04.979955] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:04.980685] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-09-26T18:32:04.980981] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-09-26T18:32:04.981797] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-26T18:32:04.982102] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-26T18:32:04.982685] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-09-26T18:32:04.982969] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-26T18:32:05.532287] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:05.556900] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-26T18:32:05.662394] [DEBUG] [LOCAL ] ED: Primary data saved (53539 records). [2025-09-26T18:32:05.662574] [INFO ] [MAIN ] ED: Full history saved. [2025-09-26T18:32:05.662696] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. ED took 41.3s. Estimated remaining: 3h 41m 4s. Rate: 7.6 symbols/min [2025-09-26T18:32:05.821803] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T18:32:05.921729] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:05.919690] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T18:32:05.926537] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-09-26T18:32:05.926991] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-09-26T18:32:05.927225] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-26T18:32:05.927328] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-26T18:32:05.927395] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-26T18:32:05.927431] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-26T18:32:06.338435] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:06.356771] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-26T18:32:06.583258] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T18:32:07.156760] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-26T18:32:07.743449] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T18:32:07.949164] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T18:32:07.956682] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-26T18:32:08.756771] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-26T18:32:09.556722] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-26T18:32:09.604944] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T18:32:10.039179] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:32:10.356694] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-26T18:32:10.601824] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T18:32:11.156716] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-26T18:32:11.804920] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:32:11.956796] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-26T18:32:11.972554] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T18:32:12.756749] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-26T18:32:13.453961] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T18:32:13.456122] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T18:32:13.556746] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-26T18:32:14.356727] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-26T18:32:14.633391] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T18:32:14.758828] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-26T18:32:15.156748] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-26T18:32:15.819022] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T18:32:15.956765] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-26T18:32:16.756769] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-26T18:32:16.940578] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T18:32:17.556775] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-26T18:32:18.231294] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T18:32:18.278594] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:32:18.356791] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-26T18:32:18.948318] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T18:32:19.156748] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-26T18:32:19.647820] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T18:32:19.956777] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-26T18:32:20.756727] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-26T18:32:21.556723] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-26T18:32:21.841295] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T18:32:22.092281] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T18:32:22.287685] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-26T18:32:22.356767] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-26T18:32:23.156770] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-26T18:32:23.730774] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-26T18:32:23.736279] [INFO ] [REMOTE ] EDN: Full fetch complete (30450 records). [2025-09-26T18:32:23.736375] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-26T18:32:23.970838] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-26T18:32:24.142732] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-26T18:32:24.142836] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-26T18:32:24.143451] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-26T18:32:24.143523] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-26T18:32:24.144455] [DEBUG] [LOCAL ] EDN: Trimmed 30450 records to 18501 (keeping 200 days of data) [2025-09-26T18:32:24.259814] [DEBUG] [LOCAL ] EDN: Primary data saved (18501 records). [2025-09-26T18:32:24.259976] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-26T18:32:24.260081] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 37.3s. Estimated remaining: 3h 41m 21s. Rate: 7.6 symbols/min [2025-09-26T18:32:24.456570] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:24.456907] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-09-26T18:32:24.457216] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-09-26T18:32:24.457400] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-26T18:32:24.457550] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-26T18:32:24.457835] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-09-26T18:32:24.457892] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-26T18:32:24.602014] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T18:32:24.687398] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T18:32:24.761970] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-26T18:32:24.920144] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:25.556740] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-26T18:32:25.919497] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:32:26.356692] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-26T18:32:26.747137] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T18:32:27.156718] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-26T18:32:27.813386] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T18:32:27.874885] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T18:32:27.956743] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-26T18:32:28.756734] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-26T18:32:29.424104] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T18:32:29.447987] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T18:32:29.556728] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-26T18:32:30.356763] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-26T18:32:31.156686] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-26T18:32:31.191915] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T18:32:31.402244] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T18:32:31.956733] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-26T18:32:32.756729] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-26T18:32:32.972107] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T18:32:33.318589] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T18:32:33.341767] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T18:32:33.556734] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-26T18:32:34.356744] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-26T18:32:35.053393] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T18:32:35.059757] [INFO ] [REMOTE ] EE: Full fetch complete (43573 records). [2025-09-26T18:32:35.059872] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-26T18:32:35.163365] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-26T18:32:35.491123] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-26T18:32:35.491290] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-26T18:32:35.491988] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-26T18:32:35.492070] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-26T18:32:35.493283] [DEBUG] [LOCAL ] EE: Trimmed 43573 records to 32973 (keeping 200 days of data) [2025-09-26T18:32:35.699033] [DEBUG] [LOCAL ] EE: Primary data saved (32973 records). [2025-09-26T18:32:35.699195] [INFO ] [MAIN ] EE: Full history saved. [2025-09-26T18:32:35.699289] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EE took 30.9s. Estimated remaining: 3h 41m 22s. Rate: 7.6 symbols/min [2025-09-26T18:32:35.881478] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:35.881675] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-09-26T18:32:35.881731] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-09-26T18:32:35.881879] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-26T18:32:35.881941] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-26T18:32:35.882011] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-09-26T18:32:35.882048] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-26T18:32:35.964969] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-26T18:32:36.296936] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:36.309821] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T18:32:36.497562] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T18:32:36.571031] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T18:32:36.580116] [INFO ] [REMOTE ] EDU: Full fetch complete (66476 records). [2025-09-26T18:32:36.580245] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-26T18:32:36.772637] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-26T18:32:37.055915] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-26T18:32:37.056061] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-26T18:32:37.057312] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-26T18:32:37.057474] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-26T18:32:37.059508] [DEBUG] [LOCAL ] EDU: Trimmed 66476 records to 45666 (keeping 200 days of data) [2025-09-26T18:32:37.346673] [DEBUG] [LOCAL ] EDU: Primary data saved (45666 records). [2025-09-26T18:32:37.346822] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-26T18:32:37.346991] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EDU took 37.6s. Estimated remaining: 3h 40m 59s. Rate: 7.6 symbols/min [2025-09-26T18:32:37.529895] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:37.530121] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-09-26T18:32:37.530165] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-09-26T18:32:37.530314] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-26T18:32:37.530357] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-26T18:32:37.530399] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-26T18:32:37.530432] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-26T18:32:37.563219] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-26T18:32:37.927600] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:38.073766] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-26T18:32:38.074952] [INFO ] [REMOTE ] EEA: Full fetch complete (3967 records). [2025-09-26T18:32:38.075027] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-26T18:32:38.272300] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T18:32:38.272519] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:32:38.272597] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:32:38.272713] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-26T18:32:38.272848] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-26T18:32:38.272908] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-26T18:32:38.273007] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-09-26T18:32:38.273096] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EEA took 32.6s. Estimated remaining: 3h 40m 34s. Rate: 7.6 symbols/min [2025-09-26T18:32:38.361850] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-26T18:32:38.470230] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:38.487293] [DEBUG] [LOCAL ] EFT: Loaded 12767 existing records from primary storage. [2025-09-26T18:32:38.487449] [INFO ] [MAIN ] EFT: Loaded 12767 existing records. [2025-09-26T18:32:38.678261] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:32:38.678503] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-26T18:32:38.678554] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-26T18:32:38.678838] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-26T18:32:38.678900] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-26T18:32:39.083752] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:39.156713] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-26T18:32:39.339405] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T18:32:39.460051] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-26T18:32:39.956741] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-26T18:32:40.066775] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T18:32:40.756751] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-26T18:32:40.783505] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T18:32:41.556752] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-26T18:32:41.728847] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T18:32:42.123967] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:32:42.356752] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-26T18:32:43.156709] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-26T18:32:43.379307] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T18:32:43.956739] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-26T18:32:44.632013] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:32:44.756751] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-26T18:32:45.018827] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T18:32:45.556725] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-26T18:32:46.207327] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T18:32:46.244865] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T18:32:46.356729] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-26T18:32:47.156730] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-26T18:32:47.251206] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:32:47.890562] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T18:32:47.956764] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-26T18:32:48.756723] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-26T18:32:48.899632] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T18:32:49.540609] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:32:49.556730] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-26T18:32:50.327831] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T18:32:50.356758] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-26T18:32:51.156717] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-26T18:32:51.205735] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T18:32:51.749705] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T18:32:51.751907] [INFO ] [REMOTE ] EEX: Full fetch complete (19626 records). [2025-09-26T18:32:51.751982] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-26T18:32:51.963509] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-26T18:32:52.147542] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-26T18:32:52.147627] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-26T18:32:52.148202] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-26T18:32:52.148267] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-26T18:32:52.148915] [DEBUG] [LOCAL ] EEX: Trimmed 19626 records to 12042 (keeping 200 days of data) [2025-09-26T18:32:52.222215] [DEBUG] [LOCAL ] EEX: Primary data saved (12042 records). [2025-09-26T18:32:52.222367] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-26T18:32:52.222482] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EEX took 28.0s. Estimated remaining: 3h 40m 41s. Rate: 7.6 symbols/min [2025-09-26T18:32:52.409317] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:52.461547] [DEBUG] [LOCAL ] EFX: Loaded 45166 existing records from primary storage. [2025-09-26T18:32:52.461732] [INFO ] [MAIN ] EFX: Loaded 45166 existing records. [2025-09-26T18:32:52.707432] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:32:52.707895] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-26T18:32:52.707957] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-26T18:32:52.708252] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-26T18:32:52.708314] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-26T18:32:52.761872] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-26T18:32:53.172507] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:53.556731] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-26T18:32:53.615401] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T18:32:53.875723] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T18:32:54.265886] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T18:32:54.356750] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-26T18:32:55.156726] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-26T18:32:55.956804] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-26T18:32:56.234889] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T18:32:56.259047] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T18:32:56.756775] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-26T18:32:57.478168] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:32:57.556746] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-26T18:32:57.999790] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T18:32:58.004501] [INFO ] [REMOTE ] EFR: Full fetch complete (18507 records). [2025-09-26T18:32:58.004702] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-26T18:32:58.005263] [FATAL] [VALIDATOR ] EFR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:32:58.005358] [FATAL] [MAIN ] EFR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:32:58.005411] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:32:58.005490] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-26T18:32:58.005578] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-26T18:32:58.005630] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-09-26T18:32:58.005735] [DEBUG] [LOCAL ] EFR: No derivative data file found to delete. [2025-09-26T18:32:58.005816] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFR took 20.7s. Estimated remaining: 3h 40m 28s. Rate: 7.6 symbols/min [2025-09-26T18:32:58.200453] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:32:58.229083] [DEBUG] [LOCAL ] EFXT: Loaded 29578 existing records from primary storage. [2025-09-26T18:32:58.229225] [INFO ] [MAIN ] EFXT: Loaded 29578 existing records. [2025-09-26T18:32:58.361818] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-26T18:32:58.434018] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:32:58.434344] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-26T18:32:58.434425] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-26T18:32:58.434748] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-26T18:32:58.434812] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-26T18:32:58.828930] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:32:59.147800] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T18:32:59.156675] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-26T18:32:59.788330] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-26T18:32:59.822793] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T18:32:59.956724] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-26T18:33:00.756771] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-26T18:33:01.556791] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-26T18:33:01.634529] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T18:33:01.668410] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T18:33:02.356747] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-26T18:33:03.011628] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T18:33:03.082722] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T18:33:03.156715] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-26T18:33:03.956751] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-26T18:33:04.662019] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:33:04.756735] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-26T18:33:05.556743] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-26T18:33:05.750591] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:33:05.816206] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T18:33:06.356758] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-26T18:33:06.990989] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T18:33:07.156710] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-26T18:33:07.956715] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-26T18:33:07.976915] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T18:33:08.272287] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T18:33:08.756768] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-26T18:33:09.196484] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T18:33:09.556730] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-26T18:33:10.356736] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-26T18:33:10.751898] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-26T18:33:10.947884] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T18:33:11.156714] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-26T18:33:11.186506] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T18:33:11.956773] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-26T18:33:12.756711] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-26T18:33:12.868110] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T18:33:12.907861] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-26T18:33:12.910861] [INFO ] [REMOTE ] EFT: Full fetch complete (17376 records). [2025-09-26T18:33:12.910963] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-26T18:33:12.911598] [FATAL] [VALIDATOR ] EFT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:33:12.911761] [FATAL] [MAIN ] EFT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:33:12.911827] [WARN ] [MAIN ] EFT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:33:12.911897] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-26T18:33:12.912054] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-26T18:33:12.912112] [INFO ] [LOCAL ] EFT: Starting deletion of derivative data. [2025-09-26T18:33:12.912703] [DEBUG] [LOCAL ] EFT: Deleted derivative data file. [2025-09-26T18:33:12.912821] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFT took 34.6s. Estimated remaining: 3h 40m 36s. Rate: 7.6 symbols/min [2025-09-26T18:33:13.093482] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:13.123369] [DEBUG] [LOCAL ] EG: Loaded 28829 existing records from primary storage. [2025-09-26T18:33:13.123509] [INFO ] [MAIN ] EG: Loaded 28829 existing records. [2025-09-26T18:33:13.308843] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:13.309209] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-26T18:33:13.309268] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-26T18:33:13.309558] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-26T18:33:13.309628] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-26T18:33:13.562727] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-26T18:33:13.721724] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:13.840573] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T18:33:14.356766] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-26T18:33:15.156735] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-26T18:33:15.386518] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T18:33:15.396880] [INFO ] [REMOTE ] EFC: Full fetch complete (66283 records). [2025-09-26T18:33:15.397105] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-26T18:33:15.853843] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-26T18:33:15.853959] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-26T18:33:15.854878] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-26T18:33:15.855048] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-26T18:33:15.856560] [DEBUG] [LOCAL ] EFC: Trimmed 66283 records to 46944 (keeping 200 days of data) [2025-09-26T18:33:15.970804] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T18:33:15.968961] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-26T18:33:16.192945] [DEBUG] [LOCAL ] EFC: Primary data saved (46944 records). [2025-09-26T18:33:16.193103] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-26T18:33:16.193186] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EFC took 40.5s. Estimated remaining: 3h 40m 17s. Rate: 7.6 symbols/min [2025-09-26T18:33:16.420038] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:16.443435] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T18:33:16.497524] [DEBUG] [LOCAL ] EGO: Loaded 51905 existing records from primary storage. [2025-09-26T18:33:16.497708] [INFO ] [MAIN ] EGO: Loaded 51905 existing records. [2025-09-26T18:33:16.680544] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:16.680850] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-26T18:33:16.680901] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-26T18:33:16.681181] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-26T18:33:16.681242] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-26T18:33:16.762018] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-26T18:33:17.078420] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:17.097122] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T18:33:17.556726] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-26T18:33:18.050619] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:33:18.345699] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T18:33:18.356670] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-26T18:33:19.156764] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-26T18:33:19.671149] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T18:33:19.956779] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-26T18:33:20.241171] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:33:20.756748] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-26T18:33:20.831525] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T18:33:21.556727] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-26T18:33:22.264115] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:33:22.356707] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-26T18:33:22.543962] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T18:33:22.550959] [INFO ] [REMOTE ] EFXT: Full fetch complete (44258 records). [2025-09-26T18:33:22.551136] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-26T18:33:22.964739] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-26T18:33:22.964834] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-26T18:33:22.966250] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-26T18:33:22.966318] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-26T18:33:22.967500] [DEBUG] [LOCAL ] EFXT: Trimmed 44258 records to 29755 (keeping 200 days of data) [2025-09-26T18:33:23.146712] [DEBUG] [LOCAL ] EFXT: Primary data saved (29755 records). [2025-09-26T18:33:23.146881] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-26T18:33:23.146975] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFXT took 25.1s. Estimated remaining: 3h 40m 7s. Rate: 7.6 symbols/min [2025-09-26T18:33:23.161965] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-26T18:33:23.336102] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:23.336361] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-09-26T18:33:23.336429] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-09-26T18:33:23.336857] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-26T18:33:23.336914] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-26T18:33:23.336959] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-09-26T18:33:23.336995] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-26T18:33:23.738398] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:23.766773] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T18:33:23.956760] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-26T18:33:24.688451] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T18:33:24.756835] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-26T18:33:25.313715] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T18:33:25.556764] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-26T18:33:25.791920] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T18:33:26.356864] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-26T18:33:26.663337] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T18:33:27.156782] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-26T18:33:27.956708] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-26T18:33:28.014535] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T18:33:28.715675] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T18:33:28.756690] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-26T18:33:28.933022] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T18:33:29.556737] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-26T18:33:30.356778] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-26T18:33:30.471175] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:33:30.552194] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T18:33:31.156782] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-26T18:33:31.774370] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:33:31.956760] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-26T18:33:32.488123] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:33:32.756788] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-26T18:33:33.556747] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-26T18:33:33.733565] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T18:33:34.206142] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T18:33:34.356726] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-26T18:33:34.508562] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T18:33:35.156717] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-26T18:33:35.626748] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T18:33:35.956743] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-26T18:33:36.307457] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T18:33:36.756738] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-26T18:33:37.360575] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T18:33:37.370482] [INFO ] [REMOTE ] EFX: Full fetch complete (64420 records). [2025-09-26T18:33:37.370712] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-26T18:33:37.561805] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-26T18:33:37.854060] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-26T18:33:37.855043] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-26T18:33:37.856046] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-26T18:33:37.856167] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-26T18:33:37.860714] [DEBUG] [LOCAL ] EFX: Trimmed 64420 records to 45419 (keeping 200 days of data) [2025-09-26T18:33:38.033244] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:33:38.216406] [DEBUG] [LOCAL ] EFX: Primary data saved (45419 records). [2025-09-26T18:33:38.216571] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-26T18:33:38.216783] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EFX took 46.0s. Estimated remaining: 3h 40m 16s. Rate: 7.6 symbols/min [2025-09-26T18:33:38.361858] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-26T18:33:38.415841] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:38.416068] [DEBUG] [LOCAL ] EGY: No existing data file found in primary storage. [2025-09-26T18:33:38.416128] [WARN ] [MAIN ] EGY: No existing data found, performing full refresh instead. [2025-09-26T18:33:38.416378] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-26T18:33:38.416478] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-26T18:33:38.416535] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-09-26T18:33:38.416587] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-26T18:33:38.822508] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:38.837604] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T18:33:39.156743] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-26T18:33:39.314284] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T18:33:39.956733] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-26T18:33:40.638883] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T18:33:40.756744] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-26T18:33:41.331792] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T18:33:41.556732] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-26T18:33:42.092306] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:33:42.356728] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-26T18:33:43.156729] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-26T18:33:43.188361] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T18:33:43.956731] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-26T18:33:44.349230] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T18:33:44.362611] [INFO ] [REMOTE ] EGO: Full fetch complete (73538 records). [2025-09-26T18:33:44.362980] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-26T18:33:44.558360] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T18:33:44.627914] [INFO ] [REMOTE ] EG: Full fetch complete (43830 records). [2025-09-26T18:33:44.687127] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-26T18:33:44.763486] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-26T18:33:45.040440] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-26T18:33:45.040686] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-26T18:33:45.041965] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-26T18:33:45.042059] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-26T18:33:45.112360] [DEBUG] [LOCAL ] EGO: Trimmed 73538 records to 52295 (keeping 200 days of data) [2025-09-26T18:33:45.472951] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-26T18:33:45.474752] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-26T18:33:45.476223] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-26T18:33:45.478065] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-26T18:33:45.500301] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T18:33:45.513146] [DEBUG] [LOCAL ] EG: Trimmed 43830 records to 29024 (keeping 200 days of data) [2025-09-26T18:33:45.607127] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-26T18:33:46.068311] [DEBUG] [LOCAL ] EGO: Primary data saved (52295 records). [2025-09-26T18:33:46.069456] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-26T18:33:46.070167] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EGO took 29.9s. Estimated remaining: 3h 40m 8s. Rate: 7.6 symbols/min [2025-09-26T18:33:46.322101] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:46.325108] [DEBUG] [LOCAL ] EG: Primary data saved (29024 records). [2025-09-26T18:33:46.326021] [INFO ] [MAIN ] EG: Full history saved. [2025-09-26T18:33:46.326196] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EG took 33.4s. Estimated remaining: 3h 39m 42s. Rate: 7.6 symbols/min [2025-09-26T18:33:46.588623] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:46.593017] [DEBUG] [LOCAL ] EHAB: Loaded 30109 existing records from primary storage. [2025-09-26T18:33:46.593298] [INFO ] [MAIN ] EHAB: Loaded 30109 existing records. [2025-09-26T18:33:46.829621] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:46.830227] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-26T18:33:46.830326] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-26T18:33:46.830729] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-26T18:33:46.831085] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-26T18:33:46.975884] [DEBUG] [LOCAL ] EHC: Loaded 41649 existing records from primary storage. [2025-09-26T18:33:46.944546] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-26T18:33:47.026162] [INFO ] [MAIN ] EHC: Loaded 41649 existing records. [2025-09-26T18:33:47.026081] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-26T18:33:47.439741] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:47.479564] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-26T18:33:47.498758] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-26T18:33:47.539568] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-26T18:33:47.539508] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:47.559043] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-26T18:33:47.559135] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-26T18:33:47.579027] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T18:33:47.964271] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-26T18:33:47.964203] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:48.752987] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:33:48.762987] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-26T18:33:48.782505] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:33:48.891839] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:33:49.556723] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-26T18:33:50.108672] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T18:33:50.356749] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-26T18:33:51.156693] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-26T18:33:51.188883] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-26T18:33:51.197184] [INFO ] [REMOTE ] EGP: Full fetch complete (45355 records). [2025-09-26T18:33:51.197369] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-26T18:33:51.630809] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-26T18:33:51.632307] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T18:33:51.631609] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-26T18:33:51.638620] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-26T18:33:51.639048] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-26T18:33:51.640236] [DEBUG] [LOCAL ] EGP: Trimmed 45355 records to 31536 (keeping 200 days of data) [2025-09-26T18:33:51.859862] [DEBUG] [LOCAL ] EGP: Primary data saved (31536 records). [2025-09-26T18:33:51.860022] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-26T18:33:51.860107] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGP took 28.7s. Estimated remaining: 3h 39m 28s. Rate: 7.6 symbols/min [2025-09-26T18:33:51.961875] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-26T18:33:52.055033] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:33:52.067509] [DEBUG] [LOCAL ] EHI: Loaded 10411 existing records from primary storage. [2025-09-26T18:33:52.067620] [INFO ] [MAIN ] EHI: Loaded 10411 existing records. [2025-09-26T18:33:52.258142] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:33:52.258424] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-26T18:33:52.258483] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-26T18:33:52.258694] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-26T18:33:52.258753] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-26T18:33:52.657974] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:33:52.754747] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:33:52.764079] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-26T18:33:53.057921] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T18:33:53.564675] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-26T18:33:53.566991] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T18:33:54.356747] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-26T18:33:55.156717] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-26T18:33:55.214803] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T18:33:55.480010] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T18:33:55.956798] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-26T18:33:56.530573] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T18:33:56.756733] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-26T18:33:57.208257] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T18:33:57.556795] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-26T18:33:57.979378] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-26T18:33:58.356728] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-26T18:33:58.666831] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:33:58.878316] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T18:33:59.156759] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-26T18:33:59.956792] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-26T18:34:00.613985] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T18:34:00.756771] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-26T18:34:01.182354] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T18:34:01.556765] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-26T18:34:02.134326] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T18:34:02.356735] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-26T18:34:02.530375] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:34:02.949239] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T18:34:03.156759] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-26T18:34:03.956778] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-26T18:34:04.554558] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:34:04.756736] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-26T18:34:05.556721] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-26T18:34:05.906992] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T18:34:06.007100] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T18:34:06.356770] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-26T18:34:06.892989] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T18:34:06.901269] [INFO ] [REMOTE ] EGY: Full fetch complete (61571 records). [2025-09-26T18:34:06.901402] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-26T18:34:07.023094] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T18:34:07.161885] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-26T18:34:07.338298] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-26T18:34:07.338422] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-26T18:34:07.339312] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-26T18:34:07.339382] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-26T18:34:07.340909] [DEBUG] [LOCAL ] EGY: Trimmed 61571 records to 42824 (keeping 200 days of data) [2025-09-26T18:34:07.613985] [DEBUG] [LOCAL ] EGY: Primary data saved (42824 records). [2025-09-26T18:34:07.614127] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-26T18:34:07.614209] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EGY took 29.4s. Estimated remaining: 3h 39m 39s. Rate: 7.6 symbols/min [2025-09-26T18:34:07.790142] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:07.818130] [DEBUG] [LOCAL ] EIC: Loaded 24164 existing records from primary storage. [2025-09-26T18:34:07.818270] [INFO ] [MAIN ] EIC: Loaded 24164 existing records. [2025-09-26T18:34:07.965882] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-26T18:34:08.011070] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:34:08.011396] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-26T18:34:08.011446] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-26T18:34:08.011671] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-26T18:34:08.011732] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-26T18:34:08.402042] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:08.575315] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:34:08.589294] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T18:34:08.756728] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-26T18:34:09.556733] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-26T18:34:10.065809] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T18:34:10.071304] [INFO ] [REMOTE ] EHAB: Full fetch complete (41387 records). [2025-09-26T18:34:10.071409] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-26T18:34:10.361951] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-26T18:34:10.480184] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-26T18:34:10.480274] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-26T18:34:10.481011] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-26T18:34:10.481077] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-26T18:34:10.482074] [DEBUG] [LOCAL ] EHAB: Trimmed 41387 records to 30257 (keeping 200 days of data) [2025-09-26T18:34:10.658716] [DEBUG] [LOCAL ] EHAB: Primary data saved (30257 records). [2025-09-26T18:34:10.658864] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-26T18:34:10.658955] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EHAB took 24.6s. Estimated remaining: 3h 39m 19s. Rate: 7.6 symbols/min [2025-09-26T18:34:10.841907] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:10.842058] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-26T18:34:10.842096] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-26T18:34:10.842239] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-26T18:34:10.842284] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-26T18:34:10.842327] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-26T18:34:10.842360] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-26T18:34:11.163857] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-26T18:34:11.282763] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:11.326584] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T18:34:11.861047] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T18:34:11.956730] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-26T18:34:12.047034] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T18:34:12.756783] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-26T18:34:13.127816] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T18:34:13.488585] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T18:34:13.556720] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-26T18:34:14.185883] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T18:34:14.356772] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-26T18:34:15.156784] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-26T18:34:15.495218] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:34:15.747855] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:34:15.956767] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-26T18:34:16.756736] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-26T18:34:16.889880] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T18:34:17.218991] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T18:34:17.556728] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-26T18:34:17.847609] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-26T18:34:18.356741] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-26T18:34:19.156724] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-26T18:34:19.864010] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T18:34:19.956751] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-26T18:34:20.682136] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T18:34:20.695542] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T18:34:20.756702] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-26T18:34:21.556719] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-26T18:34:22.356709] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-26T18:34:22.393821] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T18:34:22.596978] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T18:34:22.599732] [INFO ] [REMOTE ] EHI: Full fetch complete (16291 records). [2025-09-26T18:34:22.599815] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-26T18:34:22.990341] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-26T18:34:22.990432] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-26T18:34:22.990850] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-26T18:34:22.990913] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-26T18:34:22.991506] [DEBUG] [LOCAL ] EHI: Trimmed 16291 records to 10472 (keeping 200 days of data) [2025-09-26T18:34:23.055310] [DEBUG] [LOCAL ] EHI: Primary data saved (10472 records). [2025-09-26T18:34:23.055454] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-26T18:34:23.055564] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EHI took 31.2s. Estimated remaining: 3h 39m 22s. Rate: 7.6 symbols/min [2025-09-26T18:34:23.162883] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-26T18:34:23.241975] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:23.242221] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-26T18:34:23.242275] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-26T18:34:23.242438] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-26T18:34:23.242524] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-26T18:34:23.242674] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-26T18:34:23.242731] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-26T18:34:23.634630] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:34:23.676161] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:23.689710] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T18:34:23.956728] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-26T18:34:24.756747] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-26T18:34:25.169129] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T18:34:25.415974] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T18:34:25.556736] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-26T18:34:26.030383] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T18:34:26.356751] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-26T18:34:27.156753] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-26T18:34:27.558637] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-26T18:34:27.562164] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T18:34:27.956738] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-26T18:34:28.756722] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-26T18:34:29.195372] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T18:34:29.556750] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-26T18:34:29.846524] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-26T18:34:30.087920] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T18:34:30.096266] [INFO ] [REMOTE ] EHC: Full fetch complete (58852 records). [2025-09-26T18:34:30.096439] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-26T18:34:30.362695] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-26T18:34:30.504298] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-26T18:34:30.504393] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-26T18:34:30.505245] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-26T18:34:30.505313] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-26T18:34:30.506595] [DEBUG] [LOCAL ] EHC: Trimmed 58852 records to 41849 (keeping 200 days of data) [2025-09-26T18:34:30.791488] [DEBUG] [LOCAL ] EHC: Primary data saved (41849 records). [2025-09-26T18:34:30.791632] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-26T18:34:30.791781] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EHC took 44.5s. Estimated remaining: 3h 39m 13s. Rate: 7.6 symbols/min [2025-09-26T18:34:30.976369] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:30.976572] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-26T18:34:30.976628] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-26T18:34:30.976802] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-26T18:34:30.976871] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-26T18:34:30.976958] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-26T18:34:30.977026] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-26T18:34:31.163178] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-26T18:34:31.372610] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:31.678030] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T18:34:31.689061] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T18:34:31.956730] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-26T18:34:32.756748] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-26T18:34:33.063769] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T18:34:33.072870] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-26T18:34:33.556719] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-26T18:34:33.970111] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-26T18:34:34.356739] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-26T18:34:35.156732] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-26T18:34:35.561147] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T18:34:35.632571] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T18:34:35.637294] [INFO ] [REMOTE ] EIC: Full fetch complete (35075 records). [2025-09-26T18:34:35.637422] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-26T18:34:35.961852] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-26T18:34:36.041321] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-26T18:34:36.041411] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-26T18:34:36.041978] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-26T18:34:36.042041] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-26T18:34:36.042935] [DEBUG] [LOCAL ] EIC: Trimmed 35075 records to 24238 (keeping 200 days of data) [2025-09-26T18:34:36.200076] [DEBUG] [LOCAL ] EIC: Primary data saved (24238 records). [2025-09-26T18:34:36.200226] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-26T18:34:36.200319] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EIC took 28.6s. Estimated remaining: 3h 38m 59s. Rate: 7.6 symbols/min [2025-09-26T18:34:36.398963] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:36.421910] [DEBUG] [LOCAL ] EIG: Loaded 20438 existing records from primary storage. [2025-09-26T18:34:36.422064] [INFO ] [MAIN ] EIG: Loaded 20438 existing records. [2025-09-26T18:34:36.502093] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T18:34:36.629895] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:34:36.630173] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-26T18:34:36.630231] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-26T18:34:36.630470] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-26T18:34:36.630531] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-26T18:34:36.789174] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-26T18:34:37.058890] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:37.289859] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-26T18:34:37.556722] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-26T18:34:38.196363] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:34:38.356762] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-26T18:34:39.053700] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T18:34:39.156743] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-26T18:34:39.520426] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T18:34:39.956721] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-26T18:34:40.546325] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-26T18:34:40.547573] [INFO ] [REMOTE ] EICB: Full fetch complete (2692 records). [2025-09-26T18:34:40.547678] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-26T18:34:40.739868] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-26T18:34:40.740087] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:34:40.740158] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:34:40.740258] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-26T18:34:40.740340] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-26T18:34:40.740381] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-26T18:34:40.740438] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-26T18:34:40.740536] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EICB took 17.7s. Estimated remaining: 3h 38m 44s. Rate: 7.6 symbols/min [2025-09-26T18:34:40.762434] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-26T18:34:40.929570] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:34:40.989109] [DEBUG] [LOCAL ] EIX: Loaded 53725 existing records from primary storage. [2025-09-26T18:34:40.989262] [INFO ] [MAIN ] EIX: Loaded 53725 existing records. [2025-09-26T18:34:41.190239] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:34:41.190543] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-26T18:34:41.190603] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-26T18:34:41.190941] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-26T18:34:41.191002] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-26T18:34:41.269908] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T18:34:41.557315] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-26T18:34:41.580255] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:34:42.356767] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-26T18:34:42.825880] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T18:34:42.968689] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-26T18:34:43.156757] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-26T18:34:43.956745] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-26T18:34:44.215984] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T18:34:44.501605] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-26T18:34:44.502532] [INFO ] [REMOTE ] EICA: Full fetch complete (1269 records). [2025-09-26T18:34:44.502615] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-26T18:34:44.703857] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-26T18:34:44.704047] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:34:44.704159] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:34:44.704233] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-26T18:34:44.704301] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-26T18:34:44.704338] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-26T18:34:44.704377] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-26T18:34:44.704444] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EICA took 34.0s. Estimated remaining: 3h 38m 27s. Rate: 7.6 symbols/min [2025-09-26T18:34:44.756764] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-26T18:34:45.556738] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-26T18:34:46.356709] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-26T18:34:46.428800] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T18:34:46.715748] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-26T18:34:46.747671] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-26T18:34:47.156794] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-26T18:34:47.917619] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T18:34:47.956730] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-26T18:34:48.640882] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-26T18:34:48.756765] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-26T18:34:49.390249] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T18:34:49.556721] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-26T18:34:50.356717] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-26T18:34:50.679487] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:34:50.995950] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T18:34:51.156745] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-26T18:34:51.864625] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T18:34:51.956760] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-26T18:34:52.756780] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-26T18:34:53.200012] [DEBUG] [REMOTE ] EIX: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-26T18:34:53.200332] [WARN ] [REMOTE ] EIX: No data returned for month 2025-01 [2025-09-26T18:34:53.231478] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T18:34:53.556718] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-26T18:34:54.356724] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-26T18:34:54.611280] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:34:55.156802] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-26T18:34:55.956722] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-26T18:34:56.175484] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T18:34:56.350831] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-26T18:34:56.478344] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T18:34:56.756729] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-26T18:34:57.479341] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T18:34:57.481346] [INFO ] [REMOTE ] EICC: Full fetch complete (8033 records). [2025-09-26T18:34:57.481467] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-26T18:34:57.481907] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:34:57.482031] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:34:57.482117] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:34:57.482202] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-26T18:34:57.482300] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-26T18:34:57.482366] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-26T18:34:57.482471] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-26T18:34:57.482716] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EICC took 26.7s. Estimated remaining: 3h 38m 30s. Rate: 7.6 symbols/min [2025-09-26T18:34:57.556756] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-26T18:34:58.356748] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-26T18:34:58.629947] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T18:34:59.156757] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-26T18:35:00.043052] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:35:00.054598] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-26T18:35:00.084368] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T18:35:00.756733] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-26T18:35:02.015019] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T18:35:02.029130] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-26T18:35:02.053801] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T18:35:02.058281] [INFO ] [REMOTE ] EIG: Full fetch complete (27011 records). [2025-09-26T18:35:02.058360] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-26T18:35:02.529733] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-26T18:35:02.529821] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-26T18:35:02.530346] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-26T18:35:02.530400] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-26T18:35:02.531198] [DEBUG] [LOCAL ] EIG: Trimmed 27011 records to 20519 (keeping 200 days of data) [2025-09-26T18:35:02.660631] [DEBUG] [LOCAL ] EIG: Primary data saved (20519 records). [2025-09-26T18:35:02.660788] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-26T18:35:02.660885] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EIG took 26.5s. Estimated remaining: 3h 38m 16s. Rate: 7.6 symbols/min [2025-09-26T18:35:03.920822] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T18:35:03.932537] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-26T18:35:06.136203] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-26T18:35:06.147768] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-26T18:35:08.170665] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T18:35:08.183555] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-26T18:35:10.184509] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T18:35:10.196421] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-26T18:35:12.373917] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-26T18:35:12.388069] [INFO ] [REMOTE ] EIX: Full fetch complete (69185 records). [2025-09-26T18:35:12.388270] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-26T18:35:12.604000] [WARN ] [VALIDATOR ] EIX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-26T18:35:12.604849] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:35:12.604930] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:35:12.605008] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-26T18:35:12.605103] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-26T18:35:12.605163] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-09-26T18:35:12.605719] [DEBUG] [LOCAL ] EIX: Deleted derivative data file. [2025-09-26T18:35:12.605856] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. EIX took 31.9s. Estimated remaining: 3h 38m 12s. Rate: 7.6 symbols/min [2025-09-26T18:35:13.348566] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:13.341263] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:13.337695] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:13.413176] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:13.417716] [DEBUG] [LOCAL ] ELC: Loaded 3504 existing records from primary storage. [2025-09-26T18:35:13.417875] [INFO ] [MAIN ] ELC: Loaded 3504 existing records. [2025-09-26T18:35:13.669933] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:13.671674] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-26T18:35:13.672098] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-26T18:35:13.702813] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-26T18:35:13.703297] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-26T18:35:13.704505] [DEBUG] [LOCAL ] ELF: Loaded 52663 existing records from primary storage. [2025-09-26T18:35:13.710018] [INFO ] [MAIN ] ELF: Loaded 52663 existing records. [2025-09-26T18:35:13.726582] [DEBUG] [LOCAL ] EL: Loaded 53791 existing records from primary storage. [2025-09-26T18:35:13.756614] [DEBUG] [LOCAL ] ELAN: Loaded 53595 existing records from primary storage. [2025-09-26T18:35:13.762084] [INFO ] [MAIN ] ELAN: Loaded 53595 existing records. [2025-09-26T18:35:13.755747] [INFO ] [MAIN ] EL: Loaded 53791 existing records. [2025-09-26T18:35:14.589509] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:14.699987] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-26T18:35:14.705546] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:14.705363] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:14.721465] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-26T18:35:14.740319] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-26T18:35:14.740789] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-26T18:35:14.741364] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-26T18:35:14.751986] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-26T18:35:14.757334] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-26T18:35:14.789568] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-26T18:35:14.767856] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-26T18:35:14.789471] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-26T18:35:14.866967] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-26T18:35:14.928449] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-26T18:35:14.942740] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:14.980637] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-26T18:35:15.964176] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:15.975020] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-26T18:35:16.019857] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:16.078222] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T18:35:16.078613] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-26T18:35:16.085188] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-26T18:35:16.088443] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:16.089629] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-26T18:35:16.682217] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T18:35:16.683980] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-26T18:35:17.120872] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T18:35:17.122363] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-26T18:35:17.543594] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-26T18:35:17.545623] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-26T18:35:17.824698] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T18:35:17.836425] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-26T18:35:17.913322] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T18:35:17.925740] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-26T18:35:17.931558] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-26T18:35:17.933191] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-26T18:35:17.977614] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-26T18:35:17.988627] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-26T18:35:18.288678] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T18:35:18.290175] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-26T18:35:18.632076] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T18:35:18.633636] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-26T18:35:19.215299] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:35:19.226151] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-26T18:35:19.392433] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T18:35:19.394173] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-26T18:35:19.774979] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-26T18:35:19.777189] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-26T18:35:20.020379] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-26T18:35:20.032293] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-26T18:35:20.075982] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T18:35:20.087346] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-26T18:35:20.208709] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-26T18:35:20.209961] [INFO ] [REMOTE ] ELC: Full fetch complete (5079 records). [2025-09-26T18:35:20.210032] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-26T18:35:20.210394] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:35:20.210478] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:35:20.210523] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:35:20.210587] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-26T18:35:20.210686] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-09-26T18:35:20.210743] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-09-26T18:35:20.211242] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-09-26T18:35:20.211337] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 7.6s. Estimated remaining: 3h 38m 4s. Rate: 7.6 symbols/min [2025-09-26T18:35:20.401805] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:20.435098] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T18:35:20.477839] [DEBUG] [LOCAL ] ELME: Loaded 39528 existing records from primary storage. [2025-09-26T18:35:20.477984] [INFO ] [MAIN ] ELME: Loaded 39528 existing records. [2025-09-26T18:35:20.684366] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:20.684687] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-26T18:35:20.684759] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-26T18:35:20.685067] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-26T18:35:20.685136] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-26T18:35:20.762077] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-26T18:35:21.102237] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:21.556748] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-26T18:35:21.759680] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:35:22.164556] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:35:22.356716] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-26T18:35:22.523976] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-26T18:35:23.136796] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:35:23.156674] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-26T18:35:23.751072] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:35:23.956745] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-26T18:35:24.092108] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T18:35:24.756731] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-26T18:35:25.556731] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-26T18:35:25.865526] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T18:35:25.914511] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T18:35:26.356740] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-26T18:35:27.156704] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-26T18:35:27.283205] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T18:35:27.844170] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:35:27.956730] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-26T18:35:28.756732] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-26T18:35:29.012740] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T18:35:29.556782] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-26T18:35:30.128940] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T18:35:30.356731] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-26T18:35:30.765506] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T18:35:31.156768] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-26T18:35:31.357846] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:35:31.522357] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T18:35:31.956784] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-26T18:35:32.756731] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-26T18:35:33.115099] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T18:35:33.171761] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T18:35:33.556735] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-26T18:35:34.356746] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-26T18:35:34.910364] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-26T18:35:35.101315] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T18:35:35.156721] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-26T18:35:35.956708] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-26T18:35:36.435084] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-26T18:35:36.756737] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-26T18:35:37.177819] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T18:35:37.442277] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:35:37.556740] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-26T18:35:38.254210] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:35:38.356787] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-26T18:35:38.765950] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T18:35:39.156741] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-26T18:35:39.956769] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-26T18:35:40.573697] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-26T18:35:40.756743] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-26T18:35:41.187935] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T18:35:41.225981] [INFO ] [REMOTE ] ELME: Full fetch complete (55816 records). [2025-09-26T18:35:41.229437] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-26T18:35:41.232122] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T18:35:41.561825] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-26T18:35:41.698183] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-26T18:35:41.698285] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-26T18:35:41.699102] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-26T18:35:41.699208] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-26T18:35:41.701189] [DEBUG] [LOCAL ] ELME: Trimmed 55816 records to 39817 (keeping 200 days of data) [2025-09-26T18:35:41.970044] [DEBUG] [LOCAL ] ELME: Primary data saved (39817 records). [2025-09-26T18:35:41.970279] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-26T18:35:41.970407] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELME took 21.8s. Estimated remaining: 3h 38m 27s. Rate: 7.5 symbols/min [2025-09-26T18:35:42.169040] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:42.195578] [DEBUG] [LOCAL ] ELP: Loaded 25971 existing records from primary storage. [2025-09-26T18:35:42.195750] [INFO ] [MAIN ] ELP: Loaded 25971 existing records. [2025-09-26T18:35:42.361969] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-26T18:35:42.413317] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:42.414093] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-26T18:35:42.414173] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-26T18:35:42.414405] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-26T18:35:42.414518] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-26T18:35:42.818760] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:42.852875] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-26T18:35:43.156770] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-26T18:35:43.360800] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T18:35:43.956775] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-26T18:35:44.109976] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T18:35:44.121200] [INFO ] [REMOTE ] ELAN: Full fetch complete (76856 records). [2025-09-26T18:35:44.121398] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-26T18:35:44.590602] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-26T18:35:44.600311] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-26T18:35:44.601321] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-26T18:35:44.601589] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-26T18:35:44.603391] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T18:35:44.610556] [DEBUG] [LOCAL ] ELAN: Trimmed 76856 records to 53985 (keeping 200 days of data) [2025-09-26T18:35:44.784265] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-26T18:35:44.942732] [DEBUG] [LOCAL ] ELAN: Primary data saved (53985 records). [2025-09-26T18:35:44.942887] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-26T18:35:44.942984] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELAN took 32.3s. Estimated remaining: 3h 38m 8s. Rate: 7.6 symbols/min [2025-09-26T18:35:45.138748] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:45.138977] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-26T18:35:45.139037] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-26T18:35:45.139226] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-26T18:35:45.139321] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-26T18:35:45.139389] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-26T18:35:45.139435] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-26T18:35:45.536812] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:45.556717] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-26T18:35:45.882224] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T18:35:46.099555] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-26T18:35:46.356691] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-26T18:35:46.469674] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:35:46.480893] [INFO ] [REMOTE ] EL: Full fetch complete (77327 records). [2025-09-26T18:35:46.481081] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-26T18:35:46.734501] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-26T18:35:46.925430] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-26T18:35:46.925529] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-26T18:35:46.926515] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-26T18:35:46.926594] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-26T18:35:46.928519] [DEBUG] [LOCAL ] EL: Trimmed 77327 records to 54177 (keeping 200 days of data) [2025-09-26T18:35:47.174138] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-26T18:35:47.302327] [DEBUG] [LOCAL ] EL: Primary data saved (54177 records). [2025-09-26T18:35:47.302483] [INFO ] [MAIN ] EL: Full history saved. [2025-09-26T18:35:47.302574] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. EL took 34.7s. Estimated remaining: 3h 37m 47s. Rate: 7.6 symbols/min [2025-09-26T18:35:47.484982] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:47.541663] [DEBUG] [LOCAL ] ELS: Loaded 49758 existing records from primary storage. [2025-09-26T18:35:47.541835] [INFO ] [MAIN ] ELS: Loaded 49758 existing records. [2025-09-26T18:35:47.787688] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:47.787959] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-26T18:35:47.788008] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-26T18:35:47.788317] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-26T18:35:47.788377] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-26T18:35:47.961941] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-26T18:35:48.190911] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:48.756737] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-26T18:35:49.247074] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T18:35:49.318330] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:35:49.329699] [INFO ] [REMOTE ] ELF: Full fetch complete (75374 records). [2025-09-26T18:35:49.329880] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-26T18:35:49.561879] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-26T18:35:49.783037] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-26T18:35:49.783134] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-26T18:35:49.784002] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-26T18:35:49.784114] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-26T18:35:49.785848] [DEBUG] [LOCAL ] ELF: Trimmed 75374 records to 53037 (keeping 200 days of data) [2025-09-26T18:35:50.130892] [DEBUG] [LOCAL ] ELF: Primary data saved (53037 records). [2025-09-26T18:35:50.131055] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-26T18:35:50.132805] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELF took 37.5s. Estimated remaining: 3h 37m 28s. Rate: 7.6 symbols/min [2025-09-26T18:35:50.376977] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:35:50.371907] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-26T18:35:50.410098] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:35:50.445186] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T18:35:50.496417] [DEBUG] [LOCAL ] ELV: Loaded 50969 existing records from primary storage. [2025-09-26T18:35:50.496580] [INFO ] [MAIN ] ELV: Loaded 50969 existing records. [2025-09-26T18:35:50.694401] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T18:35:50.694238] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:35:50.696503] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-26T18:35:50.696594] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-26T18:35:50.696895] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-26T18:35:50.696971] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-26T18:35:51.115245] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:35:51.156782] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-26T18:35:51.956750] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-26T18:35:52.756709] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-26T18:35:52.953988] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T18:35:53.035977] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-26T18:35:53.186054] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T18:35:53.556742] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-26T18:35:54.051293] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T18:35:54.356795] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-26T18:35:55.156756] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-26T18:35:55.740175] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T18:35:55.905341] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T18:35:55.956842] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-26T18:35:56.756790] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-26T18:35:57.556732] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-26T18:35:57.738413] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:35:57.894460] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T18:35:58.036700] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T18:35:58.356785] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-26T18:35:59.156763] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-26T18:35:59.693938] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T18:35:59.956800] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-26T18:36:00.620692] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:36:00.756772] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-26T18:36:01.156570] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-26T18:36:01.556763] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-26T18:36:01.727214] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T18:36:01.850050] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-26T18:36:02.356768] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-26T18:36:03.156743] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-26T18:36:03.913779] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T18:36:03.956676] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-26T18:36:04.081844] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-26T18:36:04.756767] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-26T18:36:05.173261] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-26T18:36:05.174124] [INFO ] [REMOTE ] ELPC: Full fetch complete (1481 records). [2025-09-26T18:36:05.174200] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-26T18:36:05.377970] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-26T18:36:05.378503] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:36:05.378580] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:36:05.378678] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-26T18:36:05.378767] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-26T18:36:05.378809] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-26T18:36:05.378899] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-26T18:36:05.379043] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. ELPC took 20.4s. Estimated remaining: 3h 37m 36s. Rate: 7.6 symbols/min [2025-09-26T18:36:05.562609] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-26T18:36:05.566577] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:05.566850] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-26T18:36:05.568356] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-26T18:36:05.569108] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-26T18:36:05.569203] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-26T18:36:05.569312] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-26T18:36:05.569400] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-26T18:36:05.966274] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:06.003816] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-26T18:36:06.356771] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-26T18:36:06.834513] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T18:36:06.868288] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:06.868899] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-26T18:36:07.156780] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-26T18:36:07.956796] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-26T18:36:08.756799] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-26T18:36:08.854798] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T18:36:09.370158] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:36:09.556728] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-26T18:36:09.653354] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T18:36:10.356730] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-26T18:36:11.156785] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-26T18:36:11.465903] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T18:36:11.510447] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T18:36:11.956766] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-26T18:36:12.756811] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-26T18:36:12.976966] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T18:36:13.123014] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T18:36:13.134691] [INFO ] [REMOTE ] ELS: Full fetch complete (70586 records). [2025-09-26T18:36:13.134974] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-26T18:36:13.562205] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-26T18:36:13.597189] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-26T18:36:13.597529] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-26T18:36:13.601341] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-26T18:36:13.601783] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-26T18:36:13.608209] [DEBUG] [LOCAL ] ELS: Trimmed 70586 records to 50110 (keeping 200 days of data) [2025-09-26T18:36:13.841449] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:13.846832] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-26T18:36:13.958005] [DEBUG] [LOCAL ] ELS: Primary data saved (50110 records). [2025-09-26T18:36:13.958249] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-26T18:36:13.958566] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELS took 26.7s. Estimated remaining: 3h 37m 30s. Rate: 7.6 symbols/min [2025-09-26T18:36:14.142175] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:14.175540] [DEBUG] [LOCAL ] EMD: Loaded 21179 existing records from primary storage. [2025-09-26T18:36:14.175813] [INFO ] [MAIN ] EMD: Loaded 21179 existing records. [2025-09-26T18:36:14.364292] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-26T18:36:14.371303] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:14.373714] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-26T18:36:14.373791] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-26T18:36:14.374224] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-26T18:36:14.374332] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-26T18:36:14.582106] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T18:36:14.807049] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:15.156853] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-26T18:36:15.739962] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:15.741172] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-26T18:36:15.768227] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T18:36:15.956822] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-26T18:36:16.756784] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-26T18:36:16.976467] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:16.976841] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-26T18:36:17.236676] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T18:36:17.556739] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-26T18:36:18.356874] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-26T18:36:18.580864] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:36:18.581220] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-26T18:36:18.851446] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:36:18.857087] [INFO ] [REMOTE ] ELP: Full fetch complete (37517 records). [2025-09-26T18:36:18.857252] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-26T18:36:19.161973] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-26T18:36:19.339840] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-26T18:36:19.339965] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-26T18:36:19.340751] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-26T18:36:19.340820] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-26T18:36:19.342065] [DEBUG] [LOCAL ] ELP: Trimmed 37517 records to 26107 (keeping 200 days of data) [2025-09-26T18:36:19.513952] [DEBUG] [LOCAL ] ELP: Primary data saved (26107 records). [2025-09-26T18:36:19.514456] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-26T18:36:19.514692] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. ELP took 37.5s. Estimated remaining: 3h 37m 17s. Rate: 7.6 symbols/min [2025-09-26T18:36:19.685423] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T18:36:19.708393] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:19.708589] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-09-26T18:36:19.708666] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-09-26T18:36:19.708869] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-26T18:36:19.708914] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-26T18:36:19.708957] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-09-26T18:36:19.708990] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-26T18:36:19.965863] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-26T18:36:20.091355] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:20.756762] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-26T18:36:20.975691] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T18:36:21.556741] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-26T18:36:22.356702] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-26T18:36:22.380783] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T18:36:22.469089] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T18:36:23.156734] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-26T18:36:23.956721] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-26T18:36:24.095266] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T18:36:24.111442] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T18:36:24.756741] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-26T18:36:25.556766] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-26T18:36:25.994541] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T18:36:26.203031] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-26T18:36:26.356728] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-26T18:36:26.915079] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T18:36:27.156754] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-26T18:36:27.956743] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-26T18:36:28.156039] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T18:36:28.401729] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T18:36:28.600683] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:36:28.756771] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-26T18:36:29.556770] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-26T18:36:29.951922] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T18:36:29.955935] [INFO ] [REMOTE ] EMA: Full fetch complete (8290 records). [2025-09-26T18:36:29.956037] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-26T18:36:30.160526] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 85 unique days, need 200 days [2025-09-26T18:36:30.160807] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:36:30.160890] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:36:30.160974] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-26T18:36:30.161063] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-26T18:36:30.161101] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-26T18:36:30.161171] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-26T18:36:30.161241] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. EMA took 24.8s. Estimated remaining: 3h 37m 15s. Rate: 7.6 symbols/min [2025-09-26T18:36:30.338815] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:30.348629] [DEBUG] [LOCAL ] EMF: Loaded 3558 existing records from primary storage. [2025-09-26T18:36:30.348791] [INFO ] [MAIN ] EMF: Loaded 3558 existing records. [2025-09-26T18:36:30.361808] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-26T18:36:30.559703] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:30.559986] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-26T18:36:30.560041] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-26T18:36:30.560351] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-26T18:36:30.560439] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-26T18:36:30.983237] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:31.156739] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-26T18:36:31.521920] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T18:36:31.538390] [INFO ] [REMOTE ] ELV: Full fetch complete (73210 records). [2025-09-26T18:36:31.538638] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-26T18:36:31.960723] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-26T18:36:32.027026] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-26T18:36:32.029554] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-26T18:36:32.029425] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T18:36:32.031103] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-26T18:36:32.041178] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-26T18:36:32.044549] [DEBUG] [LOCAL ] ELV: Trimmed 73210 records to 51334 (keeping 200 days of data) [2025-09-26T18:36:32.161166] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T18:36:32.428432] [DEBUG] [LOCAL ] ELV: Primary data saved (51334 records). [2025-09-26T18:36:32.428615] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-26T18:36:32.430041] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. ELV took 42.3s. Estimated remaining: 3h 36m 54s. Rate: 7.6 symbols/min [2025-09-26T18:36:32.612637] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:32.675157] [DEBUG] [LOCAL ] EMN: Loaded 50743 existing records from primary storage. [2025-09-26T18:36:32.675379] [INFO ] [MAIN ] EMN: Loaded 50743 existing records. [2025-09-26T18:36:32.761830] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-26T18:36:32.877146] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:32.877567] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-26T18:36:32.877624] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-26T18:36:32.877901] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-26T18:36:32.877959] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-26T18:36:33.057853] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T18:36:33.293363] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:33.299298] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-26T18:36:33.556734] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-26T18:36:34.356726] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-26T18:36:35.156704] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-26T18:36:35.324588] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T18:36:35.575328] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-26T18:36:35.794946] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T18:36:35.956797] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-26T18:36:36.756776] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-26T18:36:37.569725] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-26T18:36:37.576440] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T18:36:37.930849] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T18:36:38.356689] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-26T18:36:38.669536] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T18:36:39.156772] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-26T18:36:39.825314] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T18:36:39.904759] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T18:36:39.956761] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-26T18:36:40.557216] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T18:36:40.756733] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-26T18:36:41.556752] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-26T18:36:41.841569] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T18:36:42.356738] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-26T18:36:42.920387] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T18:36:43.156969] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-26T18:36:43.235506] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:36:43.956800] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-26T18:36:44.242114] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T18:36:44.756785] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-26T18:36:45.556745] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-26T18:36:45.563251] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T18:36:46.179286] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:36:46.334959] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:36:46.356683] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-26T18:36:47.156707] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-26T18:36:47.402479] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T18:36:47.956722] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-26T18:36:48.756718] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-26T18:36:49.218116] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T18:36:49.203214] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:36:49.232409] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T18:36:49.243324] [INFO ] [REMOTE ] EMD: Full fetch complete (32182 records). [2025-09-26T18:36:49.243813] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-26T18:36:49.561805] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-26T18:36:49.638259] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-26T18:36:49.638348] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-26T18:36:49.638907] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-26T18:36:49.638972] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-26T18:36:49.639809] [DEBUG] [LOCAL ] EMD: Trimmed 32182 records to 21338 (keeping 200 days of data) [2025-09-26T18:36:49.769288] [DEBUG] [LOCAL ] EMD: Primary data saved (21338 records). [2025-09-26T18:36:49.769420] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-26T18:36:49.769507] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EMD took 35.8s. Estimated remaining: 3h 37m 7s. Rate: 7.6 symbols/min [2025-09-26T18:36:49.947416] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:49.965271] [DEBUG] [LOCAL ] EMO: Loaded 12593 existing records from primary storage. [2025-09-26T18:36:49.965428] [INFO ] [MAIN ] EMO: Loaded 12593 existing records. [2025-09-26T18:36:50.157892] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:50.158175] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-26T18:36:50.158227] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-26T18:36:50.158428] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-26T18:36:50.158488] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-26T18:36:50.282225] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:36:50.361846] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-26T18:36:50.569620] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:51.113328] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T18:36:51.156707] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-26T18:36:51.759879] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T18:36:51.761063] [INFO ] [REMOTE ] EMF: Full fetch complete (7148 records). [2025-09-26T18:36:51.761135] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-26T18:36:51.966695] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-26T18:36:52.138759] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-26T18:36:52.138896] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-26T18:36:52.139096] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-26T18:36:52.139138] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-26T18:36:52.139573] [DEBUG] [LOCAL ] EMF: Trimmed 7148 records to 3575 (keeping 200 days of data) [2025-09-26T18:36:52.164248] [DEBUG] [LOCAL ] EMF: Primary data saved (3575 records). [2025-09-26T18:36:52.164345] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-26T18:36:52.164455] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EMF took 22.0s. Estimated remaining: 3h 36m 47s. Rate: 7.6 symbols/min [2025-09-26T18:36:52.349798] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:52.356923] [DEBUG] [LOCAL ] EMP: Loaded 3055 existing records from primary storage. [2025-09-26T18:36:52.357022] [INFO ] [MAIN ] EMP: Loaded 3055 existing records. [2025-09-26T18:36:52.546813] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:52.547086] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-26T18:36:52.547135] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-26T18:36:52.547371] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-26T18:36:52.547432] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-26T18:36:52.768945] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-26T18:36:52.935595] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:53.490132] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:36:53.556732] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-26T18:36:53.725858] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T18:36:54.356802] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-26T18:36:54.469136] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T18:36:55.156762] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-26T18:36:55.648305] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-26T18:36:55.700751] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T18:36:55.956750] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-26T18:36:56.756798] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-26T18:36:57.556753] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-26T18:36:57.598151] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:36:57.605332] [INFO ] [REMOTE ] EME: Full fetch complete (46976 records). [2025-09-26T18:36:57.605489] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-26T18:36:58.033661] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-26T18:36:58.033789] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-26T18:36:58.034631] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-26T18:36:58.034733] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-26T18:36:58.036009] [DEBUG] [LOCAL ] EME: Trimmed 46976 records to 32035 (keeping 200 days of data) [2025-09-26T18:36:58.191792] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T18:36:58.320915] [DEBUG] [LOCAL ] EME: Primary data saved (32035 records). [2025-09-26T18:36:58.321151] [INFO ] [MAIN ] EME: Full history saved. [2025-09-26T18:36:58.321297] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EME took 38.8s. Estimated remaining: 3h 36m 35s. Rate: 7.6 symbols/min [2025-09-26T18:36:58.361813] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-26T18:36:58.475123] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T18:36:58.537931] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:36:58.593798] [DEBUG] [LOCAL ] EMR: Loaded 53639 existing records from primary storage. [2025-09-26T18:36:58.593981] [INFO ] [MAIN ] EMR: Loaded 53639 existing records. [2025-09-26T18:36:58.782055] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:36:58.782304] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-26T18:36:58.782354] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-26T18:36:58.782749] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-26T18:36:58.782809] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-26T18:36:58.988130] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T18:36:59.165547] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-26T18:36:59.201254] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:36:59.674840] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T18:36:59.956750] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-26T18:37:00.756735] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-26T18:37:00.828049] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-26T18:37:01.556734] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-26T18:37:02.091633] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T18:37:02.356706] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-26T18:37:02.486808] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T18:37:02.753564] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-26T18:37:03.156741] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-26T18:37:03.956726] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-26T18:37:04.756700] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-26T18:37:04.989890] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-26T18:37:05.106278] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-26T18:37:05.383799] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T18:37:05.556736] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-26T18:37:06.356772] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-26T18:37:07.090319] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T18:37:07.156789] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-26T18:37:07.939664] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T18:37:07.950481] [INFO ] [REMOTE ] EMN: Full fetch complete (71990 records). [2025-09-26T18:37:07.950704] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-26T18:37:07.963828] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-26T18:37:08.369336] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-26T18:37:08.369440] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-26T18:37:08.370457] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-26T18:37:08.370528] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-26T18:37:08.373049] [DEBUG] [LOCAL ] EMN: Trimmed 71990 records to 51117 (keeping 200 days of data) [2025-09-26T18:37:08.611879] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-26T18:37:08.744370] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:37:08.756707] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-26T18:37:08.845277] [DEBUG] [LOCAL ] EMN: Primary data saved (51117 records). [2025-09-26T18:37:08.845444] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-26T18:37:08.845562] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMN took 36.4s. Estimated remaining: 3h 36m 33s. Rate: 7.6 symbols/min [2025-09-26T18:37:09.045357] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:09.101423] [DEBUG] [LOCAL ] ENB: Loaded 53906 existing records from primary storage. [2025-09-26T18:37:09.101582] [INFO ] [MAIN ] ENB: Loaded 53906 existing records. [2025-09-26T18:37:09.305637] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:09.305969] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-26T18:37:09.306038] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-26T18:37:09.306438] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-26T18:37:09.306502] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-26T18:37:09.561894] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-26T18:37:09.730617] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:09.738893] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T18:37:10.356744] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-26T18:37:11.050518] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T18:37:11.156751] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-26T18:37:11.729844] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T18:37:11.734709] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T18:37:11.956752] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-26T18:37:12.756738] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-26T18:37:13.556763] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-26T18:37:13.570594] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:37:13.831064] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T18:37:14.099960] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T18:37:14.356727] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-26T18:37:15.156731] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-26T18:37:15.956732] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-26T18:37:16.425009] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-26T18:37:16.489217] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T18:37:16.760241] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-26T18:37:16.766726] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T18:37:17.385542] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T18:37:17.386933] [INFO ] [REMOTE ] EMP: Full fetch complete (4271 records). [2025-09-26T18:37:17.387015] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-26T18:37:17.558688] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-26T18:37:17.782610] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-26T18:37:17.782727] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-26T18:37:17.782889] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-26T18:37:17.782930] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-26T18:37:17.783307] [DEBUG] [LOCAL ] EMP: Trimmed 4271 records to 3062 (keeping 200 days of data) [2025-09-26T18:37:17.803690] [DEBUG] [LOCAL ] EMP: Primary data saved (3062 records). [2025-09-26T18:37:17.803803] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-26T18:37:17.803909] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. EMP took 25.6s. Estimated remaining: 3h 36m 27s. Rate: 7.6 symbols/min [2025-09-26T18:37:17.989992] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:17.995939] [DEBUG] [LOCAL ] ENFY: Loaded 3060 existing records from primary storage. [2025-09-26T18:37:17.996055] [INFO ] [MAIN ] ENFY: Loaded 3060 existing records. [2025-09-26T18:37:18.184157] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:18.184483] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-26T18:37:18.184543] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-26T18:37:18.184875] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-26T18:37:18.184939] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-26T18:37:18.361898] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-26T18:37:18.604264] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:19.156703] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-26T18:37:19.612982] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T18:37:19.863944] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-26T18:37:19.956776] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-26T18:37:20.274142] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T18:37:20.756771] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-26T18:37:21.234445] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T18:37:21.556726] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-26T18:37:21.892209] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T18:37:22.356726] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-26T18:37:23.156987] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-26T18:37:23.730758] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T18:37:23.731143] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T18:37:23.956691] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-26T18:37:23.994868] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T18:37:24.756732] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-26T18:37:25.556723] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-26T18:37:26.146537] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-26T18:37:26.356728] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-26T18:37:26.393849] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-26T18:37:26.542761] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:37:26.553272] [INFO ] [REMOTE ] EMR: Full fetch complete (77110 records). [2025-09-26T18:37:26.553406] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-26T18:37:26.863419] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T18:37:26.969361] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-26T18:37:26.969461] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-26T18:37:26.970390] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-26T18:37:26.970461] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-26T18:37:26.972248] [DEBUG] [LOCAL ] EMR: Trimmed 77110 records to 54027 (keeping 200 days of data) [2025-09-26T18:37:27.164709] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-26T18:37:27.338908] [DEBUG] [LOCAL ] EMR: Primary data saved (54027 records). [2025-09-26T18:37:27.339108] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-26T18:37:27.339269] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMR took 29.0s. Estimated remaining: 3h 36m 23s. Rate: 7.6 symbols/min [2025-09-26T18:37:27.520281] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:27.558460] [DEBUG] [LOCAL ] ENIC: Loaded 36725 existing records from primary storage. [2025-09-26T18:37:27.558634] [INFO ] [MAIN ] ENIC: Loaded 36725 existing records. [2025-09-26T18:37:27.751856] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:27.752144] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-26T18:37:27.752207] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-26T18:37:27.752519] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-26T18:37:27.752579] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-26T18:37:27.961879] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-26T18:37:28.139494] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:28.756705] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-26T18:37:28.958098] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T18:37:29.556764] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-26T18:37:29.973551] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:37:30.356751] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-26T18:37:30.412991] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-26T18:37:30.417257] [INFO ] [REMOTE ] EMO: Full fetch complete (17092 records). [2025-09-26T18:37:30.417338] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-26T18:37:30.826835] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-26T18:37:30.827041] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-26T18:37:30.827510] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-26T18:37:30.827577] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-26T18:37:30.828240] [DEBUG] [LOCAL ] EMO: Trimmed 17092 records to 12656 (keeping 200 days of data) [2025-09-26T18:37:30.910337] [DEBUG] [LOCAL ] EMO: Primary data saved (12656 records). [2025-09-26T18:37:30.910498] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-26T18:37:30.910636] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. EMO took 41.1s. Estimated remaining: 3h 36m 5s. Rate: 7.6 symbols/min [2025-09-26T18:37:31.114268] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:31.119838] [DEBUG] [LOCAL ] ENO: Loaded 1948 existing records from primary storage. [2025-09-26T18:37:31.119931] [INFO ] [MAIN ] ENO: Loaded 1948 existing records. [2025-09-26T18:37:31.167104] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-26T18:37:31.322050] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:31.322676] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-26T18:37:31.322884] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-26T18:37:31.323143] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-26T18:37:31.323257] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-26T18:37:31.524783] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T18:37:31.758707] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:31.762686] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (4.60 seconds). [2025-09-26T18:37:31.956747] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-26T18:37:32.596276] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T18:37:32.756723] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-26T18:37:33.218745] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T18:37:33.265298] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-26T18:37:33.556741] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-26T18:37:34.150967] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T18:37:34.356713] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-26T18:37:34.808622] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T18:37:35.156731] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-26T18:37:35.956756] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-26T18:37:36.459079] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T18:37:36.474125] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T18:37:36.756808] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-26T18:37:37.556755] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-26T18:37:38.356766] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-26T18:37:38.751691] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T18:37:39.020872] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:37:39.021023] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T18:37:39.156781] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-26T18:37:39.956745] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-26T18:37:40.553150] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-26T18:37:40.756725] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-26T18:37:40.916466] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T18:37:41.193490] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T18:37:41.556719] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-26T18:37:42.356771] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-26T18:37:42.982481] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T18:37:43.156719] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-26T18:37:43.968898] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-26T18:37:43.975692] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T18:37:44.321923] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T18:37:44.702683] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T18:37:44.756768] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-26T18:37:45.556744] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-26T18:37:46.132559] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T18:37:46.284281] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T18:37:46.356718] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-26T18:37:47.156728] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-26T18:37:47.705670] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T18:37:47.719700] [INFO ] [REMOTE ] ENFY: Full fetch complete (5617 records). [2025-09-26T18:37:47.721233] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-26T18:37:47.721159] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T18:37:47.962471] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-26T18:37:48.130095] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-26T18:37:48.130181] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-26T18:37:48.130358] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-26T18:37:48.130402] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-26T18:37:48.130844] [DEBUG] [LOCAL ] ENFY: Trimmed 5617 records to 3106 (keeping 200 days of data) [2025-09-26T18:37:48.149082] [DEBUG] [LOCAL ] ENFY: Primary data saved (3106 records). [2025-09-26T18:37:48.149174] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-26T18:37:48.149262] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENFY took 30.3s. Estimated remaining: 3h 36m 18s. Rate: 7.5 symbols/min [2025-09-26T18:37:48.334952] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:48.393013] [DEBUG] [LOCAL ] ENOV: Loaded 45531 existing records from primary storage. [2025-09-26T18:37:48.393184] [INFO ] [MAIN ] ENOV: Loaded 45531 existing records. [2025-09-26T18:37:48.608490] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:48.608820] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-26T18:37:48.608875] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-26T18:37:48.609203] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-26T18:37:48.609263] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-26T18:37:48.765672] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-26T18:37:49.005118] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:49.468701] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T18:37:49.475583] [INFO ] [REMOTE ] ENIC: Full fetch complete (51277 records). [2025-09-26T18:37:49.475758] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-26T18:37:49.561875] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-26T18:37:49.869776] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-26T18:37:49.869861] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-26T18:37:49.870527] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-26T18:37:49.870568] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-26T18:37:49.871700] [DEBUG] [LOCAL ] ENIC: Trimmed 51277 records to 36910 (keeping 200 days of data) [2025-09-26T18:37:50.080300] [DEBUG] [LOCAL ] ENIC: Primary data saved (36910 records). [2025-09-26T18:37:50.080466] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-26T18:37:50.080560] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENIC took 22.7s. Estimated remaining: 3h 35m 57s. Rate: 7.6 symbols/min [2025-09-26T18:37:50.259111] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:50.259308] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-09-26T18:37:50.259347] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-09-26T18:37:50.259492] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-26T18:37:50.259535] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-26T18:37:50.259589] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-26T18:37:50.259622] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-26T18:37:50.361966] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-26T18:37:50.655287] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:50.690036] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T18:37:50.886944] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:37:50.977845] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:37:51.156743] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-26T18:37:51.608058] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-26T18:37:51.956773] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-26T18:37:52.756763] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-26T18:37:53.354280] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T18:37:53.487087] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T18:37:53.556729] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-26T18:37:54.356772] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-26T18:37:55.162842] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-26T18:37:55.166198] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T18:37:55.720934] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-26T18:37:55.721915] [INFO ] [REMOTE ] ENO: Full fetch complete (3112 records). [2025-09-26T18:37:55.722006] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-26T18:37:55.961880] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-26T18:37:56.126536] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-26T18:37:56.126773] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-26T18:37:56.126927] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-26T18:37:56.127016] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-26T18:37:56.127943] [DEBUG] [LOCAL ] ENO: Trimmed 3112 records to 1952 (keeping 200 days of data) [2025-09-26T18:37:56.141329] [DEBUG] [LOCAL ] ENO: Primary data saved (1952 records). [2025-09-26T18:37:56.141437] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-26T18:37:56.141543] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENO took 25.2s. Estimated remaining: 3h 35m 45s. Rate: 7.6 symbols/min [2025-09-26T18:37:56.350671] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:56.358217] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T18:37:56.369255] [INFO ] [REMOTE ] ENB: Full fetch complete (77491 records). [2025-09-26T18:37:56.369458] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-26T18:37:56.656001] [DEBUG] [LOCAL ] ENS: Loaded 29684 existing records from primary storage. [2025-09-26T18:37:56.683952] [INFO ] [MAIN ] ENS: Loaded 29684 existing records. [2025-09-26T18:37:56.770852] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-26T18:37:57.007082] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-26T18:37:57.013330] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:57.013633] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-26T18:37:57.015422] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-26T18:37:57.015827] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-26T18:37:57.015625] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-26T18:37:57.016025] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-26T18:37:57.016847] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-26T18:37:57.016994] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-26T18:37:57.120708] [DEBUG] [LOCAL ] ENB: Trimmed 77491 records to 54295 (keeping 200 days of data) [2025-09-26T18:37:57.370513] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-26T18:37:57.522711] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:57.556673] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-26T18:37:57.776764] [DEBUG] [LOCAL ] ENB: Primary data saved (54295 records). [2025-09-26T18:37:57.776929] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-26T18:37:57.777027] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENB took 48.9s. Estimated remaining: 3h 35m 23s. Rate: 7.6 symbols/min [2025-09-26T18:37:57.962306] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:37:57.989890] [DEBUG] [LOCAL ] ENVA: Loaded 25782 existing records from primary storage. [2025-09-26T18:37:57.990081] [INFO ] [MAIN ] ENVA: Loaded 25782 existing records. [2025-09-26T18:37:58.183758] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:37:58.184031] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-26T18:37:58.184080] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-26T18:37:58.184331] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-26T18:37:58.184389] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-26T18:37:58.370593] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-26T18:37:58.608621] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:37:58.612903] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T18:37:59.047914] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T18:37:59.156793] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-26T18:37:59.906527] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:37:59.956705] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-26T18:38:00.099056] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T18:38:00.756777] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-26T18:38:01.078695] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T18:38:01.556742] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-26T18:38:02.332431] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T18:38:02.356684] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-26T18:38:02.851918] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-26T18:38:03.156747] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-26T18:38:03.747702] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T18:38:03.956729] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-26T18:38:04.674582] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:38:04.756769] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-26T18:38:04.852386] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T18:38:05.556738] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-26T18:38:05.994246] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T18:38:06.356758] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-26T18:38:06.440090] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T18:38:07.156745] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-26T18:38:07.742579] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:38:07.915874] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:38:07.956714] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-26T18:38:08.756777] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-26T18:38:09.357410] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:38:09.556732] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-26T18:38:10.312345] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T18:38:10.356744] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-26T18:38:11.156716] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-26T18:38:11.313808] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:38:11.392114] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T18:38:11.956747] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-26T18:38:12.740920] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T18:38:12.756733] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-26T18:38:12.816870] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T18:38:13.556760] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-26T18:38:14.182575] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T18:38:14.356753] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-26T18:38:15.166020] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-26T18:38:15.187787] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T18:38:15.885518] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T18:38:15.956722] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-26T18:38:16.733548] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T18:38:16.741831] [INFO ] [REMOTE ] ENR: Full fetch complete (58076 records). [2025-09-26T18:38:16.741966] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-26T18:38:16.743008] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:38:16.743116] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:38:16.743178] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:38:16.743227] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-26T18:38:16.743335] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-26T18:38:16.743408] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-26T18:38:16.743509] [DEBUG] [LOCAL ] ENR: No derivative data file found to delete. [2025-09-26T18:38:16.743602] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENR took 26.7s. Estimated remaining: 3h 35m 39s. Rate: 7.6 symbols/min [2025-09-26T18:38:16.765309] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-26T18:38:16.982439] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:17.006031] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T18:38:17.025120] [DEBUG] [LOCAL ] EOD: Loaded 14137 existing records from primary storage. [2025-09-26T18:38:17.025279] [INFO ] [MAIN ] EOD: Loaded 14137 existing records. [2025-09-26T18:38:17.222588] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:17.223412] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-26T18:38:17.223498] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-26T18:38:17.224070] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-26T18:38:17.224147] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-26T18:38:17.561909] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-26T18:38:17.625113] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:17.694721] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T18:38:18.356736] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-26T18:38:19.156733] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-26T18:38:19.654365] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:38:19.956746] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-26T18:38:20.115306] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-26T18:38:20.756736] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-26T18:38:20.945261] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-26T18:38:21.556741] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-26T18:38:21.823734] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T18:38:22.154686] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T18:38:22.213913] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (4.65 seconds). [2025-09-26T18:38:22.223295] [INFO ] [REMOTE ] ENOV: Full fetch complete (63153 records). [2025-09-26T18:38:22.223427] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-26T18:38:22.361832] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-26T18:38:22.720137] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-26T18:38:22.720282] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-26T18:38:22.722553] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-26T18:38:22.722675] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-26T18:38:22.733326] [DEBUG] [LOCAL ] ENOV: Trimmed 63153 records to 45799 (keeping 200 days of data) [2025-09-26T18:38:23.034043] [DEBUG] [LOCAL ] ENOV: Primary data saved (45799 records). [2025-09-26T18:38:23.034186] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-26T18:38:23.034455] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. ENOV took 34.9s. Estimated remaining: 3h 35m 28s. Rate: 7.6 symbols/min [2025-09-26T18:38:23.165073] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-26T18:38:23.246696] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:23.315232] [DEBUG] [LOCAL ] EOG: Loaded 53731 existing records from primary storage. [2025-09-26T18:38:23.315406] [INFO ] [MAIN ] EOG: Loaded 53731 existing records. [2025-09-26T18:38:23.514061] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:23.514359] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-26T18:38:23.514451] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-26T18:38:23.514846] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-26T18:38:23.514918] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-26T18:38:23.962184] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-26T18:38:24.007421] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:24.038558] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T18:38:24.085083] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-26T18:38:24.756732] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-26T18:38:25.306763] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:38:25.556741] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-26T18:38:25.790834] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:38:26.356745] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-26T18:38:26.946443] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T18:38:26.953505] [INFO ] [REMOTE ] ENVA: Full fetch complete (36598 records). [2025-09-26T18:38:26.953745] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-26T18:38:27.161875] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-26T18:38:27.365415] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-26T18:38:27.365534] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-26T18:38:27.366217] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-26T18:38:27.366389] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-26T18:38:27.391241] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T18:38:27.397954] [DEBUG] [LOCAL ] ENVA: Trimmed 36598 records to 25914 (keeping 200 days of data) [2025-09-26T18:38:27.572631] [DEBUG] [LOCAL ] ENVA: Primary data saved (25914 records). [2025-09-26T18:38:27.572810] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-26T18:38:27.572922] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENVA took 29.8s. Estimated remaining: 3h 35m 12s. Rate: 7.6 symbols/min [2025-09-26T18:38:27.780791] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:27.796240] [DEBUG] [LOCAL ] EOI: Loaded 10652 existing records from primary storage. [2025-09-26T18:38:27.796352] [INFO ] [MAIN ] EOI: Loaded 10652 existing records. [2025-09-26T18:38:27.957939] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-26T18:38:27.983300] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:27.983746] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-26T18:38:27.983816] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-26T18:38:27.984153] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-26T18:38:27.984214] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-26T18:38:28.374529] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:28.665821] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T18:38:28.756778] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-26T18:38:29.093129] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T18:38:29.556743] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-26T18:38:30.277321] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:38:30.284551] [INFO ] [REMOTE ] ENS: Full fetch complete (42031 records). [2025-09-26T18:38:30.284771] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-26T18:38:30.364585] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-26T18:38:30.761947] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:38:30.787252] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-26T18:38:30.787361] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-26T18:38:30.788073] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-26T18:38:30.788140] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-26T18:38:30.789360] [DEBUG] [LOCAL ] ENS: Trimmed 42031 records to 29869 (keeping 200 days of data) [2025-09-26T18:38:31.014993] [DEBUG] [LOCAL ] ENS: Primary data saved (29869 records). [2025-09-26T18:38:31.015201] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-26T18:38:31.015337] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. ENS took 34.9s. Estimated remaining: 3h 34m 54s. Rate: 7.6 symbols/min [2025-09-26T18:38:31.167721] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-26T18:38:31.204457] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:31.224913] [DEBUG] [LOCAL ] EOS: Loaded 15445 existing records from primary storage. [2025-09-26T18:38:31.225071] [INFO ] [MAIN ] EOS: Loaded 15445 existing records. [2025-09-26T18:38:31.430334] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:31.430603] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-26T18:38:31.430683] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-26T18:38:31.430915] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-26T18:38:31.430974] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-26T18:38:31.859035] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:31.956769] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-26T18:38:32.020991] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T18:38:32.104009] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:38:32.756754] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-26T18:38:32.977950] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T18:38:33.556735] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-26T18:38:34.356697] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-26T18:38:34.513581] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T18:38:34.705187] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T18:38:34.912122] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-26T18:38:35.156737] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-26T18:38:35.956736] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-26T18:38:36.132778] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:38:36.756754] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-26T18:38:37.140377] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T18:38:37.316205] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T18:38:37.556748] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-26T18:38:38.356745] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-26T18:38:39.156699] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-26T18:38:39.355134] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:38:39.536537] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T18:38:39.941399] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:38:39.956681] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-26T18:38:40.756701] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-26T18:38:40.823497] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T18:38:41.556737] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-26T18:38:41.736199] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T18:38:42.182334] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T18:38:42.356775] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-26T18:38:43.156784] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-26T18:38:43.956709] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-26T18:38:44.167534] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T18:38:44.188984] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:38:44.621682] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-26T18:38:44.756766] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-26T18:38:45.556718] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-26T18:38:45.616935] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T18:38:46.356713] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-26T18:38:46.422162] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-26T18:38:47.082892] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T18:38:47.087570] [INFO ] [REMOTE ] EOD: Full fetch complete (20013 records). [2025-09-26T18:38:47.087751] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-26T18:38:47.161857] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-26T18:38:47.480068] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-26T18:38:47.480160] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-26T18:38:47.480660] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-26T18:38:47.480726] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-26T18:38:47.481479] [DEBUG] [LOCAL ] EOD: Trimmed 20013 records to 14232 (keeping 200 days of data) [2025-09-26T18:38:47.578122] [DEBUG] [LOCAL ] EOD: Primary data saved (14232 records). [2025-09-26T18:38:47.578304] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-26T18:38:47.578445] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOD took 30.8s. Estimated remaining: 3h 35m 5s. Rate: 7.6 symbols/min [2025-09-26T18:38:47.773256] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:47.788793] [DEBUG] [LOCAL ] EOT: Loaded 6891 existing records from primary storage. [2025-09-26T18:38:47.788993] [INFO ] [MAIN ] EOT: Loaded 6891 existing records. [2025-09-26T18:38:47.957803] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-26T18:38:47.980350] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:47.982040] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-26T18:38:47.982112] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-26T18:38:47.982283] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-26T18:38:47.982371] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-26T18:38:48.352831] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T18:38:48.375059] [INFO ] [REMOTE ] EOI: Full fetch complete (16040 records). [2025-09-26T18:38:48.395011] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-26T18:38:48.399173] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:48.762433] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-26T18:38:48.790700] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-26T18:38:48.790833] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-26T18:38:48.791245] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-26T18:38:48.791289] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-26T18:38:48.791889] [DEBUG] [LOCAL ] EOI: Trimmed 16040 records to 10783 (keeping 200 days of data) [2025-09-26T18:38:48.860361] [DEBUG] [LOCAL ] EOI: Primary data saved (10783 records). [2025-09-26T18:38:48.860512] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-26T18:38:48.860680] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOI took 21.3s. Estimated remaining: 3h 34m 43s. Rate: 7.6 symbols/min [2025-09-26T18:38:49.034703] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:38:49.063002] [DEBUG] [LOCAL ] EPAC: Loaded 27252 existing records from primary storage. [2025-09-26T18:38:49.063145] [INFO ] [MAIN ] EPAC: Loaded 27252 existing records. [2025-09-26T18:38:49.255598] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:38:49.255998] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-26T18:38:49.256057] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-26T18:38:49.256351] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-26T18:38:49.256411] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-26T18:38:49.561915] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-26T18:38:49.640141] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:38:49.833416] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T18:38:49.872054] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T18:38:50.356740] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-26T18:38:50.491429] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T18:38:50.898383] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-26T18:38:51.156775] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-26T18:38:51.956768] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-26T18:38:52.756748] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-26T18:38:52.888607] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T18:38:53.112910] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T18:38:53.556752] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-26T18:38:53.979697] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:38:54.220359] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T18:38:54.356790] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-26T18:38:55.156741] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-26T18:38:55.956710] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-26T18:38:56.155784] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:38:56.210002] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T18:38:56.406983] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-26T18:38:56.756723] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-26T18:38:57.556724] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-26T18:38:57.890707] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T18:38:58.093310] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T18:38:58.356738] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-26T18:38:59.156706] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-26T18:38:59.598392] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:38:59.956759] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-26T18:39:00.756715] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-26T18:39:00.912817] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:39:00.910632] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T18:39:01.556723] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-26T18:39:01.870408] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T18:39:01.873603] [INFO ] [REMOTE ] EOS: Full fetch complete (22966 records). [2025-09-26T18:39:01.873708] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-26T18:39:01.874287] [FATAL] [VALIDATOR ] EOS: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:39:01.874387] [FATAL] [MAIN ] EOS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:39:01.874454] [WARN ] [MAIN ] EOS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:39:01.874529] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-26T18:39:01.874611] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-09-26T18:39:01.874698] [INFO ] [LOCAL ] EOS: Starting deletion of derivative data. [2025-09-26T18:39:01.875220] [DEBUG] [LOCAL ] EOS: Deleted derivative data file. [2025-09-26T18:39:01.875376] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EOS took 30.9s. Estimated remaining: 3h 34m 46s. Rate: 7.6 symbols/min [2025-09-26T18:39:02.067018] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T18:39:02.105527] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:02.154409] [DEBUG] [LOCAL ] EPAM: Loaded 40102 existing records from primary storage. [2025-09-26T18:39:02.154561] [INFO ] [MAIN ] EPAM: Loaded 40102 existing records. [2025-09-26T18:39:02.350060] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:02.350396] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-26T18:39:02.350456] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-26T18:39:02.350756] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-26T18:39:02.350819] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-26T18:39:02.362813] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-26T18:39:02.762190] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:03.156736] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-26T18:39:03.956718] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-26T18:39:04.446542] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-26T18:39:04.486351] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:39:04.756706] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-26T18:39:04.969278] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-26T18:39:05.556723] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-26T18:39:06.055283] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:39:06.315849] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T18:39:06.356719] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-26T18:39:07.156765] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-26T18:39:07.805618] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-26T18:39:07.956759] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-26T18:39:08.120998] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T18:39:08.131830] [INFO ] [REMOTE ] EOG: Full fetch complete (77272 records). [2025-09-26T18:39:08.131999] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-26T18:39:08.483559] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T18:39:08.564340] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-26T18:39:08.564443] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-26T18:39:08.565554] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-26T18:39:08.565633] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-26T18:39:08.567521] [DEBUG] [LOCAL ] EOG: Trimmed 77272 records to 54121 (keeping 200 days of data) [2025-09-26T18:39:08.771546] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-26T18:39:08.943520] [DEBUG] [LOCAL ] EOG: Primary data saved (54121 records). [2025-09-26T18:39:08.943717] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-26T18:39:08.943839] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOG took 45.9s. Estimated remaining: 3h 34m 36s. Rate: 7.6 symbols/min [2025-09-26T18:39:09.126515] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:09.126752] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-09-26T18:39:09.126800] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-09-26T18:39:09.126962] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-26T18:39:09.127005] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-26T18:39:09.127048] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-09-26T18:39:09.127081] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-26T18:39:09.515022] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:09.556758] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-26T18:39:10.360552] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-26T18:39:10.364101] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:39:10.377753] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T18:39:11.156724] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-26T18:39:11.956726] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-26T18:39:12.094260] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T18:39:12.162595] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T18:39:12.756721] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-26T18:39:12.919582] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T18:39:12.921633] [INFO ] [REMOTE ] EOT: Full fetch complete (10762 records). [2025-09-26T18:39:12.921736] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-26T18:39:13.314702] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-26T18:39:13.314794] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-26T18:39:13.315065] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-26T18:39:13.315104] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-26T18:39:13.315625] [DEBUG] [LOCAL ] EOT: Trimmed 10762 records to 6916 (keeping 200 days of data) [2025-09-26T18:39:13.365963] [DEBUG] [LOCAL ] EOT: Primary data saved (6916 records). [2025-09-26T18:39:13.366126] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-26T18:39:13.366225] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EOT took 25.8s. Estimated remaining: 3h 34m 21s. Rate: 7.6 symbols/min [2025-09-26T18:39:13.551791] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:13.556747] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-26T18:39:13.618403] [DEBUG] [LOCAL ] EPD: Loaded 54001 existing records from primary storage. [2025-09-26T18:39:13.618569] [INFO ] [MAIN ] EPD: Loaded 54001 existing records. [2025-09-26T18:39:13.807504] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:13.807812] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-26T18:39:13.807872] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-26T18:39:13.808180] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-26T18:39:13.808239] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-26T18:39:14.195714] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:14.217936] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T18:39:14.356748] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-26T18:39:15.099004] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:39:15.156732] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-26T18:39:15.956686] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-26T18:39:16.448928] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T18:39:16.492999] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-26T18:39:16.756729] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-26T18:39:17.467275] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:39:17.556749] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-26T18:39:18.146123] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T18:39:18.356765] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-26T18:39:19.156773] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-26T18:39:19.236626] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:39:19.658342] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T18:39:19.956780] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-26T18:39:20.756739] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-26T18:39:21.267874] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-26T18:39:21.362680] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:39:21.556757] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-26T18:39:22.356734] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-26T18:39:22.466050] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T18:39:23.156752] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-26T18:39:23.228369] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T18:39:23.817236] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:39:23.956738] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-26T18:39:24.704724] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T18:39:24.756719] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-26T18:39:25.537269] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T18:39:25.556702] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-26T18:39:26.311478] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:39:26.356705] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-26T18:39:27.036456] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T18:39:27.042259] [INFO ] [REMOTE ] EPAC: Full fetch complete (39098 records). [2025-09-26T18:39:27.042366] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-26T18:39:27.161795] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-26T18:39:27.456140] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-26T18:39:27.456246] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-26T18:39:27.457248] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-26T18:39:27.457325] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-26T18:39:27.458533] [DEBUG] [LOCAL ] EPAC: Trimmed 39098 records to 27416 (keeping 200 days of data) [2025-09-26T18:39:27.630332] [DEBUG] [LOCAL ] EPAC: Primary data saved (27416 records). [2025-09-26T18:39:27.630483] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-26T18:39:27.630629] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPAC took 38.8s. Estimated remaining: 3h 34m 26s. Rate: 7.6 symbols/min [2025-09-26T18:39:27.813752] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:27.868990] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:39:27.893291] [DEBUG] [LOCAL ] EPR: Loaded 44449 existing records from primary storage. [2025-09-26T18:39:27.893470] [INFO ] [MAIN ] EPR: Loaded 44449 existing records. [2025-09-26T18:39:27.961916] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-26T18:39:28.084700] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:28.084964] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-26T18:39:28.085011] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-26T18:39:28.085259] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-26T18:39:28.085318] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-26T18:39:28.481380] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:28.756756] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-26T18:39:28.807380] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:39:29.509595] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T18:39:29.556724] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-26T18:39:30.356728] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-26T18:39:30.461957] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:39:30.644383] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T18:39:31.156756] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-26T18:39:31.704894] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T18:39:31.956732] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-26T18:39:32.540854] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T18:39:32.756736] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-26T18:39:33.556712] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-26T18:39:33.741373] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T18:39:33.959209] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-26T18:39:33.967459] [INFO ] [REMOTE ] EPC: Full fetch complete (56701 records). [2025-09-26T18:39:33.967590] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-26T18:39:34.362044] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-26T18:39:34.449973] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-26T18:39:34.450081] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-26T18:39:34.451008] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-26T18:39:34.451074] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-26T18:39:34.452494] [DEBUG] [LOCAL ] EPC: Trimmed 56701 records to 40383 (keeping 200 days of data) [2025-09-26T18:39:34.710203] [DEBUG] [LOCAL ] EPC: Primary data saved (40383 records). [2025-09-26T18:39:34.710332] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-26T18:39:34.710450] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPC took 25.8s. Estimated remaining: 3h 34m 16s. Rate: 7.6 symbols/min [2025-09-26T18:39:34.894467] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:34.920506] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T18:39:34.969870] [DEBUG] [LOCAL ] EPRT: Loaded 48991 existing records from primary storage. [2025-09-26T18:39:34.970056] [INFO ] [MAIN ] EPRT: Loaded 48991 existing records. [2025-09-26T18:39:35.160752] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-26T18:39:35.164204] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:35.165659] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-26T18:39:35.165721] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-26T18:39:35.166353] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-26T18:39:35.166439] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-26T18:39:35.562130] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:35.942407] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T18:39:35.956668] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-26T18:39:36.628446] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:39:36.637212] [INFO ] [REMOTE ] EPAM: Full fetch complete (55935 records). [2025-09-26T18:39:36.637377] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-26T18:39:36.638190] [FATAL] [VALIDATOR ] EPAM: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:39:36.638287] [FATAL] [MAIN ] EPAM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:39:36.638333] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:39:36.638375] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-26T18:39:36.638443] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-09-26T18:39:36.638481] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-09-26T18:39:36.639089] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-09-26T18:39:36.639198] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPAM took 34.8s. Estimated remaining: 3h 33m 56s. Rate: 7.6 symbols/min [2025-09-26T18:39:36.761817] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-26T18:39:36.825142] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:36.838552] [DEBUG] [LOCAL ] EQBK: Loaded 10987 existing records from primary storage. [2025-09-26T18:39:36.838758] [INFO ] [MAIN ] EQBK: Loaded 10987 existing records. [2025-09-26T18:39:37.034861] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:39:37.035145] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-26T18:39:37.035196] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-26T18:39:37.035403] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-26T18:39:37.035460] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-26T18:39:37.418145] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:37.556739] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-26T18:39:37.880718] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T18:39:37.960371] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T18:39:38.166238] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-26T18:39:38.356790] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-26T18:39:39.156764] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-26T18:39:39.919134] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T18:39:39.956674] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-26T18:39:40.177801] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T18:39:40.424596] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-26T18:39:40.756751] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-26T18:39:41.556723] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-26T18:39:42.356763] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-26T18:39:42.746862] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T18:39:42.757453] [INFO ] [REMOTE ] EPD: Full fetch complete (77253 records). [2025-09-26T18:39:42.757684] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-26T18:39:42.758558] [FATAL] [VALIDATOR ] EPD: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:39:42.758693] [FATAL] [MAIN ] EPD: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:39:42.758773] [WARN ] [MAIN ] EPD: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:39:42.758872] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-26T18:39:42.758973] [DEBUG] [LOCAL ] EPD: No primary data file found to delete. [2025-09-26T18:39:42.759034] [INFO ] [LOCAL ] EPD: Starting deletion of derivative data. [2025-09-26T18:39:42.759520] [DEBUG] [LOCAL ] EPD: Deleted derivative data file. [2025-09-26T18:39:42.759627] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EPD took 29.4s. Estimated remaining: 3h 33m 44s. Rate: 7.6 symbols/min [2025-09-26T18:39:42.926514] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T18:39:42.957557] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:39:42.957907] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-09-26T18:39:42.958110] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-09-26T18:39:42.958339] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-26T18:39:42.958410] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-26T18:39:42.958665] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-09-26T18:39:42.958769] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-26T18:39:43.156739] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-26T18:39:43.161153] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:39:43.387093] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:39:43.956770] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-26T18:39:44.679045] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:39:44.756739] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-26T18:39:45.541729] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T18:39:45.556683] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-26T18:39:46.138312] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T18:39:46.356737] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-26T18:39:46.513068] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T18:39:47.156762] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-26T18:39:47.741093] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:39:47.956737] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-26T18:39:48.559832] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:39:48.756773] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-26T18:39:49.556735] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-26T18:39:49.616360] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T18:39:49.639827] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T18:39:50.356743] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-26T18:39:50.954290] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:39:51.156782] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-26T18:39:51.569136] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T18:39:51.655990] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T18:39:51.956762] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-26T18:39:52.756711] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-26T18:39:52.897338] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T18:39:53.556727] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-26T18:39:54.219054] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T18:39:54.356768] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-26T18:39:55.156702] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-26T18:39:55.229860] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T18:39:55.956818] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-26T18:39:56.169520] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T18:39:56.539792] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T18:39:56.756756] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-26T18:39:57.506967] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:39:57.534146] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T18:39:57.556716] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-26T18:39:58.356723] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-26T18:39:58.907756] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T18:39:59.156757] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-26T18:39:59.770207] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:39:59.956831] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-26T18:40:00.756822] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-26T18:40:01.032348] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T18:40:01.556772] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-26T18:40:01.658479] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T18:40:02.356849] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-26T18:40:02.446996] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T18:40:02.450708] [INFO ] [REMOTE ] EQBK: Full fetch complete (15360 records). [2025-09-26T18:40:02.450932] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-26T18:40:02.841794] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-26T18:40:02.841935] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-26T18:40:02.842320] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-26T18:40:02.842392] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-26T18:40:02.843048] [DEBUG] [LOCAL ] EQBK: Trimmed 15360 records to 11050 (keeping 200 days of data) [2025-09-26T18:40:02.913756] [DEBUG] [LOCAL ] EQBK: Primary data saved (11050 records). [2025-09-26T18:40:02.913920] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-26T18:40:02.914038] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EQBK took 26.3s. Estimated remaining: 3h 34m 2s. Rate: 7.6 symbols/min [2025-09-26T18:40:03.113662] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:03.114095] [DEBUG] [LOCAL ] EQNR: No existing data file found in primary storage. [2025-09-26T18:40:03.114164] [WARN ] [MAIN ] EQNR: No existing data found, performing full refresh instead. [2025-09-26T18:40:03.114567] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-26T18:40:03.114781] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-26T18:40:03.114966] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-09-26T18:40:03.115185] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-26T18:40:03.163996] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-26T18:40:03.478900] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T18:40:03.577143] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:03.956743] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-26T18:40:04.104679] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:40:04.756794] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-26T18:40:05.199870] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T18:40:05.209342] [INFO ] [REMOTE ] EPR: Full fetch complete (62832 records). [2025-09-26T18:40:05.209597] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-26T18:40:05.557816] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-26T18:40:05.635394] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-26T18:40:05.635557] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-26T18:40:05.636618] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-26T18:40:05.636799] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-26T18:40:05.638839] [DEBUG] [LOCAL ] EPR: Trimmed 62832 records to 44722 (keeping 200 days of data) [2025-09-26T18:40:05.778319] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T18:40:05.974969] [DEBUG] [LOCAL ] EPR: Primary data saved (44722 records). [2025-09-26T18:40:05.975127] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-26T18:40:05.975241] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EPR took 38.3s. Estimated remaining: 3h 33m 44s. Rate: 7.6 symbols/min [2025-09-26T18:40:06.164546] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:06.214890] [DEBUG] [LOCAL ] EQR: Loaded 51810 existing records from primary storage. [2025-09-26T18:40:06.215053] [INFO ] [MAIN ] EQR: Loaded 51810 existing records. [2025-09-26T18:40:06.361939] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-26T18:40:06.431320] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:06.431777] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-26T18:40:06.431863] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-26T18:40:06.432210] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-26T18:40:06.432333] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-26T18:40:06.769331] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T18:40:06.957963] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:07.156719] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-26T18:40:07.352190] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T18:40:07.871266] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T18:40:07.956769] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-26T18:40:08.756698] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-26T18:40:08.919958] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T18:40:09.556775] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-26T18:40:09.774635] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T18:40:10.356715] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-26T18:40:10.483360] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T18:40:10.956615] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:40:11.156750] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-26T18:40:11.956781] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-26T18:40:12.220909] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T18:40:12.756726] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-26T18:40:12.885832] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T18:40:12.896161] [INFO ] [REMOTE ] EPRT: Full fetch complete (68749 records). [2025-09-26T18:40:12.896363] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-26T18:40:13.313044] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-26T18:40:13.313184] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-26T18:40:13.314329] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-26T18:40:13.314484] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-26T18:40:13.317017] [DEBUG] [LOCAL ] EPRT: Trimmed 68749 records to 49306 (keeping 200 days of data) [2025-09-26T18:40:13.446376] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:40:13.557427] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-26T18:40:13.684395] [DEBUG] [LOCAL ] EPRT: Primary data saved (49306 records). [2025-09-26T18:40:13.684610] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-26T18:40:13.684756] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EPRT took 39.0s. Estimated remaining: 3h 33m 35s. Rate: 7.6 symbols/min [2025-09-26T18:40:14.356765] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-26T18:40:14.426229] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T18:40:14.892675] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:40:15.156770] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-26T18:40:15.799411] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T18:40:15.956744] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-26T18:40:16.756822] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-26T18:40:17.151123] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-26T18:40:17.340856] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T18:40:17.556733] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-26T18:40:18.356722] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-26T18:40:18.472131] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T18:40:18.483443] [INFO ] [REMOTE ] EQH: Full fetch complete (76341 records). [2025-09-26T18:40:18.483720] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-26T18:40:18.905541] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-26T18:40:18.905767] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-26T18:40:18.907006] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-26T18:40:18.907117] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-26T18:40:18.909404] [DEBUG] [LOCAL ] EQH: Trimmed 76341 records to 53435 (keeping 200 days of data) [2025-09-26T18:40:19.046339] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T18:40:19.182248] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-26T18:40:19.306637] [DEBUG] [LOCAL ] EQH: Primary data saved (53435 records). [2025-09-26T18:40:19.306915] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-26T18:40:19.307053] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 36.5s. Estimated remaining: 3h 33m 22s. Rate: 7.6 symbols/min [2025-09-26T18:40:20.018793] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T18:40:20.030596] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-26T18:40:20.506335] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T18:40:20.756727] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-26T18:40:21.519791] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T18:40:21.556716] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-26T18:40:22.168175] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T18:40:22.356729] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-26T18:40:23.089304] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:40:23.156738] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-26T18:40:23.858660] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T18:40:23.956775] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-26T18:40:24.855459] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:40:24.866066] [INFO ] [REMOTE ] EQNR: Full fetch complete (76773 records). [2025-09-26T18:40:24.866224] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-26T18:40:25.309331] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-26T18:40:25.309496] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-26T18:40:25.310509] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-26T18:40:25.311081] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-26T18:40:25.349385] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T18:40:25.361157] [DEBUG] [LOCAL ] EQNR: Trimmed 76773 records to 53809 (keeping 200 days of data) [2025-09-26T18:40:25.365040] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-26T18:40:25.724146] [DEBUG] [LOCAL ] EQNR: Primary data saved (53809 records). [2025-09-26T18:40:25.724308] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-26T18:40:25.724523] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQNR took 22.8s. Estimated remaining: 3h 33m 11s. Rate: 7.6 symbols/min [2025-09-26T18:40:27.311551] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T18:40:27.321837] [INFO ] [REMOTE ] EQR: Full fetch complete (73866 records). [2025-09-26T18:40:27.321984] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-26T18:40:27.746249] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-26T18:40:27.746367] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-26T18:40:27.747375] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-26T18:40:27.747448] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-26T18:40:27.749189] [DEBUG] [LOCAL ] EQR: Trimmed 73866 records to 52190 (keeping 200 days of data) [2025-09-26T18:40:28.106592] [DEBUG] [LOCAL ] EQR: Primary data saved (52190 records). [2025-09-26T18:40:28.106775] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-26T18:40:28.106887] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQR took 22.1s. Estimated remaining: 3h 32m 51s. Rate: 7.6 symbols/min [2025-09-26T18:40:28.857013] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:28.907802] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:28.908838] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:28.912732] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-26T18:40:28.913731] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:28.914412] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-26T18:40:28.915825] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-26T18:40:28.915882] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-26T18:40:28.915930] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-26T18:40:28.915972] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-26T18:40:28.993547] [DEBUG] [LOCAL ] EQV: Loaded 2830 existing records from primary storage. [2025-09-26T18:40:29.022726] [INFO ] [MAIN ] EQV: Loaded 2830 existing records. [2025-09-26T18:40:29.443147] [DEBUG] [LOCAL ] ERJ: Loaded 51109 existing records from primary storage. [2025-09-26T18:40:29.467493] [INFO ] [MAIN ] ERJ: Loaded 51109 existing records. [2025-09-26T18:40:29.553837] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-09-26T18:40:29.654617] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:29.680715] [INFO ] [MAIN ] EQT: Loaded 54072 existing records. [2025-09-26T18:40:29.722936] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:29.737754] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-26T18:40:29.749538] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-26T18:40:29.765714] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-26T18:40:29.854689] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-26T18:40:29.854857] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-26T18:40:29.954580] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:30.113585] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-26T18:40:30.142192] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-26T18:40:30.226936] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:30.253504] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-26T18:40:30.271057] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-26T18:40:30.297921] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-26T18:40:30.338684] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-26T18:40:30.458039] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-26T18:40:30.493285] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-26T18:40:30.478383] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T18:40:30.553368] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-26T18:40:30.705971] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:30.766676] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-26T18:40:31.153845] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:31.170181] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-26T18:40:31.264437] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:31.266997] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T18:40:31.268415] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-26T18:40:31.267265] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-26T18:40:31.591763] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T18:40:31.594123] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-26T18:40:31.766312] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-26T18:40:31.767575] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-26T18:40:32.075260] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-26T18:40:32.076943] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-26T18:40:32.160939] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-26T18:40:32.545009] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T18:40:32.590700] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T18:40:32.761800] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-26T18:40:32.780922] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:40:33.144928] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-26T18:40:33.556739] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-26T18:40:34.356790] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-26T18:40:34.724387] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-26T18:40:35.142695] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T18:40:35.156687] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-26T18:40:35.956774] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-26T18:40:36.264414] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-26T18:40:36.586998] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T18:40:36.756772] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-26T18:40:37.556740] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-26T18:40:38.356689] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-26T18:40:38.847088] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T18:40:38.965480] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:40:39.156767] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-26T18:40:39.307300] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T18:40:39.544907] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-26T18:40:39.956737] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-26T18:40:40.756722] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-26T18:40:40.827707] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T18:40:40.829148] [INFO ] [REMOTE ] EQS: Full fetch complete (2522 records). [2025-09-26T18:40:40.829219] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-26T18:40:41.032750] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-26T18:40:41.032990] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:40:41.033063] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:40:41.033128] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-26T18:40:41.033223] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-26T18:40:41.033283] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-26T18:40:41.033332] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-26T18:40:41.033397] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQS took 12.9s. Estimated remaining: 3h 32m 54s. Rate: 7.6 symbols/min [2025-09-26T18:40:41.229857] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:41.291808] [DEBUG] [LOCAL ] ERO: Loaded 41546 existing records from primary storage. [2025-09-26T18:40:41.291956] [INFO ] [MAIN ] ERO: Loaded 41546 existing records. [2025-09-26T18:40:41.505869] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:41.506225] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-26T18:40:41.506280] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-26T18:40:41.506559] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-26T18:40:41.506617] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-26T18:40:41.563916] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-26T18:40:41.906336] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:42.356807] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-26T18:40:42.745440] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-26T18:40:43.156737] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-26T18:40:43.196727] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:40:43.859257] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-26T18:40:43.956768] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-26T18:40:44.000739] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T18:40:44.756775] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-26T18:40:45.556705] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-26T18:40:45.675444] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T18:40:46.215325] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T18:40:46.356717] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-26T18:40:46.445553] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:40:46.852482] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-26T18:40:47.156737] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-26T18:40:47.741999] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T18:40:47.956752] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-26T18:40:48.756763] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-26T18:40:49.390147] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T18:40:49.556737] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-26T18:40:50.356728] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-26T18:40:50.471563] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:40:50.674176] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:40:50.686742] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-26T18:40:51.156767] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-26T18:40:51.956754] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-26T18:40:52.566075] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:40:52.756745] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-26T18:40:52.994100] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T18:40:53.305605] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T18:40:53.307138] [INFO ] [REMOTE ] EQV: Full fetch complete (5754 records). [2025-09-26T18:40:53.307285] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-26T18:40:53.562132] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-26T18:40:53.724814] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-26T18:40:53.724900] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-26T18:40:53.725137] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-26T18:40:53.725202] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-26T18:40:53.725805] [DEBUG] [LOCAL ] EQV: Trimmed 5754 records to 2840 (keeping 200 days of data) [2025-09-26T18:40:53.750136] [DEBUG] [LOCAL ] EQV: Primary data saved (2840 records). [2025-09-26T18:40:53.750293] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-26T18:40:53.750406] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. EQV took 25.6s. Estimated remaining: 3h 32m 56s. Rate: 7.6 symbols/min [2025-09-26T18:40:53.951037] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:40:54.018463] [DEBUG] [LOCAL ] ES: Loaded 52919 existing records from primary storage. [2025-09-26T18:40:54.018716] [INFO ] [MAIN ] ES: Loaded 52919 existing records. [2025-09-26T18:40:54.225116] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:40:54.225428] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-26T18:40:54.225510] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-26T18:40:54.225826] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-26T18:40:54.225890] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-26T18:40:54.361848] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-26T18:40:54.651046] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:40:55.156787] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-26T18:40:55.616385] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T18:40:55.693105] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T18:40:55.956782] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-26T18:40:56.756752] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-26T18:40:57.058307] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T18:40:57.556731] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-26T18:40:57.973739] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T18:40:58.033700] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:40:58.356737] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-26T18:40:59.112256] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T18:40:59.156710] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-26T18:40:59.385815] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T18:40:59.956772] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-26T18:41:00.756763] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-26T18:41:00.845076] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T18:41:01.040688] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T18:41:01.556733] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-26T18:41:02.331058] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T18:41:02.356683] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-26T18:41:03.156701] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-26T18:41:03.426320] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T18:41:03.956694] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-26T18:41:04.522075] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-26T18:41:04.756740] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-26T18:41:05.122890] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T18:41:05.486940] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T18:41:05.556748] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-26T18:41:06.309895] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:41:06.356727] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-26T18:41:07.156781] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-26T18:41:07.855847] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:41:07.956767] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-26T18:41:08.756705] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-26T18:41:08.898962] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T18:41:08.909250] [INFO ] [REMOTE ] EQT: Full fetch complete (77302 records). [2025-09-26T18:41:08.909417] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-26T18:41:08.910255] [FATAL] [VALIDATOR ] EQT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:41:08.910351] [FATAL] [MAIN ] EQT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:41:08.910397] [WARN ] [MAIN ] EQT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:41:08.910475] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-26T18:41:08.910550] [DEBUG] [LOCAL ] EQT: No primary data file found to delete. [2025-09-26T18:41:08.910590] [INFO ] [LOCAL ] EQT: Starting deletion of derivative data. [2025-09-26T18:41:08.911030] [DEBUG] [LOCAL ] EQT: Deleted derivative data file. [2025-09-26T18:41:08.911203] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. EQT took 40.8s. Estimated remaining: 3h 33m 4s. Rate: 7.5 symbols/min [2025-09-26T18:41:09.093554] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:09.125824] [DEBUG] [LOCAL ] ESAB: Loaded 26482 existing records from primary storage. [2025-09-26T18:41:09.125972] [INFO ] [MAIN ] ESAB: Loaded 26482 existing records. [2025-09-26T18:41:09.324979] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:09.325387] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-26T18:41:09.325458] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-26T18:41:09.325748] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-26T18:41:09.325812] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-26T18:41:09.778474] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:09.779097] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-26T18:41:09.810225] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:41:09.822593] [INFO ] [REMOTE ] ERJ: Full fetch complete (72228 records). [2025-09-26T18:41:09.822884] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-26T18:41:10.037990] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (4.48 seconds). [2025-09-26T18:41:10.111819] [INFO ] [REMOTE ] ERO: Full fetch complete (59341 records). [2025-09-26T18:41:10.140777] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-26T18:41:10.471963] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-26T18:41:10.508019] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-26T18:41:10.571911] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-26T18:41:10.598914] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-26T18:41:10.678672] [DEBUG] [LOCAL ] ERJ: Trimmed 72228 records to 51477 (keeping 200 days of data) [2025-09-26T18:41:10.899190] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-26T18:41:10.899726] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-26T18:41:10.900840] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-26T18:41:10.901300] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-26T18:41:10.908547] [DEBUG] [LOCAL ] ERO: Trimmed 59341 records to 41901 (keeping 200 days of data) [2025-09-26T18:41:11.045324] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-26T18:41:11.085633] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-26T18:41:11.092942] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T18:41:11.219921] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-26T18:41:11.428875] [DEBUG] [LOCAL ] ERO: Primary data saved (41901 records). [2025-09-26T18:41:11.429566] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-26T18:41:11.429781] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ERO took 30.4s. Estimated remaining: 3h 32m 44s. Rate: 7.6 symbols/min [2025-09-26T18:41:11.659233] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:11.704248] [DEBUG] [LOCAL ] ESE: Loaded 16748 existing records from primary storage. [2025-09-26T18:41:11.704973] [INFO ] [MAIN ] ESE: Loaded 16748 existing records. [2025-09-26T18:41:11.920538] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:11.924979] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-26T18:41:11.924627] [DEBUG] [LOCAL ] ERJ: Primary data saved (51477 records). [2025-09-26T18:41:11.925208] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-26T18:41:11.925301] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-26T18:41:11.925526] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ERJ took 43.8s. Estimated remaining: 3h 32m 21s. Rate: 7.6 symbols/min [2025-09-26T18:41:11.926046] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-26T18:41:11.931301] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-26T18:41:12.292771] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:12.539069] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:12.540326] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-26T18:41:12.568974] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:41:12.593027] [DEBUG] [LOCAL ] ESI: Loaded 51196 existing records from primary storage. [2025-09-26T18:41:12.593189] [INFO ] [MAIN ] ESI: Loaded 51196 existing records. [2025-09-26T18:41:12.791454] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:12.761191] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-26T18:41:12.792920] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-26T18:41:12.793036] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-26T18:41:12.793265] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-26T18:41:12.793324] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-26T18:41:13.189945] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:13.223128] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-26T18:41:13.556713] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-26T18:41:13.716949] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T18:41:13.908680] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T18:41:14.356723] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-26T18:41:15.156717] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-26T18:41:15.359489] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:41:15.387550] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:41:15.956738] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-26T18:41:16.756743] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-26T18:41:17.076205] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:41:17.345185] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-26T18:41:17.556731] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-26T18:41:17.670484] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T18:41:18.337084] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T18:41:18.356673] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-26T18:41:19.156729] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-26T18:41:19.243905] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T18:41:19.956789] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-26T18:41:20.139596] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T18:41:20.756786] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-26T18:41:21.561848] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-26T18:41:21.580471] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T18:41:22.356744] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-26T18:41:22.613107] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T18:41:22.681773] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T18:41:23.156782] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-26T18:41:23.586226] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T18:41:23.956739] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-26T18:41:24.549449] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-26T18:41:24.756737] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-26T18:41:25.547119] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:41:25.558513] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-26T18:41:25.592857] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T18:41:26.356776] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-26T18:41:27.156492] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T18:41:27.162282] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-26T18:41:27.218159] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-26T18:41:27.956798] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-26T18:41:28.756735] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-26T18:41:28.844602] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:41:28.868184] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T18:41:29.556738] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-26T18:41:30.356702] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-26T18:41:30.484623] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T18:41:30.495753] [INFO ] [REMOTE ] ES: Full fetch complete (76173 records). [2025-09-26T18:41:30.495934] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-26T18:41:30.972952] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-26T18:41:30.974447] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T18:41:30.974694] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-26T18:41:30.983814] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-26T18:41:30.984333] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-26T18:41:30.985986] [DEBUG] [LOCAL ] ES: Trimmed 76173 records to 53309 (keeping 200 days of data) [2025-09-26T18:41:31.103780] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T18:41:31.192957] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-26T18:41:31.357354] [DEBUG] [LOCAL ] ES: Primary data saved (53309 records). [2025-09-26T18:41:31.357523] [INFO ] [MAIN ] ES: Full history saved. [2025-09-26T18:41:31.357622] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ES took 37.6s. Estimated remaining: 3h 32m 37s. Rate: 7.5 symbols/min [2025-09-26T18:41:31.594553] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:31.633498] [DEBUG] [LOCAL ] ESNT: Loaded 38813 existing records from primary storage. [2025-09-26T18:41:31.633731] [INFO ] [MAIN ] ESNT: Loaded 38813 existing records. [2025-09-26T18:41:31.840084] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:31.840368] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-26T18:41:31.840417] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-26T18:41:31.840705] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-26T18:41:31.840765] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-26T18:41:31.961851] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-26T18:41:32.228383] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:32.733263] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T18:41:32.739630] [INFO ] [REMOTE ] ESAB: Full fetch complete (35636 records). [2025-09-26T18:41:32.739772] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-26T18:41:32.761952] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-26T18:41:33.138885] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-26T18:41:33.138971] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-26T18:41:33.139586] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-26T18:41:33.139629] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-26T18:41:33.140663] [DEBUG] [LOCAL ] ESAB: Trimmed 35636 records to 26683 (keeping 200 days of data) [2025-09-26T18:41:33.365526] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T18:41:33.382502] [DEBUG] [LOCAL ] ESAB: Primary data saved (26683 records). [2025-09-26T18:41:33.382637] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-26T18:41:33.382765] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESAB took 24.5s. Estimated remaining: 3h 32m 16s. Rate: 7.6 symbols/min [2025-09-26T18:41:33.557275] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-26T18:41:33.578716] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:33.594506] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T18:41:33.640590] [DEBUG] [LOCAL ] ESRT: Loaded 46733 existing records from primary storage. [2025-09-26T18:41:33.640851] [INFO ] [MAIN ] ESRT: Loaded 46733 existing records. [2025-09-26T18:41:33.842239] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:33.842529] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-26T18:41:33.842591] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-26T18:41:33.842869] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-26T18:41:33.842930] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-26T18:41:34.262226] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:34.356756] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-26T18:41:35.156709] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-26T18:41:35.330570] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T18:41:35.582404] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:41:35.956744] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-26T18:41:36.415594] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T18:41:36.756737] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-26T18:41:37.293614] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:41:37.556725] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-26T18:41:37.816387] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T18:41:38.356777] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-26T18:41:39.055715] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:41:39.156798] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-26T18:41:39.477608] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:41:39.956756] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-26T18:41:40.428427] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T18:41:40.432662] [INFO ] [REMOTE ] ESE: Full fetch complete (22169 records). [2025-09-26T18:41:40.432753] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-26T18:41:40.761832] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-26T18:41:40.833386] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-26T18:41:40.833499] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-26T18:41:40.834070] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-26T18:41:40.834136] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-26T18:41:40.835455] [DEBUG] [LOCAL ] ESE: Trimmed 22169 records to 16878 (keeping 200 days of data) [2025-09-26T18:41:40.948944] [DEBUG] [LOCAL ] ESE: Primary data saved (16878 records). [2025-09-26T18:41:40.949119] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-26T18:41:40.949241] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESE took 29.5s. Estimated remaining: 3h 32m 8s. Rate: 7.6 symbols/min [2025-09-26T18:41:41.135446] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:41.167356] [DEBUG] [LOCAL ] ESS: Loaded 30254 existing records from primary storage. [2025-09-26T18:41:41.167543] [INFO ] [MAIN ] ESS: Loaded 30254 existing records. [2025-09-26T18:41:41.363166] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:41.363675] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-26T18:41:41.363857] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-26T18:41:41.364727] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-26T18:41:41.364789] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-26T18:41:41.567131] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-26T18:41:41.683072] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T18:41:41.809864] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:42.300257] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T18:41:42.310933] [INFO ] [REMOTE ] ESI: Full fetch complete (72462 records). [2025-09-26T18:41:42.311091] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-26T18:41:42.361801] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-26T18:41:42.754224] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-26T18:41:42.754326] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-26T18:41:42.755299] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-26T18:41:42.755371] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-26T18:41:42.757442] [DEBUG] [LOCAL ] ESI: Trimmed 72462 records to 51566 (keeping 200 days of data) [2025-09-26T18:41:43.012132] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:41:43.129059] [DEBUG] [LOCAL ] ESI: Primary data saved (51566 records). [2025-09-26T18:41:43.129205] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-26T18:41:43.129293] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESI took 31.2s. Estimated remaining: 3h 31m 48s. Rate: 7.6 symbols/min [2025-09-26T18:41:43.161830] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-26T18:41:43.308054] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:41:43.356994] [DEBUG] [LOCAL ] ESTC: Loaded 50398 existing records from primary storage. [2025-09-26T18:41:43.357187] [INFO ] [MAIN ] ESTC: Loaded 50398 existing records. [2025-09-26T18:41:43.559246] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:41:43.559631] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-26T18:41:43.559736] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-26T18:41:43.561351] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-26T18:41:43.561418] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-26T18:41:43.753400] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T18:41:43.962823] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-26T18:41:43.986759] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:41:44.568680] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:41:44.756747] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-26T18:41:44.872090] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T18:41:45.556759] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-26T18:41:46.356713] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-26T18:41:46.529996] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T18:41:47.156734] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-26T18:41:47.961804] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-26T18:41:47.977738] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T18:41:48.129149] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-26T18:41:48.163254] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T18:41:48.756757] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-26T18:41:49.554045] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T18:41:49.562510] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-26T18:41:50.356709] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-26T18:41:50.390147] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T18:41:50.753109] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:41:51.156745] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-26T18:41:51.453755] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-26T18:41:51.956753] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-26T18:41:52.756705] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-26T18:41:53.045313] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-26T18:41:53.391239] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:41:53.556730] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-26T18:41:54.356772] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-26T18:41:54.613679] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-26T18:41:54.992170] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T18:41:55.156765] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-26T18:41:55.597055] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T18:41:55.956750] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-26T18:41:56.155856] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T18:41:56.756799] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-26T18:41:57.132703] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T18:41:57.556740] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-26T18:41:58.228431] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T18:41:58.356760] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-26T18:41:59.017063] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:41:59.156745] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-26T18:41:59.956751] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-26T18:42:00.463431] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-26T18:42:00.493414] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T18:42:00.492411] [INFO ] [REMOTE ] ESRT: Full fetch complete (66561 records). [2025-09-26T18:42:00.496519] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-26T18:42:00.761819] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-26T18:42:00.949476] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-26T18:42:00.949580] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-26T18:42:00.950523] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-26T18:42:00.950602] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-26T18:42:00.952263] [DEBUG] [LOCAL ] ESRT: Trimmed 66561 records to 47104 (keeping 200 days of data) [2025-09-26T18:42:01.243897] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:42:01.272740] [INFO ] [REMOTE ] ESNT: Full fetch complete (56905 records). [2025-09-26T18:42:01.275586] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-26T18:42:01.278393] [DEBUG] [LOCAL ] ESRT: Primary data saved (47104 records). [2025-09-26T18:42:01.278721] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-26T18:42:01.278959] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESRT took 27.9s. Estimated remaining: 3h 32m 1s. Rate: 7.6 symbols/min [2025-09-26T18:42:01.285235] [FATAL] [VALIDATOR ] ESNT: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:42:01.340809] [FATAL] [MAIN ] ESNT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:42:01.350614] [WARN ] [MAIN ] ESNT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:42:01.356634] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-26T18:42:01.362772] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-09-26T18:42:01.379705] [INFO ] [LOCAL ] ESNT: Starting deletion of derivative data. [2025-09-26T18:42:01.397815] [DEBUG] [LOCAL ] ESNT: Deleted derivative data file. [2025-09-26T18:42:01.408227] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESNT took 30.1s. Estimated remaining: 3h 31m 37s. Rate: 7.6 symbols/min [2025-09-26T18:42:01.580698] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:01.576157] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-26T18:42:01.672151] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:01.673296] [DEBUG] [LOCAL ] ETB: No existing data file found in primary storage. [2025-09-26T18:42:01.673427] [WARN ] [MAIN ] ETB: No existing data found, performing full refresh instead. [2025-09-26T18:42:01.673706] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-26T18:42:01.673780] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-26T18:42:01.673869] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-09-26T18:42:01.673940] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-26T18:42:02.018251] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-09-26T18:42:02.045664] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-09-26T18:42:02.169908] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:02.330897] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:02.331406] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-26T18:42:02.331604] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-26T18:42:02.338770] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-26T18:42:02.349804] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-26T18:42:02.374455] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T18:42:02.373028] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-26T18:42:02.748012] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:03.156701] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-26T18:42:03.231332] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T18:42:03.364955] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T18:42:03.956726] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-26T18:42:04.465901] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T18:42:04.756797] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-26T18:42:05.556748] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-26T18:42:05.770147] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T18:42:06.356842] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-26T18:42:06.510172] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-26T18:42:06.994622] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T18:42:07.156738] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-26T18:42:07.737776] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T18:42:07.743754] [INFO ] [REMOTE ] ESS: Full fetch complete (43389 records). [2025-09-26T18:42:07.743880] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-26T18:42:07.961937] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-26T18:42:08.071081] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:42:08.164758] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-26T18:42:08.164852] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-26T18:42:08.165565] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-26T18:42:08.165658] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-26T18:42:08.166857] [DEBUG] [LOCAL ] ESS: Trimmed 43389 records to 30441 (keeping 200 days of data) [2025-09-26T18:42:08.357083] [DEBUG] [LOCAL ] ESS: Primary data saved (30441 records). [2025-09-26T18:42:08.357259] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-26T18:42:08.357364] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ESS took 27.4s. Estimated remaining: 3h 31m 27s. Rate: 7.6 symbols/min [2025-09-26T18:42:08.542029] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:08.569629] [DEBUG] [LOCAL ] ETD: Loaded 27502 existing records from primary storage. [2025-09-26T18:42:08.569834] [INFO ] [MAIN ] ETD: Loaded 27502 existing records. [2025-09-26T18:42:08.757300] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-26T18:42:08.761699] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:08.762819] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-26T18:42:08.762883] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-26T18:42:08.763854] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-26T18:42:08.763918] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-26T18:42:09.175471] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:09.556725] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-26T18:42:10.246442] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-26T18:42:10.356707] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-26T18:42:10.600870] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T18:42:10.601696] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T18:42:11.156743] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-26T18:42:11.956749] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-26T18:42:12.182060] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T18:42:12.488105] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-26T18:42:12.756722] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-26T18:42:13.353753] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:42:13.556730] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-26T18:42:13.657484] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T18:42:14.356725] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-26T18:42:15.156724] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-26T18:42:15.715356] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-26T18:42:15.808704] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T18:42:15.838077] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T18:42:15.956727] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-26T18:42:16.756756] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-26T18:42:17.556722] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-26T18:42:18.356719] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-26T18:42:18.579235] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T18:42:18.622543] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-26T18:42:18.671712] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:42:19.156751] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-26T18:42:19.339019] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T18:42:19.956779] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-26T18:42:20.756800] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-26T18:42:20.802517] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T18:42:20.963378] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T18:42:20.979288] [INFO ] [REMOTE ] ESTC: Full fetch complete (72019 records). [2025-09-26T18:42:20.979528] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-26T18:42:21.545920] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-26T18:42:21.546040] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-26T18:42:21.547381] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-26T18:42:21.547490] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-26T18:42:21.549768] [DEBUG] [LOCAL ] ESTC: Trimmed 72019 records to 50744 (keeping 200 days of data) [2025-09-26T18:42:21.605130] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-26T18:42:21.879816] [DEBUG] [LOCAL ] ESTC: Primary data saved (50744 records). [2025-09-26T18:42:21.880015] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-26T18:42:21.880164] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ESTC took 38.8s. Estimated remaining: 3h 31m 31s. Rate: 7.6 symbols/min [2025-09-26T18:42:22.069690] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:22.088335] [DEBUG] [LOCAL ] ETG: Loaded 16639 existing records from primary storage. [2025-09-26T18:42:22.088506] [INFO ] [MAIN ] ETG: Loaded 16639 existing records. [2025-09-26T18:42:22.257004] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T18:42:22.291709] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:22.292561] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-26T18:42:22.292620] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-26T18:42:22.293292] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-26T18:42:22.293383] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-26T18:42:22.361681] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-26T18:42:22.700359] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:22.738228] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T18:42:23.003628] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:42:23.156786] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-26T18:42:23.956753] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-26T18:42:24.578059] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T18:42:24.756738] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-26T18:42:25.556723] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-26T18:42:25.709713] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T18:42:26.356732] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-26T18:42:26.379886] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T18:42:26.505916] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T18:42:27.156774] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-26T18:42:27.907940] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T18:42:27.910455] [INFO ] [REMOTE ] ETB: Full fetch complete (17862 records). [2025-09-26T18:42:27.910564] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-26T18:42:27.961864] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-26T18:42:28.301737] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-26T18:42:28.301830] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-26T18:42:28.302278] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-26T18:42:28.302319] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-26T18:42:28.302928] [DEBUG] [LOCAL ] ETB: Trimmed 17862 records to 12181 (keeping 200 days of data) [2025-09-26T18:42:28.382273] [DEBUG] [LOCAL ] ETB: Primary data saved (12181 records). [2025-09-26T18:42:28.382446] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-26T18:42:28.382539] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ETB took 27.0s. Estimated remaining: 3h 31m 20s. Rate: 7.6 symbols/min [2025-09-26T18:42:28.567091] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:28.584487] [DEBUG] [LOCAL ] ETJ: Loaded 16755 existing records from primary storage. [2025-09-26T18:42:28.584637] [INFO ] [MAIN ] ETJ: Loaded 16755 existing records. [2025-09-26T18:42:28.756810] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-26T18:42:28.783469] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:28.784442] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-26T18:42:28.784577] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-26T18:42:28.785560] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-26T18:42:28.785814] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-26T18:42:28.987784] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-26T18:42:29.179659] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T18:42:29.291428] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:29.556726] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-26T18:42:29.758871] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T18:42:30.356707] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-26T18:42:30.594589] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T18:42:31.156750] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-26T18:42:31.781964] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T18:42:31.929434] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T18:42:31.956716] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-26T18:42:32.756719] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-26T18:42:32.883690] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T18:42:33.471102] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T18:42:33.556716] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-26T18:42:34.356751] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-26T18:42:34.773268] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T18:42:35.156769] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-26T18:42:35.956773] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-26T18:42:36.461683] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T18:42:36.530065] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-26T18:42:36.756742] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-26T18:42:37.014715] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T18:42:37.556744] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-26T18:42:38.275851] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T18:42:38.356727] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-26T18:42:38.852315] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T18:42:38.863727] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-26T18:42:38.863924] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-26T18:42:39.161905] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-26T18:42:39.288348] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-26T18:42:39.288435] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-26T18:42:39.289339] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-26T18:42:39.289405] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-26T18:42:39.291054] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54569 (keeping 200 days of data) [2025-09-26T18:42:39.654901] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-09-26T18:42:39.655322] [INFO ] [MAIN ] ET: Full history saved. [2025-09-26T18:42:39.655439] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ET took 38.4s. Estimated remaining: 3h 31m 19s. Rate: 7.6 symbols/min [2025-09-26T18:42:39.866292] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:42:39.865139] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:39.927485] [DEBUG] [LOCAL ] ETN: Loaded 53221 existing records from primary storage. [2025-09-26T18:42:39.927637] [INFO ] [MAIN ] ETN: Loaded 53221 existing records. [2025-09-26T18:42:39.961822] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-26T18:42:40.131185] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:40.132386] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-26T18:42:40.132149] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:42:40.132567] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-26T18:42:40.137603] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-26T18:42:40.137715] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-26T18:42:40.513842] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:40.756734] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-26T18:42:41.244921] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T18:42:41.556701] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-26T18:42:41.797342] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T18:42:42.356746] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-26T18:42:42.678694] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T18:42:43.156724] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-26T18:42:43.390815] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:42:43.956796] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-26T18:42:44.242602] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T18:42:44.756826] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-26T18:42:44.981795] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T18:42:45.405341] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T18:42:45.556724] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-26T18:42:46.356761] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-26T18:42:46.591969] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T18:42:47.156764] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-26T18:42:47.956726] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-26T18:42:48.535452] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T18:42:48.537904] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-26T18:42:48.554842] [INFO ] [REMOTE ] ETD: Full fetch complete (38077 records). [2025-09-26T18:42:48.555814] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-26T18:42:48.757802] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-26T18:42:48.803841] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-26T18:42:48.885433] [INFO ] [REMOTE ] ETJ: Full fetch complete (25036 records). [2025-09-26T18:42:48.898190] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-26T18:42:49.179692] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-26T18:42:49.185305] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-26T18:42:49.197346] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-26T18:42:49.197882] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-26T18:42:49.299921] [DEBUG] [LOCAL ] ETD: Trimmed 38077 records to 27661 (keeping 200 days of data) [2025-09-26T18:42:49.536418] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-26T18:42:49.536804] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-26T18:42:49.540987] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-26T18:42:49.543446] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-26T18:42:49.558963] [DEBUG] [LOCAL ] ETJ: Trimmed 25036 records to 16938 (keeping 200 days of data) [2025-09-26T18:42:49.559058] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-26T18:42:49.713255] [DEBUG] [LOCAL ] ETJ: Primary data saved (16938 records). [2025-09-26T18:42:49.714080] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-26T18:42:49.714310] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETJ took 21.3s. Estimated remaining: 3h 31m 15s. Rate: 7.6 symbols/min [2025-09-26T18:42:49.905330] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:49.905486] [DEBUG] [LOCAL ] ETD: Primary data saved (27661 records). [2025-09-26T18:42:49.906409] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-26T18:42:49.906597] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETD took 41.5s. Estimated remaining: 3h 30m 51s. Rate: 7.6 symbols/min [2025-09-26T18:42:50.012637] [DEBUG] [LOCAL ] ETO: Loaded 6531 existing records from primary storage. [2025-09-26T18:42:50.024297] [INFO ] [MAIN ] ETO: Loaded 6531 existing records. [2025-09-26T18:42:50.234167] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:50.250887] [DEBUG] [LOCAL ] ETR: No existing data file found in primary storage. [2025-09-26T18:42:50.256189] [WARN ] [MAIN ] ETR: No existing data found, performing full refresh instead. [2025-09-26T18:42:50.297139] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-26T18:42:50.297590] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-26T18:42:50.315945] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-09-26T18:42:50.319793] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-26T18:42:50.319605] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:42:50.413369] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-26T18:42:50.444681] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-26T18:42:50.450873] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-26T18:42:50.466423] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-26T18:42:50.913483] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T18:42:51.001736] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-26T18:42:51.085084] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:51.157196] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-26T18:42:51.201686] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:51.234725] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-26T18:42:51.956742] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-26T18:42:52.003701] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T18:42:52.007213] [INFO ] [REMOTE ] ETG: Full fetch complete (24772 records). [2025-09-26T18:42:52.007330] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-26T18:42:52.424122] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-26T18:42:52.424232] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-26T18:42:52.424754] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-26T18:42:52.424819] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-26T18:42:52.426577] [DEBUG] [LOCAL ] ETG: Trimmed 24772 records to 16710 (keeping 200 days of data) [2025-09-26T18:42:52.539541] [DEBUG] [LOCAL ] ETG: Primary data saved (16710 records). [2025-09-26T18:42:52.539793] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-26T18:42:52.539916] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETG took 30.7s. Estimated remaining: 3h 30m 32s. Rate: 7.6 symbols/min [2025-09-26T18:42:52.751048] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:42:52.751350] [DEBUG] [LOCAL ] ETV: No existing data file found in primary storage. [2025-09-26T18:42:52.751429] [WARN ] [MAIN ] ETV: No existing data found, performing full refresh instead. [2025-09-26T18:42:52.751705] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-26T18:42:52.751779] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-26T18:42:52.751952] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-09-26T18:42:52.752045] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-26T18:42:52.774865] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-26T18:42:53.192996] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T18:42:53.198004] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:42:53.378442] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T18:42:53.426751] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:42:53.556738] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-26T18:42:54.357973] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-26T18:42:54.359872] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T18:42:55.156731] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-26T18:42:55.813886] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T18:42:55.956744] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-26T18:42:56.173236] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T18:42:56.756780] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-26T18:42:57.053249] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T18:42:57.556784] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-26T18:42:58.000401] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T18:42:58.356709] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-26T18:42:58.432219] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:42:59.156739] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-26T18:42:59.956751] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-26T18:43:00.006678] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T18:43:00.288312] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T18:43:00.756756] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-26T18:43:01.556741] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-26T18:43:01.589925] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T18:43:01.775736] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T18:43:02.356714] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-26T18:43:02.824778] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:43:03.156768] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-26T18:43:03.702872] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:43:03.956695] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-26T18:43:04.063193] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T18:43:04.672567] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-26T18:43:04.756729] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-26T18:43:05.556749] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-26T18:43:05.772258] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T18:43:06.356728] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-26T18:43:07.095970] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T18:43:07.156723] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-26T18:43:07.443106] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T18:43:07.678709] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-26T18:43:07.956747] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-26T18:43:08.739773] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:43:08.756690] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-26T18:43:09.346364] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T18:43:09.556720] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-26T18:43:10.356701] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-26T18:43:10.479778] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T18:43:10.481601] [INFO ] [REMOTE ] ETO: Full fetch complete (9326 records). [2025-09-26T18:43:10.481740] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-26T18:43:10.872919] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-26T18:43:10.873020] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-26T18:43:10.873286] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-26T18:43:10.873347] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-26T18:43:10.873934] [DEBUG] [LOCAL ] ETO: Trimmed 9326 records to 6600 (keeping 200 days of data) [2025-09-26T18:43:10.919473] [DEBUG] [LOCAL ] ETO: Primary data saved (6600 records). [2025-09-26T18:43:10.919608] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-26T18:43:10.919724] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETO took 21.2s. Estimated remaining: 3h 30m 46s. Rate: 7.6 symbols/min [2025-09-26T18:43:11.098719] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:11.129878] [DEBUG] [LOCAL ] ETW: Loaded 25236 existing records from primary storage. [2025-09-26T18:43:11.130038] [INFO ] [MAIN ] ETW: Loaded 25236 existing records. [2025-09-26T18:43:11.162072] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-26T18:43:11.321090] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:11.321405] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-26T18:43:11.321489] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-26T18:43:11.322404] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-26T18:43:11.322471] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-26T18:43:11.729946] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:11.724344] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T18:43:11.956724] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-26T18:43:12.680280] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T18:43:12.756712] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-26T18:43:13.556784] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-26T18:43:13.770026] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T18:43:14.313006] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T18:43:14.358343] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:43:14.358509] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-26T18:43:15.156775] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-26T18:43:15.533977] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T18:43:15.956739] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-26T18:43:16.756719] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-26T18:43:17.056489] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:43:17.556701] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-26T18:43:17.749262] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-26T18:43:17.759790] [INFO ] [REMOTE ] ETN: Full fetch complete (76599 records). [2025-09-26T18:43:17.759951] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-26T18:43:18.174856] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-26T18:43:18.174968] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-26T18:43:18.176105] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-26T18:43:18.176194] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-26T18:43:18.180921] [DEBUG] [LOCAL ] ETN: Trimmed 76599 records to 53593 (keeping 200 days of data) [2025-09-26T18:43:18.335123] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T18:43:18.356981] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-26T18:43:18.375962] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T18:43:18.613453] [DEBUG] [LOCAL ] ETN: Primary data saved (53593 records). [2025-09-26T18:43:18.613614] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-26T18:43:18.613762] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETN took 39.0s. Estimated remaining: 3h 30m 37s. Rate: 7.6 symbols/min [2025-09-26T18:43:18.794067] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:18.800892] [DEBUG] [LOCAL ] ETX: Loaded 5002 existing records from primary storage. [2025-09-26T18:43:18.800999] [INFO ] [MAIN ] ETX: Loaded 5002 existing records. [2025-09-26T18:43:19.029660] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:19.029943] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-26T18:43:19.029994] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-26T18:43:19.030333] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-26T18:43:19.030393] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-26T18:43:19.165614] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-26T18:43:19.497048] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:19.572380] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:43:19.956736] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-26T18:43:20.010281] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T18:43:20.015311] [INFO ] [REMOTE ] ETV: Full fetch complete (31727 records). [2025-09-26T18:43:20.015420] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-26T18:43:20.424840] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-26T18:43:20.424958] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-26T18:43:20.425565] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-26T18:43:20.425613] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-26T18:43:20.426719] [DEBUG] [LOCAL ] ETV: Trimmed 31727 records to 21729 (keeping 200 days of data) [2025-09-26T18:43:20.572135] [DEBUG] [LOCAL ] ETV: Primary data saved (21729 records). [2025-09-26T18:43:20.572271] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-26T18:43:20.572351] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETV took 28.0s. Estimated remaining: 3h 30m 17s. Rate: 7.6 symbols/min [2025-09-26T18:43:20.766805] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:20.765773] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-26T18:43:20.774095] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T18:43:20.797564] [DEBUG] [LOCAL ] ETY: Loaded 22913 existing records from primary storage. [2025-09-26T18:43:20.797722] [INFO ] [MAIN ] ETY: Loaded 22913 existing records. [2025-09-26T18:43:20.997504] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:20.997810] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-26T18:43:20.997862] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-26T18:43:20.998581] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-26T18:43:20.998681] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-26T18:43:21.395154] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:21.556745] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-26T18:43:22.356705] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-26T18:43:22.551245] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T18:43:22.730879] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T18:43:22.748930] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-26T18:43:23.156811] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-26T18:43:23.956749] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-26T18:43:24.756783] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-26T18:43:25.080890] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T18:43:25.133693] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T18:43:25.217210] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T18:43:25.556717] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-26T18:43:26.182846] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T18:43:26.356732] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-26T18:43:27.027724] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T18:43:27.156766] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-26T18:43:27.956738] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-26T18:43:28.498288] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-26T18:43:28.756733] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-26T18:43:28.832010] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:43:29.475685] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T18:43:29.556721] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-26T18:43:30.126341] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T18:43:30.356750] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-26T18:43:31.156732] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-26T18:43:31.473139] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T18:43:31.956772] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-26T18:43:32.500779] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T18:43:32.756753] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-26T18:43:32.892544] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T18:43:33.339159] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-26T18:43:33.341112] [INFO ] [REMOTE ] ETX: Full fetch complete (7020 records). [2025-09-26T18:43:33.341200] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-26T18:43:33.566539] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-26T18:43:33.744520] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-26T18:43:33.744614] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-26T18:43:33.744872] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-26T18:43:33.744932] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-26T18:43:33.745608] [DEBUG] [LOCAL ] ETX: Trimmed 7020 records to 5028 (keeping 200 days of data) [2025-09-26T18:43:33.777940] [DEBUG] [LOCAL ] ETX: Primary data saved (5028 records). [2025-09-26T18:43:33.778087] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-26T18:43:33.778179] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETX took 15.2s. Estimated remaining: 3h 30m 20s. Rate: 7.6 symbols/min [2025-09-26T18:43:33.962110] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:33.985483] [DEBUG] [LOCAL ] EVC: Loaded 19345 existing records from primary storage. [2025-09-26T18:43:33.985620] [INFO ] [MAIN ] EVC: Loaded 19345 existing records. [2025-09-26T18:43:34.181670] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:34.181983] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-26T18:43:34.182041] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-26T18:43:34.182717] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-26T18:43:34.182779] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-26T18:43:34.356913] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-26T18:43:34.605904] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:34.830579] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T18:43:35.156753] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-26T18:43:35.956728] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-26T18:43:36.004235] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T18:43:36.109119] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T18:43:36.756735] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-26T18:43:37.556737] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-26T18:43:37.660089] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:43:37.670770] [INFO ] [REMOTE ] ETR: Full fetch complete (77012 records). [2025-09-26T18:43:37.671015] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-26T18:43:38.187383] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-26T18:43:38.187747] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-26T18:43:38.188816] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-26T18:43:38.188903] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-26T18:43:38.191082] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T18:43:38.199991] [DEBUG] [LOCAL ] ETR: Trimmed 77012 records to 54001 (keeping 200 days of data) [2025-09-26T18:43:38.407736] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-26T18:43:38.453677] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-26T18:43:38.586058] [DEBUG] [LOCAL ] ETR: Primary data saved (54001 records). [2025-09-26T18:43:38.586258] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-26T18:43:38.586422] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. ETR took 48.7s. Estimated remaining: 3h 30m 6s. Rate: 7.6 symbols/min [2025-09-26T18:43:38.841993] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:38.889717] [DEBUG] [LOCAL ] EVEX: Loaded 30253 existing records from primary storage. [2025-09-26T18:43:38.889879] [INFO ] [MAIN ] EVEX: Loaded 30253 existing records. [2025-09-26T18:43:39.144882] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:39.145289] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-26T18:43:39.145366] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-26T18:43:39.146338] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-26T18:43:39.146414] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-26T18:43:39.165022] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-26T18:43:39.557979] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:39.645808] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T18:43:39.956725] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-26T18:43:40.703602] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:43:40.756733] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-26T18:43:40.772865] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T18:43:41.556727] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-26T18:43:41.888782] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T18:43:42.356787] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-26T18:43:42.506079] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:43:43.156793] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-26T18:43:43.461695] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:43:43.897802] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T18:43:43.956789] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-26T18:43:44.756753] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-26T18:43:45.105822] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:43:45.556779] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-26T18:43:45.673159] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T18:43:46.356689] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-26T18:43:46.379013] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T18:43:47.156736] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-26T18:43:47.313749] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T18:43:47.956767] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-26T18:43:48.516754] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T18:43:48.522005] [INFO ] [REMOTE ] ETW: Full fetch complete (36361 records). [2025-09-26T18:43:48.522138] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-26T18:43:48.763453] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-26T18:43:48.941398] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-26T18:43:48.941479] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-26T18:43:48.942141] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-26T18:43:48.942208] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-26T18:43:48.943259] [DEBUG] [LOCAL ] ETW: Trimmed 36361 records to 25463 (keeping 200 days of data) [2025-09-26T18:43:49.103798] [DEBUG] [LOCAL ] ETW: Primary data saved (25463 records). [2025-09-26T18:43:49.103935] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-26T18:43:49.104031] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETW took 38.2s. Estimated remaining: 3h 30m 3s. Rate: 7.6 symbols/min [2025-09-26T18:43:49.293460] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:49.311047] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T18:43:49.325462] [DEBUG] [LOCAL ] EVF: Loaded 9349 existing records from primary storage. [2025-09-26T18:43:49.325698] [INFO ] [MAIN ] EVF: Loaded 9349 existing records. [2025-09-26T18:43:49.519998] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:49.520248] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-26T18:43:49.520304] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-26T18:43:49.520788] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-26T18:43:49.520852] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-26T18:43:49.561933] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-26T18:43:49.924243] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:49.997381] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T18:43:50.356773] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-26T18:43:50.763288] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T18:43:51.156774] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-26T18:43:51.204979] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T18:43:51.956735] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-26T18:43:51.978269] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T18:43:52.756776] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-26T18:43:53.048886] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T18:43:53.183965] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T18:43:53.556724] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-26T18:43:54.356788] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-26T18:43:54.751162] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:43:55.156771] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-26T18:43:55.281992] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T18:43:55.931427] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T18:43:55.956705] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-26T18:43:56.756708] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-26T18:43:57.102058] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-26T18:43:57.106308] [INFO ] [REMOTE ] ETY: Full fetch complete (34074 records). [2025-09-26T18:43:57.106410] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-26T18:43:57.505026] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-26T18:43:57.505179] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-26T18:43:57.505808] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-26T18:43:57.505906] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-26T18:43:57.507301] [DEBUG] [LOCAL ] ETY: Trimmed 34074 records to 23078 (keeping 200 days of data) [2025-09-26T18:43:57.567547] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-26T18:43:57.619564] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T18:43:57.688770] [DEBUG] [LOCAL ] ETY: Primary data saved (23078 records). [2025-09-26T18:43:57.689229] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-26T18:43:57.689344] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. ETY took 37.1s. Estimated remaining: 3h 29m 56s. Rate: 7.6 symbols/min [2025-09-26T18:43:57.883975] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:43:57.892417] [DEBUG] [LOCAL ] EVG: Loaded 5833 existing records from primary storage. [2025-09-26T18:43:57.892512] [INFO ] [MAIN ] EVG: Loaded 5833 existing records. [2025-09-26T18:43:58.082609] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:43:58.082885] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-26T18:43:58.082934] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-26T18:43:58.083253] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-26T18:43:58.083313] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-26T18:43:58.365068] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-26T18:43:58.469468] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:43:58.775687] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-26T18:43:59.156728] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-26T18:43:59.563348] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T18:43:59.643524] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T18:43:59.956731] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-26T18:44:00.516766] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T18:44:00.756737] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-26T18:44:01.556732] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-26T18:44:01.574841] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-26T18:44:02.356753] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-26T18:44:02.877523] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T18:44:03.156729] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-26T18:44:03.913979] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T18:44:03.956751] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-26T18:44:04.283404] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T18:44:04.288503] [INFO ] [REMOTE ] EVC: Full fetch complete (30799 records). [2025-09-26T18:44:04.288764] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-26T18:44:04.711877] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-26T18:44:04.712040] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-26T18:44:04.712759] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-26T18:44:04.712841] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-26T18:44:04.713925] [DEBUG] [LOCAL ] EVC: Trimmed 30799 records to 19415 (keeping 200 days of data) [2025-09-26T18:44:04.768335] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-26T18:44:04.846486] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T18:44:04.865045] [DEBUG] [LOCAL ] EVC: Primary data saved (19415 records). [2025-09-26T18:44:04.865225] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-26T18:44:04.865362] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVC took 31.1s. Estimated remaining: 3h 29m 47s. Rate: 7.6 symbols/min [2025-09-26T18:44:05.044297] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:05.092763] [DEBUG] [LOCAL ] EVH: Loaded 49734 existing records from primary storage. [2025-09-26T18:44:05.092963] [INFO ] [MAIN ] EVH: Loaded 49734 existing records. [2025-09-26T18:44:05.293392] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:05.293742] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-26T18:44:05.293812] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-26T18:44:05.295082] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-26T18:44:05.295145] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-26T18:44:05.553700] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T18:44:05.566281] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-26T18:44:05.718882] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:06.356735] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-26T18:44:07.072003] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T18:44:07.156685] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-26T18:44:07.266375] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T18:44:07.890176] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-26T18:44:07.956736] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-26T18:44:08.756739] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-26T18:44:09.205922] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T18:44:09.534488] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T18:44:09.544218] [INFO ] [REMOTE ] EVEX: Full fetch complete (41693 records). [2025-09-26T18:44:09.544381] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-26T18:44:09.561857] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-26T18:44:09.981207] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-26T18:44:09.981308] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-26T18:44:09.982047] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-26T18:44:09.982139] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-26T18:44:09.983531] [DEBUG] [LOCAL ] EVEX: Trimmed 41693 records to 30549 (keeping 200 days of data) [2025-09-26T18:44:10.176365] [DEBUG] [LOCAL ] EVEX: Primary data saved (30549 records). [2025-09-26T18:44:10.176980] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-26T18:44:10.177215] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVEX took 31.6s. Estimated remaining: 3h 29m 34s. Rate: 7.6 symbols/min [2025-09-26T18:44:10.314744] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T18:44:10.361498] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-26T18:44:10.387834] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:10.389165] [DEBUG] [LOCAL ] EVN: No existing data file found in primary storage. [2025-09-26T18:44:10.389213] [WARN ] [MAIN ] EVN: No existing data found, performing full refresh instead. [2025-09-26T18:44:10.389372] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-26T18:44:10.389417] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-26T18:44:10.389463] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-09-26T18:44:10.389495] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-26T18:44:10.824808] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:11.156722] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-26T18:44:11.388841] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:44:11.956769] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-26T18:44:12.557781] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T18:44:12.756781] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-26T18:44:13.556717] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-26T18:44:13.612913] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T18:44:13.875806] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T18:44:14.339399] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T18:44:14.356724] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-26T18:44:15.156778] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-26T18:44:15.956786] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-26T18:44:16.237143] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T18:44:16.277532] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T18:44:16.280317] [INFO ] [REMOTE ] EVF: Full fetch complete (12101 records). [2025-09-26T18:44:16.280408] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-26T18:44:16.711086] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-26T18:44:16.711259] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-26T18:44:16.711750] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-26T18:44:16.711949] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-26T18:44:16.713065] [DEBUG] [LOCAL ] EVF: Trimmed 12101 records to 9501 (keeping 200 days of data) [2025-09-26T18:44:16.725000] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T18:44:16.769404] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-26T18:44:16.790775] [DEBUG] [LOCAL ] EVF: Primary data saved (9501 records). [2025-09-26T18:44:16.790933] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-26T18:44:16.791108] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVF took 27.7s. Estimated remaining: 3h 29m 23s. Rate: 7.6 symbols/min [2025-09-26T18:44:16.985953] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:17.028338] [DEBUG] [LOCAL ] EVR: Loaded 35727 existing records from primary storage. [2025-09-26T18:44:17.028533] [INFO ] [MAIN ] EVR: Loaded 35727 existing records. [2025-09-26T18:44:17.224208] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:17.224517] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-26T18:44:17.224567] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-26T18:44:17.225739] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-26T18:44:17.225803] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-26T18:44:17.566201] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-26T18:44:17.657586] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:17.714172] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T18:44:18.356742] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-26T18:44:19.071825] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:44:19.156710] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-26T18:44:19.906870] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T18:44:19.956690] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-26T18:44:20.756737] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-26T18:44:20.977180] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T18:44:21.188114] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-26T18:44:21.529837] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:44:21.556678] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-26T18:44:22.356779] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-26T18:44:23.095496] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T18:44:23.156720] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-26T18:44:23.901332] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T18:44:23.956753] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-26T18:44:24.303605] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T18:44:24.756771] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-26T18:44:25.140387] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T18:44:25.556759] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-26T18:44:26.356731] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-26T18:44:26.477416] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T18:44:26.714799] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T18:44:27.156735] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-26T18:44:27.188945] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-26T18:44:27.956772] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-26T18:44:28.696886] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T18:44:28.756730] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-26T18:44:29.357959] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:44:29.556721] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-26T18:44:30.158028] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T18:44:30.191334] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T18:44:30.356748] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-26T18:44:31.156744] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-26T18:44:31.809319] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T18:44:31.836982] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T18:44:31.956735] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-26T18:44:32.756752] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-26T18:44:32.802126] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T18:44:33.251453] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T18:44:33.253225] [INFO ] [REMOTE ] EVG: Full fetch complete (8055 records). [2025-09-26T18:44:33.253308] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-26T18:44:33.563322] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-26T18:44:33.671339] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-26T18:44:33.671425] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-26T18:44:33.671682] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-26T18:44:33.671745] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-26T18:44:33.672266] [DEBUG] [LOCAL ] EVG: Trimmed 8055 records to 5862 (keeping 200 days of data) [2025-09-26T18:44:33.711048] [DEBUG] [LOCAL ] EVG: Primary data saved (5862 records). [2025-09-26T18:44:33.711198] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-26T18:44:33.711293] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVG took 36.0s. Estimated remaining: 3h 29m 33s. Rate: 7.5 symbols/min [2025-09-26T18:44:33.896435] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:33.896629] [DEBUG] [LOCAL ] EVT: No existing data file found in primary storage. [2025-09-26T18:44:33.896703] [WARN ] [MAIN ] EVT: No existing data found, performing full refresh instead. [2025-09-26T18:44:33.896864] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-26T18:44:33.896909] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-26T18:44:33.896952] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-09-26T18:44:33.896986] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-26T18:44:34.283978] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:34.356773] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-26T18:44:35.156775] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-26T18:44:35.542952] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T18:44:35.565489] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:44:35.923154] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T18:44:35.956772] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-26T18:44:36.756743] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-26T18:44:37.242154] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T18:44:37.556742] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-26T18:44:37.999071] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:44:38.356782] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-26T18:44:38.697743] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T18:44:38.704082] [INFO ] [REMOTE ] EVR: Full fetch complete (50703 records). [2025-09-26T18:44:38.704237] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-26T18:44:39.108037] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-26T18:44:39.108117] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-26T18:44:39.108820] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-26T18:44:39.108883] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-26T18:44:39.110195] [DEBUG] [LOCAL ] EVR: Trimmed 50703 records to 35882 (keeping 200 days of data) [2025-09-26T18:44:39.168481] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-26T18:44:39.343579] [DEBUG] [LOCAL ] EVR: Primary data saved (35882 records). [2025-09-26T18:44:39.343795] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-26T18:44:39.343891] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVR took 22.6s. Estimated remaining: 3h 29m 20s. Rate: 7.6 symbols/min [2025-09-26T18:44:39.532362] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:39.559715] [DEBUG] [LOCAL ] EVTC: Loaded 26605 existing records from primary storage. [2025-09-26T18:44:39.559856] [INFO ] [MAIN ] EVTC: Loaded 26605 existing records. [2025-09-26T18:44:39.765715] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:39.766300] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-26T18:44:39.766504] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-26T18:44:39.777018] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-26T18:44:39.792069] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-26T18:44:39.836200] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:44:39.975479] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-26T18:44:39.996067] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T18:44:40.219794] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:40.756747] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-26T18:44:41.017334] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T18:44:41.556764] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-26T18:44:42.313009] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T18:44:42.323626] [INFO ] [REMOTE ] EVH: Full fetch complete (71768 records). [2025-09-26T18:44:42.323858] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-26T18:44:42.361956] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-26T18:44:42.754254] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-26T18:44:42.754352] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-26T18:44:42.755237] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-26T18:44:42.755305] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-26T18:44:42.756934] [DEBUG] [LOCAL ] EVH: Trimmed 71768 records to 50111 (keeping 200 days of data) [2025-09-26T18:44:43.061837] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T18:44:43.084253] [DEBUG] [LOCAL ] EVH: Primary data saved (50111 records). [2025-09-26T18:44:43.084426] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-26T18:44:43.084528] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVH took 38.2s. Estimated remaining: 3h 29m 4s. Rate: 7.6 symbols/min [2025-09-26T18:44:43.161841] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-26T18:44:43.283041] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:43.325750] [DEBUG] [LOCAL ] EVTL: Loaded 37759 existing records from primary storage. [2025-09-26T18:44:43.325962] [INFO ] [MAIN ] EVTL: Loaded 37759 existing records. [2025-09-26T18:44:43.474499] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:44:43.549292] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:43.549616] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-26T18:44:43.549710] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-26T18:44:43.550686] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-26T18:44:43.550768] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-26T18:44:43.883438] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T18:44:43.961952] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-26T18:44:43.967982] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:44.756716] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-26T18:44:45.069356] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T18:44:45.305332] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T18:44:45.556743] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-26T18:44:46.356784] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-26T18:44:47.041927] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:44:47.099538] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-26T18:44:47.102292] [INFO ] [REMOTE ] EVN: Full fetch complete (17540 records). [2025-09-26T18:44:47.102405] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-26T18:44:47.161811] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-26T18:44:47.550225] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-26T18:44:47.550323] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-26T18:44:47.550863] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-26T18:44:47.550941] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-26T18:44:47.551922] [DEBUG] [LOCAL ] EVN: Trimmed 17540 records to 11217 (keeping 200 days of data) [2025-09-26T18:44:47.627263] [DEBUG] [LOCAL ] EVN: Primary data saved (11217 records). [2025-09-26T18:44:47.627427] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-26T18:44:47.627521] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVN took 37.5s. Estimated remaining: 3h 28m 49s. Rate: 7.6 symbols/min [2025-09-26T18:44:47.826230] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:47.850633] [DEBUG] [LOCAL ] EVTR: Loaded 23468 existing records from primary storage. [2025-09-26T18:44:47.850810] [INFO ] [MAIN ] EVTR: Loaded 23468 existing records. [2025-09-26T18:44:47.966319] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-26T18:44:48.056189] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:44:48.056490] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-26T18:44:48.056549] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-26T18:44:48.057368] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-26T18:44:48.057460] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-26T18:44:48.466838] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:48.477522] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:44:48.740317] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T18:44:48.756680] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-26T18:44:49.556720] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-26T18:44:49.820533] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T18:44:50.356769] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-26T18:44:50.934230] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:44:51.035169] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:44:51.156775] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-26T18:44:51.956729] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-26T18:44:52.155528] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T18:44:52.756772] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-26T18:44:53.409790] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T18:44:53.556746] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-26T18:44:53.725854] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T18:44:53.732026] [INFO ] [REMOTE ] EVT: Full fetch complete (25214 records). [2025-09-26T18:44:53.732229] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-26T18:44:54.165695] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-26T18:44:54.165800] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-26T18:44:54.166381] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-26T18:44:54.166464] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-26T18:44:54.167423] [DEBUG] [LOCAL ] EVT: Trimmed 25214 records to 17270 (keeping 200 days of data) [2025-09-26T18:44:54.273844] [DEBUG] [LOCAL ] EVT: Primary data saved (17270 records). [2025-09-26T18:44:54.274007] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-26T18:44:54.274144] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVT took 20.6s. Estimated remaining: 3h 28m 39s. Rate: 7.6 symbols/min [2025-09-26T18:44:54.361900] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-26T18:44:54.458974] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:44:54.459297] [DEBUG] [LOCAL ] EW: No existing data file found in primary storage. [2025-09-26T18:44:54.459484] [WARN ] [MAIN ] EW: No existing data found, performing full refresh instead. [2025-09-26T18:44:54.459688] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-26T18:44:54.459744] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-26T18:44:54.459789] [DEBUG] [LOCAL ] EW: No primary data file found to delete. [2025-09-26T18:44:54.459830] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-26T18:44:54.757194] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T18:44:54.873068] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:44:55.156734] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-26T18:44:55.575558] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T18:44:55.836694] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-26T18:44:55.956734] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-26T18:44:56.756711] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-26T18:44:57.198973] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:44:57.556719] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-26T18:44:58.356717] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-26T18:44:58.555429] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T18:44:58.890221] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T18:44:58.973575] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:44:59.156721] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-26T18:44:59.956702] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-26T18:45:00.344183] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T18:45:00.756728] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-26T18:45:01.556735] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-26T18:45:01.879824] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T18:45:01.923501] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T18:45:02.356722] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-26T18:45:02.444890] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:45:03.156724] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-26T18:45:03.956690] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-26T18:45:04.033883] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T18:45:04.330024] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T18:45:04.756723] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-26T18:45:05.424066] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:45:05.556968] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-26T18:45:05.556883] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T18:45:06.356732] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-26T18:45:06.728979] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T18:45:07.156835] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-26T18:45:07.878728] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:45:07.884098] [INFO ] [REMOTE ] EVTC: Full fetch complete (37742 records). [2025-09-26T18:45:07.884214] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-26T18:45:07.884866] [FATAL] [VALIDATOR ] EVTC: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:45:07.884972] [FATAL] [MAIN ] EVTC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:45:07.885050] [WARN ] [MAIN ] EVTC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:45:07.885149] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-26T18:45:07.885232] [DEBUG] [LOCAL ] EVTC: No primary data file found to delete. [2025-09-26T18:45:07.885271] [INFO ] [LOCAL ] EVTC: Starting deletion of derivative data. [2025-09-26T18:45:07.885775] [DEBUG] [LOCAL ] EVTC: Deleted derivative data file. [2025-09-26T18:45:07.885876] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTC took 28.5s. Estimated remaining: 3h 28m 42s. Rate: 7.6 symbols/min [2025-09-26T18:45:07.965560] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-26T18:45:08.068115] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:08.111389] [DEBUG] [LOCAL ] EXG: Loaded 34473 existing records from primary storage. [2025-09-26T18:45:08.111561] [INFO ] [MAIN ] EXG: Loaded 34473 existing records. [2025-09-26T18:45:08.304895] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:08.305189] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-26T18:45:08.305299] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-26T18:45:08.306796] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-26T18:45:08.306862] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-26T18:45:08.626009] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T18:45:08.740618] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:08.756712] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-26T18:45:08.898233] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T18:45:09.556737] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-26T18:45:09.885180] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T18:45:10.356726] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-26T18:45:10.829351] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:45:11.156774] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-26T18:45:11.956773] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-26T18:45:12.235326] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T18:45:12.553407] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:45:12.756757] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-26T18:45:13.396890] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:45:13.556728] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-26T18:45:14.356721] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-26T18:45:14.400229] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T18:45:14.440871] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T18:45:15.156767] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-26T18:45:15.956691] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-26T18:45:16.089054] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T18:45:16.347282] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T18:45:16.756768] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-26T18:45:17.556697] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-26T18:45:17.831770] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:45:17.970084] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T18:45:18.356823] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-26T18:45:19.161918] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-26T18:45:19.191175] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T18:45:19.837941] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:45:19.956780] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-26T18:45:20.313258] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T18:45:20.756761] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-26T18:45:21.556740] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-26T18:45:21.753854] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T18:45:21.763927] [INFO ] [REMOTE ] EVTL: Full fetch complete (50676 records). [2025-09-26T18:45:21.764112] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-26T18:45:21.764922] [FATAL] [VALIDATOR ] EVTL: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:45:21.765019] [FATAL] [MAIN ] EVTL: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:45:21.765066] [WARN ] [MAIN ] EVTL: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:45:21.765108] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-26T18:45:21.765174] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-09-26T18:45:21.765212] [INFO ] [LOCAL ] EVTL: Starting deletion of derivative data. [2025-09-26T18:45:21.765671] [DEBUG] [LOCAL ] EVTL: Deleted derivative data file. [2025-09-26T18:45:21.765778] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EVTL took 38.7s. Estimated remaining: 3h 28m 46s. Rate: 7.5 symbols/min [2025-09-26T18:45:21.977361] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:22.009258] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T18:45:22.067492] [DEBUG] [LOCAL ] EXK: Loaded 53514 existing records from primary storage. [2025-09-26T18:45:22.067699] [INFO ] [MAIN ] EXK: Loaded 53514 existing records. [2025-09-26T18:45:22.282274] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:22.282554] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-26T18:45:22.282605] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-26T18:45:22.284019] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-26T18:45:22.284084] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-26T18:45:22.363749] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-26T18:45:22.678009] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:22.847304] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T18:45:22.854356] [INFO ] [REMOTE ] EVTR: Full fetch complete (32102 records). [2025-09-26T18:45:22.854473] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-26T18:45:23.162509] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-26T18:45:23.254858] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-26T18:45:23.254953] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-26T18:45:23.255530] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-26T18:45:23.255591] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-26T18:45:23.256546] [DEBUG] [LOCAL ] EVTR: Trimmed 32102 records to 23675 (keeping 200 days of data) [2025-09-26T18:45:23.404523] [DEBUG] [LOCAL ] EVTR: Primary data saved (23675 records). [2025-09-26T18:45:23.404685] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-26T18:45:23.404797] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EVTR took 35.8s. Estimated remaining: 3h 28m 26s. Rate: 7.6 symbols/min [2025-09-26T18:45:23.578885] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:23.579095] [DEBUG] [LOCAL ] EXP: No existing data file found in primary storage. [2025-09-26T18:45:23.579134] [WARN ] [MAIN ] EXP: No existing data found, performing full refresh instead. [2025-09-26T18:45:23.579276] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-26T18:45:23.579319] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-26T18:45:23.579402] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-09-26T18:45:23.579448] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-26T18:45:23.971592] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-26T18:45:24.019499] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:24.065722] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T18:45:24.693346] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T18:45:24.756792] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-26T18:45:25.454600] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-26T18:45:25.556753] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-26T18:45:25.770290] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T18:45:26.356801] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-26T18:45:27.068739] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:45:27.156774] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-26T18:45:27.808767] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T18:45:27.956797] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-26T18:45:28.690681] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T18:45:28.756768] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-26T18:45:29.465029] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:45:29.556746] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-26T18:45:30.359669] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-26T18:45:30.363461] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T18:45:30.635372] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:45:31.156747] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-26T18:45:31.320576] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T18:45:31.956784] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-26T18:45:32.756777] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-26T18:45:33.236727] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T18:45:33.415376] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-26T18:45:33.426492] [INFO ] [REMOTE ] EW: Full fetch complete (77348 records). [2025-09-26T18:45:33.426718] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-26T18:45:33.561885] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-26T18:45:33.909160] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-26T18:45:33.909354] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-26T18:45:33.913883] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-26T18:45:33.915133] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-26T18:45:33.914949] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T18:45:33.923860] [INFO ] [REMOTE ] EXG: Full fetch complete (49890 records). [2025-09-26T18:45:33.923994] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-26T18:45:33.930382] [DEBUG] [LOCAL ] EW: Trimmed 77348 records to 54176 (keeping 200 days of data) [2025-09-26T18:45:34.359254] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-26T18:45:34.461727] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-26T18:45:34.462957] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-26T18:45:34.463932] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-26T18:45:34.464276] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-26T18:45:34.468563] [DEBUG] [LOCAL ] EXG: Trimmed 49890 records to 34725 (keeping 200 days of data) [2025-09-26T18:45:34.938568] [DEBUG] [LOCAL ] EXG: Primary data saved (34725 records). [2025-09-26T18:45:34.939783] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-26T18:45:34.940047] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EXG took 27.1s. Estimated remaining: 3h 28m 25s. Rate: 7.6 symbols/min [2025-09-26T18:45:34.955590] [DEBUG] [LOCAL ] EW: Primary data saved (54176 records). [2025-09-26T18:45:34.955774] [INFO ] [MAIN ] EW: Full history saved. [2025-09-26T18:45:34.955941] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EW took 40.7s. Estimated remaining: 3h 28m 1s. Rate: 7.6 symbols/min [2025-09-26T18:45:35.249240] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T18:45:35.261374] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-26T18:45:35.643074] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T18:45:35.956787] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-26T18:45:36.667408] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T18:45:36.756760] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-26T18:45:37.459740] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T18:45:37.556734] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-26T18:45:38.681199] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T18:45:38.693185] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-26T18:45:38.743765] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:45:39.156769] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-26T18:45:40.737434] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-26T18:45:40.749812] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-26T18:45:40.803751] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:45:40.814189] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-26T18:45:41.789156] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T18:45:41.800100] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-26T18:45:42.264765] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:45:42.356765] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-26T18:45:43.181925] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T18:45:43.190696] [INFO ] [REMOTE ] EXP: Full fetch complete (43052 records). [2025-09-26T18:45:43.190905] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-26T18:45:43.597826] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-26T18:45:43.597941] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-26T18:45:43.598623] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-26T18:45:43.598702] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-26T18:45:43.600157] [DEBUG] [LOCAL ] EXP: Trimmed 43052 records to 30275 (keeping 200 days of data) [2025-09-26T18:45:43.806596] [DEBUG] [LOCAL ] EXP: Primary data saved (30275 records). [2025-09-26T18:45:43.806768] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-26T18:45:43.806854] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXP took 20.4s. Estimated remaining: 3h 27m 55s. Rate: 7.6 symbols/min [2025-09-26T18:45:44.268108] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T18:45:44.279606] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-26T18:45:46.459842] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T18:45:46.479183] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-26T18:45:48.359301] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T18:45:48.371880] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-26T18:45:50.507288] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:45:50.521888] [INFO ] [REMOTE ] EXK: Full fetch complete (76493 records). [2025-09-26T18:45:50.522046] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-26T18:45:50.945409] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-26T18:45:50.945507] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-26T18:45:50.946523] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-26T18:45:50.946596] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-26T18:45:50.948487] [DEBUG] [LOCAL ] EXK: Trimmed 76493 records to 53904 (keeping 200 days of data) [2025-09-26T18:45:51.289301] [DEBUG] [LOCAL ] EXK: Primary data saved (53904 records). [2025-09-26T18:45:51.289481] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-26T18:45:51.289612] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXK took 29.5s. Estimated remaining: 3h 27m 46s. Rate: 7.6 symbols/min [2025-09-26T18:45:51.883588] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:51.931083] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:51.921612] [DEBUG] [LOCAL ] EXPD: No existing data file found in primary storage. [2025-09-26T18:45:51.977895] [WARN ] [MAIN ] EXPD: No existing data found, performing full refresh instead. [2025-09-26T18:45:52.030939] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:52.041447] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-26T18:45:52.056895] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-26T18:45:52.057634] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-09-26T18:45:52.057743] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-26T18:45:52.067391] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:45:52.414578] [DEBUG] [LOCAL ] FAF: Loaded 42198 existing records from primary storage. [2025-09-26T18:45:52.433305] [INFO ] [MAIN ] FAF: Loaded 42198 existing records. [2025-09-26T18:45:52.559882] [DEBUG] [LOCAL ] EXR: Loaded 45800 existing records from primary storage. [2025-09-26T18:45:52.606240] [INFO ] [MAIN ] EXR: Loaded 45800 existing records. [2025-09-26T18:45:52.647322] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-09-26T18:45:52.665382] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-09-26T18:45:52.726254] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:52.835532] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-26T18:45:53.087781] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:53.136368] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-26T18:45:53.223974] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-26T18:45:53.267443] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:53.282269] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-26T18:45:53.281949] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:45:53.282479] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-26T18:45:53.282609] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-26T18:45:53.282795] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-26T18:45:53.283591] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-26T18:45:53.283827] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-26T18:45:53.289393] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-26T18:45:53.289301] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-26T18:45:53.301927] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-26T18:45:53.312778] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-26T18:45:54.494265] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:54.533589] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-26T18:45:54.533203] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:54.580008] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-26T18:45:54.602455] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:45:54.604290] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-26T18:45:54.703558] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T18:45:54.713572] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-26T18:45:55.848145] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:45:55.855456] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-26T18:45:56.021083] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T18:45:56.032090] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-26T18:45:56.150258] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T18:45:56.159387] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-26T18:45:56.974627] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T18:45:56.985254] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-26T18:45:57.184971] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-26T18:45:57.197048] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-26T18:45:57.749755] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T18:45:57.761796] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-26T18:45:57.950842] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-26T18:45:57.961352] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-26T18:45:58.357327] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T18:45:58.366287] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-26T18:45:59.475161] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:45:59.485261] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-26T18:45:59.588358] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T18:45:59.602127] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-26T18:45:59.651968] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-09-26T18:45:59.665155] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-26T18:45:59.886848] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T18:45:59.895601] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-26T18:46:01.120378] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T18:46:01.130690] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-26T18:46:01.428493] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T18:46:01.439939] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-26T18:46:01.680671] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T18:46:01.691811] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-26T18:46:02.120041] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-26T18:46:02.134906] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-26T18:46:02.586965] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T18:46:02.597374] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-26T18:46:02.794150] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T18:46:02.851257] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:46:03.156824] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-26T18:46:03.867172] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T18:46:03.956789] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-26T18:46:04.258265] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-26T18:46:04.300820] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T18:46:04.756742] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-26T18:46:05.278289] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T18:46:05.556742] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-26T18:46:06.356793] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-26T18:46:06.903201] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T18:46:07.017455] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-26T18:46:07.156736] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-26T18:46:07.651270] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T18:46:07.956732] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-26T18:46:08.756766] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-26T18:46:09.298457] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T18:46:09.437926] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-26T18:46:09.556723] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-26T18:46:10.356745] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-26T18:46:10.412942] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T18:46:11.156799] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-26T18:46:11.238843] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:46:11.633755] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T18:46:11.956800] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-26T18:46:12.601664] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T18:46:12.611549] [INFO ] [REMOTE ] EXPD: Full fetch complete (69217 records). [2025-09-26T18:46:12.611764] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-26T18:46:12.764040] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-26T18:46:13.047367] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-26T18:46:13.047586] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-26T18:46:13.048484] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-26T18:46:13.048580] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-26T18:46:13.073467] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T18:46:13.081598] [DEBUG] [LOCAL ] EXPD: Trimmed 69217 records to 48786 (keeping 200 days of data) [2025-09-26T18:46:13.408912] [DEBUG] [LOCAL ] EXPD: Primary data saved (48786 records). [2025-09-26T18:46:13.409068] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-26T18:46:13.409161] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. EXPD took 22.1s. Estimated remaining: 3h 28m 6s. Rate: 7.5 symbols/min [2025-09-26T18:46:13.565904] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-26T18:46:13.594055] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:13.646110] [DEBUG] [LOCAL ] FBIN: Loaded 50757 existing records from primary storage. [2025-09-26T18:46:13.646271] [INFO ] [MAIN ] FBIN: Loaded 50757 existing records. [2025-09-26T18:46:13.849732] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:13.850040] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-26T18:46:13.850097] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-26T18:46:13.851528] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-26T18:46:13.851592] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-26T18:46:14.240516] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:14.356779] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-26T18:46:15.156724] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-26T18:46:15.282263] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-26T18:46:15.353111] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:46:15.362551] [INFO ] [REMOTE ] EXR: Full fetch complete (65908 records). [2025-09-26T18:46:15.362766] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-26T18:46:15.819800] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-26T18:46:15.819943] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-26T18:46:15.820915] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-26T18:46:15.821067] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-26T18:46:15.832521] [DEBUG] [LOCAL ] EXR: Trimmed 65908 records to 46080 (keeping 200 days of data) [2025-09-26T18:46:15.851363] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:46:15.957701] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-26T18:46:16.164832] [DEBUG] [LOCAL ] EXR: Primary data saved (46080 records). [2025-09-26T18:46:16.164984] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-26T18:46:16.167206] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. EXR took 24.9s. Estimated remaining: 3h 27m 48s. Rate: 7.6 symbols/min [2025-09-26T18:46:16.348265] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:16.378849] [DEBUG] [LOCAL ] FBK: Loaded 25859 existing records from primary storage. [2025-09-26T18:46:16.378990] [INFO ] [MAIN ] FBK: Loaded 25859 existing records. [2025-09-26T18:46:16.581869] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:16.582326] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-26T18:46:16.582495] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-26T18:46:16.583530] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-26T18:46:16.583598] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-26T18:46:16.739569] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T18:46:16.757343] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-26T18:46:16.835258] [INFO ] [REMOTE ] FAF: Full fetch complete (57542 records). [2025-09-26T18:46:16.869111] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-26T18:46:17.175721] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:17.450308] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-26T18:46:17.450402] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-26T18:46:17.451165] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-26T18:46:17.451239] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-26T18:46:17.452617] [DEBUG] [LOCAL ] FAF: Trimmed 57542 records to 42474 (keeping 200 days of data) [2025-09-26T18:46:17.556892] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-26T18:46:17.745310] [DEBUG] [LOCAL ] FAF: Primary data saved (42474 records). [2025-09-26T18:46:17.745471] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-26T18:46:17.748593] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. FAF took 26.5s. Estimated remaining: 3h 27m 28s. Rate: 7.6 symbols/min [2025-09-26T18:46:17.967362] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:18.027179] [DEBUG] [LOCAL ] FBP: Loaded 46592 existing records from primary storage. [2025-09-26T18:46:18.027340] [INFO ] [MAIN ] FBP: Loaded 46592 existing records. [2025-09-26T18:46:18.234185] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:18.234486] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-26T18:46:18.234549] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-26T18:46:18.235853] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-26T18:46:18.235919] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-26T18:46:18.754212] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-26T18:46:18.771458] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:46:18.761791] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:18.780568] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-26T18:46:18.817932] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T18:46:19.156776] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-26T18:46:19.956812] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-26T18:46:20.321195] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-26T18:46:20.423098] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:46:20.756792] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-26T18:46:21.556730] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-26T18:46:21.959915] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T18:46:22.052210] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-26T18:46:22.356760] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-26T18:46:22.787122] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T18:46:23.156731] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-26T18:46:23.956783] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-26T18:46:24.556037] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:46:24.599198] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T18:46:24.610123] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-26T18:46:24.610285] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-26T18:46:24.766240] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-26T18:46:24.908699] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:46:25.066983] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-26T18:46:25.067070] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-26T18:46:25.068043] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-26T18:46:25.068110] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-26T18:46:25.069685] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-09-26T18:46:25.433799] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-09-26T18:46:25.433955] [INFO ] [MAIN ] F: Full history saved. [2025-09-26T18:46:25.434073] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 34.1s. Estimated remaining: 3h 27m 19s. Rate: 7.6 symbols/min [2025-09-26T18:46:25.561803] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-26T18:46:25.621223] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:25.656836] [DEBUG] [LOCAL ] FBRT: Loaded 34745 existing records from primary storage. [2025-09-26T18:46:25.657006] [INFO ] [MAIN ] FBRT: Loaded 34745 existing records. [2025-09-26T18:46:25.855457] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:25.855763] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-26T18:46:25.855820] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-26T18:46:25.856788] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-26T18:46:25.856855] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-26T18:46:26.253830] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:26.356740] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-26T18:46:26.676029] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T18:46:26.699931] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:46:27.156775] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-26T18:46:27.610268] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T18:46:27.956759] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-26T18:46:28.601141] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:46:28.756761] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-26T18:46:29.274921] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T18:46:29.556740] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-26T18:46:29.927889] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T18:46:30.356773] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-26T18:46:31.156781] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-26T18:46:31.241329] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T18:46:31.912187] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T18:46:31.956775] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-26T18:46:32.026549] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T18:46:32.756791] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-26T18:46:32.977031] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T18:46:33.556742] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-26T18:46:34.299511] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T18:46:34.356681] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-26T18:46:34.749010] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T18:46:35.156806] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-26T18:46:35.616418] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T18:46:35.873962] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T18:46:35.956732] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-26T18:46:36.756785] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-26T18:46:37.561735] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-26T18:46:37.585356] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T18:46:37.641375] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-26T18:46:38.356800] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-26T18:46:38.518089] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T18:46:39.156800] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-26T18:46:39.457323] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:46:39.956798] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-26T18:46:40.563252] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T18:46:40.756766] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-26T18:46:41.556724] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-26T18:46:41.630119] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T18:46:42.356743] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-26T18:46:42.398426] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T18:46:42.670868] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-26T18:46:43.156754] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-26T18:46:43.779581] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T18:46:43.788369] [INFO ] [REMOTE ] FBP: Full fetch complete (66339 records). [2025-09-26T18:46:43.788495] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-26T18:46:43.961807] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-26T18:46:44.224178] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-26T18:46:44.224286] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-26T18:46:44.225304] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-26T18:46:44.225378] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-26T18:46:44.227007] [DEBUG] [LOCAL ] FBP: Trimmed 66339 records to 46874 (keeping 200 days of data) [2025-09-26T18:46:44.541075] [DEBUG] [LOCAL ] FBP: Primary data saved (46874 records). [2025-09-26T18:46:44.541277] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-26T18:46:44.541406] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBP took 26.8s. Estimated remaining: 3h 27m 33s. Rate: 7.5 symbols/min [2025-09-26T18:46:44.752728] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T18:46:44.761912] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-26T18:46:44.786713] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:44.809869] [DEBUG] [LOCAL ] FC: Loaded 15445 existing records from primary storage. [2025-09-26T18:46:44.810042] [INFO ] [MAIN ] FC: Loaded 15445 existing records. [2025-09-26T18:46:45.036299] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:45.036566] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-26T18:46:45.036616] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-26T18:46:45.037217] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-26T18:46:45.037281] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-26T18:46:45.455068] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:45.556722] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-26T18:46:45.816614] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T18:46:45.827911] [INFO ] [REMOTE ] FBIN: Full fetch complete (72599 records). [2025-09-26T18:46:45.828211] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-26T18:46:46.091259] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:46:46.247665] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T18:46:46.324848] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-26T18:46:46.325005] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-26T18:46:46.325995] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-26T18:46:46.326063] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-26T18:46:46.327838] [DEBUG] [LOCAL ] FBIN: Trimmed 72599 records to 51061 (keeping 200 days of data) [2025-09-26T18:46:46.386832] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-26T18:46:46.665994] [DEBUG] [LOCAL ] FBIN: Primary data saved (51061 records). [2025-09-26T18:46:46.666142] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-26T18:46:46.666235] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBIN took 33.3s. Estimated remaining: 3h 27m 14s. Rate: 7.6 symbols/min [2025-09-26T18:46:46.851174] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:46.892152] [DEBUG] [LOCAL ] FCF: Loaded 39973 existing records from primary storage. [2025-09-26T18:46:46.892332] [INFO ] [MAIN ] FCF: Loaded 39973 existing records. [2025-09-26T18:46:47.088012] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:47.088355] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-26T18:46:47.088455] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-26T18:46:47.089585] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-26T18:46:47.089691] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-26T18:46:47.161969] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-26T18:46:47.493513] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:47.849335] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-26T18:46:47.956800] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-26T18:46:48.043927] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T18:46:48.049301] [INFO ] [REMOTE ] FBK: Full fetch complete (33214 records). [2025-09-26T18:46:48.049454] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-26T18:46:48.476425] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-26T18:46:48.476539] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-26T18:46:48.477400] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-26T18:46:48.477478] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-26T18:46:48.478663] [DEBUG] [LOCAL ] FBK: Trimmed 33214 records to 26066 (keeping 200 days of data) [2025-09-26T18:46:48.647940] [DEBUG] [LOCAL ] FBK: Primary data saved (26066 records). [2025-09-26T18:46:48.648088] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-26T18:46:48.648208] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FBK took 32.5s. Estimated remaining: 3h 26m 54s. Rate: 7.6 symbols/min [2025-09-26T18:46:48.761009] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-26T18:46:48.841551] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:48.871821] [DEBUG] [LOCAL ] FCN: Loaded 26414 existing records from primary storage. [2025-09-26T18:46:48.872003] [INFO ] [MAIN ] FCN: Loaded 26414 existing records. [2025-09-26T18:46:49.081857] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:49.082506] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-26T18:46:49.082730] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-26T18:46:49.083529] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-26T18:46:49.083610] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-26T18:46:49.390421] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T18:46:49.532830] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:49.556740] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-26T18:46:50.052531] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T18:46:50.356744] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-26T18:46:51.156728] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-26T18:46:51.529718] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T18:46:51.629880] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T18:46:51.816604] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T18:46:51.956775] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-26T18:46:52.756763] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-26T18:46:53.195816] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:46:53.556767] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-26T18:46:53.949764] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T18:46:53.956906] [INFO ] [REMOTE ] FBRT: Full fetch complete (48543 records). [2025-09-26T18:46:53.957069] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-26T18:46:54.357934] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-26T18:46:54.365147] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T18:46:54.421834] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-26T18:46:54.421949] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-26T18:46:54.422848] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-26T18:46:54.422914] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-26T18:46:54.424752] [DEBUG] [LOCAL ] FBRT: Trimmed 48543 records to 34985 (keeping 200 days of data) [2025-09-26T18:46:54.655231] [DEBUG] [LOCAL ] FBRT: Primary data saved (34985 records). [2025-09-26T18:46:54.655455] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-26T18:46:54.655605] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FBRT took 29.2s. Estimated remaining: 3h 26m 43s. Rate: 7.6 symbols/min [2025-09-26T18:46:54.830511] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:46:54.870252] [DEBUG] [LOCAL ] FCPT: Loaded 37647 existing records from primary storage. [2025-09-26T18:46:54.870488] [INFO ] [MAIN ] FCPT: Loaded 37647 existing records. [2025-09-26T18:46:55.058299] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:46:55.058662] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-26T18:46:55.058730] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-26T18:46:55.059915] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-26T18:46:55.059981] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-26T18:46:55.161935] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-26T18:46:55.448969] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:46:55.864860] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T18:46:55.887013] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-26T18:46:55.956761] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-26T18:46:56.756754] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-26T18:46:57.288232] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T18:46:57.556783] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-26T18:46:58.196395] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T18:46:58.356737] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-26T18:46:58.379286] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T18:46:59.156793] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-26T18:46:59.956778] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-26T18:47:00.011568] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T18:47:00.059544] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T18:47:00.756839] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-26T18:47:00.811697] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T18:47:01.556764] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-26T18:47:01.841704] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:47:02.332473] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T18:47:02.356737] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-26T18:47:03.156748] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-26T18:47:03.440162] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T18:47:03.956783] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-26T18:47:04.353265] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T18:47:04.589435] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T18:47:04.756768] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-26T18:47:05.556792] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-26T18:47:05.771427] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T18:47:05.775285] [INFO ] [REMOTE ] FC: Full fetch complete (21645 records). [2025-09-26T18:47:05.775458] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-26T18:47:06.182577] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-26T18:47:06.182684] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-26T18:47:06.183162] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-26T18:47:06.183204] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-26T18:47:06.183891] [DEBUG] [LOCAL ] FC: Trimmed 21645 records to 15634 (keeping 200 days of data) [2025-09-26T18:47:06.279488] [DEBUG] [LOCAL ] FC: Primary data saved (15634 records). [2025-09-26T18:47:06.279668] [INFO ] [MAIN ] FC: Full history saved. [2025-09-26T18:47:06.279832] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FC took 21.7s. Estimated remaining: 3h 26m 42s. Rate: 7.6 symbols/min [2025-09-26T18:47:06.366066] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-26T18:47:06.473103] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:06.473325] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-26T18:47:06.473382] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-26T18:47:06.473575] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-26T18:47:06.473663] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-26T18:47:06.473750] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-26T18:47:06.473800] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-26T18:47:06.929342] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:47:06.927932] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:07.156715] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-26T18:47:07.568242] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-26T18:47:07.956749] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-26T18:47:08.135966] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T18:47:08.756784] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-26T18:47:08.975431] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T18:47:09.556741] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-26T18:47:09.789693] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T18:47:10.356701] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-26T18:47:10.447313] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:47:10.609920] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-26T18:47:11.156775] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-26T18:47:11.597681] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-26T18:47:11.956768] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-26T18:47:12.756740] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-26T18:47:13.407635] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:47:13.556757] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-26T18:47:14.359988] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-26T18:47:14.365975] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T18:47:15.041039] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-26T18:47:15.074533] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:47:15.156728] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-26T18:47:15.956775] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-26T18:47:16.678098] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T18:47:16.756764] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-26T18:47:16.872722] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T18:47:17.556743] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-26T18:47:17.829753] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-26T18:47:17.859935] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T18:47:18.356787] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-26T18:47:19.156765] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-26T18:47:19.510744] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-26T18:47:19.956754] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-26T18:47:20.009842] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T18:47:20.756771] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-26T18:47:21.422432] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T18:47:21.521366] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T18:47:21.529209] [INFO ] [REMOTE ] FCF: Full fetch complete (58117 records). [2025-09-26T18:47:21.529388] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-26T18:47:21.561979] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-26T18:47:21.955474] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-26T18:47:21.955592] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-26T18:47:21.956414] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-26T18:47:21.956491] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-26T18:47:21.957926] [DEBUG] [LOCAL ] FCF: Trimmed 58117 records to 40237 (keeping 200 days of data) [2025-09-26T18:47:22.049936] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-26T18:47:22.219852] [DEBUG] [LOCAL ] FCF: Primary data saved (40237 records). [2025-09-26T18:47:22.219990] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-26T18:47:22.220100] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCF took 35.6s. Estimated remaining: 3h 26m 49s. Rate: 7.5 symbols/min [2025-09-26T18:47:22.361825] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-26T18:47:22.427557] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:22.444420] [DEBUG] [LOCAL ] FCT: Loaded 14502 existing records from primary storage. [2025-09-26T18:47:22.444620] [INFO ] [MAIN ] FCT: Loaded 14502 existing records. [2025-09-26T18:47:22.660067] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:22.660535] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-26T18:47:22.660604] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-26T18:47:22.661235] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-26T18:47:22.661303] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-26T18:47:23.038808] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:23.156767] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-26T18:47:23.500446] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T18:47:23.817599] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T18:47:23.956802] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-26T18:47:24.756765] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-26T18:47:25.165376] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-26T18:47:25.187852] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T18:47:25.556724] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-26T18:47:25.910743] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T18:47:26.356731] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-26T18:47:27.156772] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-26T18:47:27.603979] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:47:27.609390] [INFO ] [REMOTE ] FCN: Full fetch complete (35699 records). [2025-09-26T18:47:27.609568] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-26T18:47:27.972675] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-26T18:47:28.025765] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-26T18:47:28.025855] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-26T18:47:28.026477] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-26T18:47:28.026541] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-26T18:47:28.027689] [DEBUG] [LOCAL ] FCN: Trimmed 35699 records to 26559 (keeping 200 days of data) [2025-09-26T18:47:28.196407] [DEBUG] [LOCAL ] FCN: Primary data saved (26559 records). [2025-09-26T18:47:28.196562] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-26T18:47:28.196687] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCN took 39.5s. Estimated remaining: 3h 26m 38s. Rate: 7.5 symbols/min [2025-09-26T18:47:28.385268] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:28.420535] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-26T18:47:28.465344] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T18:47:28.466915] [INFO ] [REMOTE ] FCRX: Full fetch complete (1674 records). [2025-09-26T18:47:28.467138] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-26T18:47:28.615098] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-09-26T18:47:28.638604] [INFO ] [MAIN ] FCX: Loaded 54090 existing records. [2025-09-26T18:47:28.759781] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-26T18:47:28.862160] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-26T18:47:28.879198] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:47:28.889806] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:47:28.926691] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-26T18:47:28.928083] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-26T18:47:28.928207] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-26T18:47:28.929015] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-26T18:47:28.929928] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FCRX took 22.6s. Estimated remaining: 3h 26m 16s. Rate: 7.6 symbols/min [2025-09-26T18:47:28.953139] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:28.995682] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-26T18:47:29.034754] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-26T18:47:29.068683] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-26T18:47:29.083536] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-26T18:47:29.282090] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:29.569416] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-26T18:47:29.576738] [DEBUG] [LOCAL ] FDP: Loaded 30588 existing records from primary storage. [2025-09-26T18:47:29.614241] [INFO ] [MAIN ] FDP: Loaded 30588 existing records. [2025-09-26T18:47:29.628076] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:29.826579] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T18:47:29.860809] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:29.861078] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-26T18:47:29.861131] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-26T18:47:29.862066] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-26T18:47:29.862131] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-26T18:47:30.277134] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:30.356737] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-26T18:47:30.744896] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T18:47:31.156710] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-26T18:47:31.237385] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T18:47:31.956775] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-26T18:47:32.438072] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T18:47:32.447715] [INFO ] [REMOTE ] FCPT: Full fetch complete (53409 records). [2025-09-26T18:47:32.447891] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-26T18:47:32.758540] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-26T18:47:32.850866] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T18:47:32.960935] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-26T18:47:32.961042] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-26T18:47:32.961837] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-26T18:47:32.961911] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-26T18:47:32.963366] [DEBUG] [LOCAL ] FCPT: Trimmed 53409 records to 37955 (keeping 200 days of data) [2025-09-26T18:47:33.203993] [DEBUG] [LOCAL ] FCPT: Primary data saved (37955 records). [2025-09-26T18:47:33.204159] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-26T18:47:33.204257] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCPT took 38.5s. Estimated remaining: 3h 26m 1s. Rate: 7.6 symbols/min [2025-09-26T18:47:33.397163] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:33.427846] [DEBUG] [LOCAL ] FDS: Loaded 26520 existing records from primary storage. [2025-09-26T18:47:33.428039] [INFO ] [MAIN ] FDS: Loaded 26520 existing records. [2025-09-26T18:47:33.561891] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-26T18:47:33.663597] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:33.664094] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-26T18:47:33.664176] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-26T18:47:33.665599] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-26T18:47:33.665719] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-26T18:47:34.039538] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:34.356785] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-26T18:47:34.741121] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T18:47:34.784463] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:47:35.156735] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-26T18:47:35.271395] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T18:47:35.956748] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-26T18:47:36.127779] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T18:47:36.756780] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-26T18:47:36.978987] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T18:47:37.425852] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T18:47:37.556746] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-26T18:47:38.356728] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-26T18:47:38.635795] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:47:39.156720] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-26T18:47:39.263786] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T18:47:39.956756] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-26T18:47:40.617016] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-26T18:47:40.756748] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-26T18:47:40.835353] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T18:47:41.465023] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T18:47:41.556718] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-26T18:47:42.356726] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-26T18:47:42.501716] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T18:47:43.156725] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-26T18:47:43.931401] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T18:47:43.956702] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-26T18:47:44.168286] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T18:47:44.756734] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-26T18:47:45.005808] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T18:47:45.009767] [INFO ] [REMOTE ] FCT: Full fetch complete (21141 records). [2025-09-26T18:47:45.009855] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-26T18:47:45.458810] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-26T18:47:45.459052] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-26T18:47:45.459630] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-26T18:47:45.459722] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-26T18:47:45.460546] [DEBUG] [LOCAL ] FCT: Trimmed 21141 records to 14613 (keeping 200 days of data) [2025-09-26T18:47:45.557073] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-26T18:47:45.561462] [DEBUG] [LOCAL ] FCT: Primary data saved (14613 records). [2025-09-26T18:47:45.562296] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-26T18:47:45.562394] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCT took 23.3s. Estimated remaining: 3h 26m 1s. Rate: 7.6 symbols/min [2025-09-26T18:47:45.755815] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:45.816096] [DEBUG] [LOCAL ] FDX: Loaded 51985 existing records from primary storage. [2025-09-26T18:47:45.816249] [INFO ] [MAIN ] FDX: Loaded 51985 existing records. [2025-09-26T18:47:46.009399] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:47:46.009850] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-26T18:47:46.009922] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-26T18:47:46.011453] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-26T18:47:46.011517] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-26T18:47:46.309139] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T18:47:46.361766] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-26T18:47:46.431276] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:47:47.156730] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-26T18:47:47.824415] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-26T18:47:47.855264] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:47:47.956738] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-26T18:47:48.091575] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T18:47:48.756723] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-26T18:47:49.556724] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-26T18:47:50.010162] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T18:47:50.359981] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-26T18:47:50.365844] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T18:47:50.520027] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T18:47:51.156728] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-26T18:47:51.249690] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T18:47:51.956724] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-26T18:47:52.657412] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T18:47:52.751392] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T18:47:52.756830] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-26T18:47:53.556727] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-26T18:47:53.910342] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T18:47:54.356887] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-26T18:47:55.164447] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-26T18:47:55.172866] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T18:47:55.531329] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-26T18:47:55.956747] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-26T18:47:56.492158] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T18:47:56.756733] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-26T18:47:57.297111] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-26T18:47:57.556722] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-26T18:47:58.072264] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T18:47:58.356714] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-26T18:47:59.022003] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:47:59.029929] [INFO ] [REMOTE ] FDS: Full fetch complete (37229 records). [2025-09-26T18:47:59.030076] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-26T18:47:59.161786] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-26T18:47:59.455375] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-26T18:47:59.455573] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-26T18:47:59.456350] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-26T18:47:59.456472] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-26T18:47:59.479185] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T18:47:59.479414] [DEBUG] [LOCAL ] FDS: Trimmed 37229 records to 26759 (keeping 200 days of data) [2025-09-26T18:47:59.679214] [DEBUG] [LOCAL ] FDS: Primary data saved (26759 records). [2025-09-26T18:47:59.679391] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-26T18:47:59.679688] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDS took 26.5s. Estimated remaining: 3h 26m 5s. Rate: 7.6 symbols/min [2025-09-26T18:47:59.864113] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:47:59.920912] [DEBUG] [LOCAL ] FE: Loaded 53818 existing records from primary storage. [2025-09-26T18:47:59.921113] [INFO ] [MAIN ] FE: Loaded 53818 existing records. [2025-09-26T18:47:59.965494] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-26T18:48:00.117928] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:00.118216] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-26T18:48:00.118268] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-26T18:48:00.119797] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-26T18:48:00.119871] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-26T18:48:00.502552] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:00.756719] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-26T18:48:01.235567] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-26T18:48:01.556735] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-26T18:48:01.696401] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T18:48:01.702800] [INFO ] [REMOTE ] FDP: Full fetch complete (42751 records). [2025-09-26T18:48:01.702968] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-26T18:48:02.107060] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-26T18:48:02.107187] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-26T18:48:02.108157] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-26T18:48:02.108246] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-26T18:48:02.109492] [DEBUG] [LOCAL ] FDP: Trimmed 42751 records to 30760 (keeping 200 days of data) [2025-09-26T18:48:02.304812] [DEBUG] [LOCAL ] FDP: Primary data saved (30760 records). [2025-09-26T18:48:02.304967] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-26T18:48:02.305099] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FDP took 33.4s. Estimated remaining: 3h 25m 47s. Rate: 7.6 symbols/min [2025-09-26T18:48:02.361852] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-26T18:48:02.492464] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:02.492747] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-26T18:48:02.492810] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-26T18:48:02.492989] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-26T18:48:02.493032] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-26T18:48:02.493074] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-26T18:48:02.493106] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-26T18:48:02.843778] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-26T18:48:02.930207] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:03.156689] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-26T18:48:03.291622] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:48:03.956742] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-26T18:48:04.090629] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T18:48:04.575835] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:48:04.756796] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-26T18:48:05.556773] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-26T18:48:05.632701] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T18:48:06.356720] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-26T18:48:06.725748] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-26T18:48:07.156708] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-26T18:48:07.508066] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T18:48:07.570283] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T18:48:07.867299] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T18:48:07.956786] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-26T18:48:08.756783] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-26T18:48:09.191551] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T18:48:09.556721] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-26T18:48:09.718379] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T18:48:10.356737] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-26T18:48:11.156711] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-26T18:48:11.572536] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T18:48:11.769495] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T18:48:11.956727] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-26T18:48:12.617195] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-26T18:48:12.756773] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-26T18:48:13.055557] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-26T18:48:13.476574] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T18:48:13.556741] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-26T18:48:14.356743] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-26T18:48:14.844298] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-26T18:48:15.156761] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-26T18:48:15.248383] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T18:48:15.464434] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-26T18:48:15.956747] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-26T18:48:16.490300] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T18:48:16.756786] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-26T18:48:17.556772] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-26T18:48:18.356702] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-26T18:48:18.558078] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T18:48:19.156727] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-26T18:48:19.474575] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-26T18:48:19.478474] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T18:48:19.956735] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-26T18:48:20.330849] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T18:48:20.379946] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-26T18:48:20.756745] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-26T18:48:21.556725] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-26T18:48:22.356750] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-26T18:48:22.952306] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-26T18:48:22.965162] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-09-26T18:48:22.965343] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-26T18:48:23.161857] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-26T18:48:23.473376] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-26T18:48:23.473508] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-26T18:48:23.474668] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-26T18:48:23.474828] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-26T18:48:23.493308] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54480 (keeping 200 days of data) [2025-09-26T18:48:23.512240] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-26T18:48:23.758261] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-26T18:48:23.760158] [INFO ] [REMOTE ] FENG: Full fetch complete (2245 records). [2025-09-26T18:48:23.760814] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-26T18:48:23.966343] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-26T18:48:23.973927] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T18:48:23.976077] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:48:23.977030] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:48:23.977498] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-26T18:48:23.977868] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-26T18:48:23.978501] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-26T18:48:23.979690] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-26T18:48:23.981010] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FENG took 21.7s. Estimated remaining: 3h 26m 5s. Rate: 7.5 symbols/min [2025-09-26T18:48:24.183272] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:24.311695] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T18:48:24.337820] [INFO ] [REMOTE ] FDX: Full fetch complete (74426 records). [2025-09-26T18:48:24.338723] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-26T18:48:24.400028] [DEBUG] [LOCAL ] FCX: Primary data saved (54480 records). [2025-09-26T18:48:24.445550] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-26T18:48:24.465807] [DEBUG] [LOCAL ] FERG: Loaded 49361 existing records from primary storage. [2025-09-26T18:48:24.466068] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FCX took 56.3s. Estimated remaining: 3h 25m 43s. Rate: 7.5 symbols/min [2025-09-26T18:48:24.483237] [INFO ] [MAIN ] FERG: Loaded 49361 existing records. [2025-09-26T18:48:25.117060] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:25.134994] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-26T18:48:25.151287] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-26T18:48:25.202754] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:25.232981] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-26T18:48:25.259193] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-26T18:48:25.259665] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-26T18:48:25.265172] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-26T18:48:25.279132] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-26T18:48:25.282845] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-26T18:48:25.358737] [DEBUG] [LOCAL ] FET: Loaded 12838 existing records from primary storage. [2025-09-26T18:48:25.389793] [INFO ] [MAIN ] FET: Loaded 12838 existing records. [2025-09-26T18:48:25.400736] [DEBUG] [LOCAL ] FDX: Trimmed 74426 records to 52362 (keeping 200 days of data) [2025-09-26T18:48:25.946323] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:26.019454] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-26T18:48:26.022877] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-26T18:48:26.045955] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:26.046258] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-26T18:48:26.047549] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-26T18:48:26.048324] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-26T18:48:26.069787] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-26T18:48:26.165695] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-26T18:48:26.616385] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:26.617621] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-26T18:48:26.730991] [DEBUG] [LOCAL ] FDX: Primary data saved (52362 records). [2025-09-26T18:48:26.731162] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-26T18:48:26.731255] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FDX took 41.2s. Estimated remaining: 3h 25m 24s. Rate: 7.6 symbols/min [2025-09-26T18:48:26.924420] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:26.953468] [DEBUG] [LOCAL ] FF: Loaded 25640 existing records from primary storage. [2025-09-26T18:48:26.953675] [INFO ] [MAIN ] FF: Loaded 25640 existing records. [2025-09-26T18:48:27.152146] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:27.152420] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-26T18:48:27.152468] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-26T18:48:27.153318] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-26T18:48:27.153379] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-26T18:48:27.596053] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T18:48:27.595389] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:27.600017] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-26T18:48:27.715792] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T18:48:27.956700] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-26T18:48:28.071566] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T18:48:28.082419] [INFO ] [REMOTE ] FE: Full fetch complete (77227 records). [2025-09-26T18:48:28.082616] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-26T18:48:28.545709] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-26T18:48:28.545582] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:48:28.545848] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-26T18:48:28.549961] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-26T18:48:28.550384] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-26T18:48:28.551871] [DEBUG] [LOCAL ] FE: Trimmed 77227 records to 54208 (keeping 200 days of data) [2025-09-26T18:48:28.775423] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-26T18:48:28.902344] [DEBUG] [LOCAL ] FE: Primary data saved (54208 records). [2025-09-26T18:48:28.902510] [INFO ] [MAIN ] FE: Full history saved. [2025-09-26T18:48:28.902603] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FE took 29.2s. Estimated remaining: 3h 25m 6s. Rate: 7.6 symbols/min [2025-09-26T18:48:29.104544] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:29.122289] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T18:48:29.134536] [DEBUG] [LOCAL ] FFA: Loaded 5730 existing records from primary storage. [2025-09-26T18:48:29.134630] [INFO ] [MAIN ] FFA: Loaded 5730 existing records. [2025-09-26T18:48:29.335554] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:29.335968] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-26T18:48:29.336044] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-26T18:48:29.336589] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-26T18:48:29.336704] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-26T18:48:29.561876] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-26T18:48:29.771807] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:30.279526] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-26T18:48:30.356724] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-26T18:48:30.952530] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T18:48:31.156757] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-26T18:48:31.273347] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T18:48:31.956744] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-26T18:48:32.756761] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-26T18:48:32.795877] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T18:48:32.796200] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T18:48:33.556714] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-26T18:48:33.947969] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T18:48:34.356732] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-26T18:48:35.077290] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T18:48:35.156741] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-26T18:48:35.330612] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T18:48:35.956750] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-26T18:48:36.100757] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T18:48:36.516756] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T18:48:36.756740] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-26T18:48:37.410773] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T18:48:37.556751] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-26T18:48:38.353694] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:48:38.356668] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-26T18:48:39.156765] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-26T18:48:39.186384] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T18:48:39.956730] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-26T18:48:40.476174] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:48:40.756729] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-26T18:48:41.502336] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T18:48:41.507711] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T18:48:41.556736] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-26T18:48:42.356695] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-26T18:48:42.586317] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T18:48:42.742347] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-26T18:48:43.156734] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-26T18:48:43.818907] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-26T18:48:43.956732] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-26T18:48:44.756759] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-26T18:48:45.015620] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-26T18:48:45.019502] [INFO ] [REMOTE ] FET: Full fetch complete (18305 records). [2025-09-26T18:48:45.019606] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-26T18:48:45.488376] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-26T18:48:45.488506] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-26T18:48:45.489103] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-26T18:48:45.489170] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-26T18:48:45.489960] [DEBUG] [LOCAL ] FET: Trimmed 18305 records to 12984 (keeping 200 days of data) [2025-09-26T18:48:45.557131] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-26T18:48:45.560288] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:48:45.589906] [DEBUG] [LOCAL ] FET: Primary data saved (12984 records). [2025-09-26T18:48:45.590078] [INFO ] [MAIN ] FET: Full history saved. [2025-09-26T18:48:45.590180] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FET took 21.1s. Estimated remaining: 3h 25m 14s. Rate: 7.6 symbols/min [2025-09-26T18:48:45.789428] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:45.814059] [DEBUG] [LOCAL ] FFC: Loaded 16760 existing records from primary storage. [2025-09-26T18:48:45.814230] [INFO ] [MAIN ] FFC: Loaded 16760 existing records. [2025-09-26T18:48:46.019806] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:46.020075] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-26T18:48:46.020125] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-26T18:48:46.020839] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-26T18:48:46.020915] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-26T18:48:46.364672] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-26T18:48:46.411837] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:47.156706] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-26T18:48:47.294179] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:48:47.333293] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:48:47.826077] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:48:47.956910] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-26T18:48:48.756731] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-26T18:48:49.394593] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:48:49.556738] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-26T18:48:50.238186] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:48:50.321514] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-26T18:48:50.356690] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-26T18:48:51.156727] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-26T18:48:51.509395] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T18:48:51.565595] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-26T18:48:51.956736] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-26T18:48:52.506041] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T18:48:52.756720] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-26T18:48:53.556712] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-26T18:48:53.887794] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T18:48:53.892319] [INFO ] [REMOTE ] FF: Full fetch complete (37010 records). [2025-09-26T18:48:53.892430] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-26T18:48:54.281747] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-26T18:48:54.281841] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-26T18:48:54.282469] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-26T18:48:54.282515] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-26T18:48:54.283539] [DEBUG] [LOCAL ] FF: Trimmed 37010 records to 25768 (keeping 200 days of data) [2025-09-26T18:48:54.371833] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-26T18:48:54.443936] [DEBUG] [LOCAL ] FF: Primary data saved (25768 records). [2025-09-26T18:48:54.444092] [INFO ] [MAIN ] FF: Full history saved. [2025-09-26T18:48:54.444212] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FF took 27.7s. Estimated remaining: 3h 25m 8s. Rate: 7.6 symbols/min [2025-09-26T18:48:54.621567] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:54.655987] [DEBUG] [LOCAL ] FFWM: Loaded 36348 existing records from primary storage. [2025-09-26T18:48:54.656133] [INFO ] [MAIN ] FFWM: Loaded 36348 existing records. [2025-09-26T18:48:54.845786] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:48:54.846062] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-26T18:48:54.846111] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-26T18:48:54.847362] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-26T18:48:54.847426] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-26T18:48:55.180909] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-26T18:48:55.238064] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:48:55.251227] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-26T18:48:55.301259] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T18:48:55.851023] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T18:48:55.956745] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-26T18:48:56.756758] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-26T18:48:57.360253] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T18:48:57.551737] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T18:48:57.561050] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-26T18:48:57.669055] [DEBUG] [REMOTE ] FFWM: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-26T18:48:57.669475] [WARN ] [REMOTE ] FFWM: No data returned for month 2024-12 [2025-09-26T18:48:58.356719] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-26T18:48:59.156727] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-26T18:48:59.198283] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T18:48:59.200053] [INFO ] [REMOTE ] FFA: Full fetch complete (8305 records). [2025-09-26T18:48:59.200124] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-26T18:48:59.587230] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-26T18:48:59.587319] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-26T18:48:59.587552] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-26T18:48:59.587596] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-26T18:48:59.588064] [DEBUG] [LOCAL ] FFA: Trimmed 8305 records to 5800 (keeping 200 days of data) [2025-09-26T18:48:59.624758] [DEBUG] [LOCAL ] FFA: Primary data saved (5800 records). [2025-09-26T18:48:59.624901] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-26T18:48:59.625000] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FFA took 30.7s. Estimated remaining: 3h 24m 55s. Rate: 7.6 symbols/min [2025-09-26T18:48:59.818447] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:48:59.841301] [DEBUG] [LOCAL ] FG: Loaded 22680 existing records from primary storage. [2025-09-26T18:48:59.841451] [INFO ] [MAIN ] FG: Loaded 22680 existing records. [2025-09-26T18:48:59.960335] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-26T18:49:00.053789] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:00.055315] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-26T18:49:00.055118] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T18:49:00.055559] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-26T18:49:00.060976] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-26T18:49:00.061048] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-26T18:49:00.436164] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:00.756746] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-26T18:49:01.556729] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-26T18:49:01.721848] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T18:49:01.895126] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T18:49:01.905615] [INFO ] [REMOTE ] FERG: Full fetch complete (71013 records). [2025-09-26T18:49:01.905844] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-26T18:49:02.239362] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-26T18:49:02.356208] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-26T18:49:02.356312] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-26T18:49:02.357277] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-26T18:49:02.357391] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-26T18:49:02.359085] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-26T18:49:02.360927] [DEBUG] [LOCAL ] FERG: Trimmed 71013 records to 49691 (keeping 200 days of data) [2025-09-26T18:49:02.723939] [DEBUG] [LOCAL ] FERG: Primary data saved (49691 records). [2025-09-26T18:49:02.724084] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-26T18:49:02.724197] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FERG took 38.7s. Estimated remaining: 3h 24m 38s. Rate: 7.6 symbols/min [2025-09-26T18:49:02.926506] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:02.935709] [DEBUG] [LOCAL ] FGN: Loaded 3905 existing records from primary storage. [2025-09-26T18:49:02.935920] [INFO ] [MAIN ] FGN: Loaded 3905 existing records. [2025-09-26T18:49:03.129460] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:03.129802] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-26T18:49:03.129874] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-26T18:49:03.130279] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-26T18:49:03.130339] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-26T18:49:03.161861] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-26T18:49:03.268090] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:49:03.539350] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:03.956723] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-26T18:49:04.315556] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T18:49:04.756789] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-26T18:49:04.973631] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T18:49:05.389481] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-26T18:49:05.556730] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-26T18:49:06.356700] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-26T18:49:06.658911] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T18:49:07.034137] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T18:49:07.156748] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-26T18:49:07.956708] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-26T18:49:08.230686] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T18:49:08.756743] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-26T18:49:09.261676] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T18:49:09.556751] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-26T18:49:10.124297] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T18:49:10.356771] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-26T18:49:10.956827] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:49:11.110515] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-26T18:49:11.156722] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-26T18:49:11.956779] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-26T18:49:12.738314] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T18:49:12.756682] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-26T18:49:12.789027] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T18:49:13.345506] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T18:49:13.556734] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-26T18:49:14.356728] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-26T18:49:14.932746] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:49:15.156709] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-26T18:49:15.249370] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:49:15.479045] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-26T18:49:15.956729] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-26T18:49:16.756738] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-26T18:49:17.353350] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-26T18:49:17.407472] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T18:49:17.556727] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-26T18:49:18.356690] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-26T18:49:18.730288] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T18:49:19.156780] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-26T18:49:19.956710] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-26T18:49:20.045960] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T18:49:20.162740] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T18:49:20.166715] [INFO ] [REMOTE ] FFC: Full fetch complete (24715 records). [2025-09-26T18:49:20.166800] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-26T18:49:20.380110] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-26T18:49:20.574620] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-26T18:49:20.574750] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-26T18:49:20.575318] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-26T18:49:20.575381] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-26T18:49:20.576360] [DEBUG] [LOCAL ] FFC: Trimmed 24715 records to 16899 (keeping 200 days of data) [2025-09-26T18:49:20.682178] [DEBUG] [LOCAL ] FFC: Primary data saved (16899 records). [2025-09-26T18:49:20.682336] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-26T18:49:20.682452] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FFC took 35.1s. Estimated remaining: 3h 24m 49s. Rate: 7.5 symbols/min [2025-09-26T18:49:20.761941] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-26T18:49:20.868436] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:20.868611] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-26T18:49:20.868680] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-26T18:49:20.868838] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-26T18:49:20.868885] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-26T18:49:20.868930] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-26T18:49:20.868966] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-26T18:49:21.252416] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:21.286752] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-26T18:49:21.556724] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-26T18:49:22.356751] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-26T18:49:22.586301] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T18:49:23.156758] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-26T18:49:23.481979] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:49:23.492313] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-26T18:49:23.494705] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T18:49:23.956780] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-26T18:49:24.576222] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T18:49:24.756797] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-26T18:49:25.556807] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-26T18:49:26.162155] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T18:49:26.180416] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T18:49:26.180775] [INFO ] [REMOTE ] FFWM: Full fetch complete (47955 records). [2025-09-26T18:49:26.184906] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-26T18:49:26.380498] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-26T18:49:26.401825] [WARN ] [VALIDATOR ] FFWM: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-26T18:49:26.402722] [FATAL] [MAIN ] FFWM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:49:26.402804] [WARN ] [MAIN ] FFWM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:49:26.402886] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-26T18:49:26.403007] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-09-26T18:49:26.403070] [INFO ] [LOCAL ] FFWM: Starting deletion of derivative data. [2025-09-26T18:49:26.403741] [DEBUG] [LOCAL ] FFWM: Deleted derivative data file. [2025-09-26T18:49:26.403899] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FFWM took 32.0s. Estimated remaining: 3h 24m 36s. Rate: 7.6 symbols/min [2025-09-26T18:49:26.592274] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:26.638995] [DEBUG] [LOCAL ] FHI: Loaded 40977 existing records from primary storage. [2025-09-26T18:49:26.639258] [INFO ] [MAIN ] FHI: Loaded 40977 existing records. [2025-09-26T18:49:26.835385] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:26.835781] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-26T18:49:26.835844] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-26T18:49:26.837445] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-26T18:49:26.837518] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-26T18:49:27.025130] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:49:27.161994] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-26T18:49:27.259831] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:27.808020] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T18:49:27.956784] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-26T18:49:28.648235] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-26T18:49:28.756759] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-26T18:49:29.396822] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T18:49:29.556722] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-26T18:49:30.356717] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-26T18:49:31.045284] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:49:31.064804] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-26T18:49:31.156785] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-26T18:49:31.956769] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-26T18:49:32.644532] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T18:49:32.756740] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-26T18:49:33.031265] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T18:49:33.073211] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-26T18:49:33.556724] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-26T18:49:34.356747] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-26T18:49:34.631224] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T18:49:34.830636] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-26T18:49:34.831801] [INFO ] [REMOTE ] FGN: Full fetch complete (5744 records). [2025-09-26T18:49:34.831900] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-26T18:49:35.165418] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-26T18:49:35.215968] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-26T18:49:35.216233] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-26T18:49:35.216432] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-26T18:49:35.216493] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-26T18:49:35.217037] [DEBUG] [LOCAL ] FGN: Trimmed 5744 records to 3915 (keeping 200 days of data) [2025-09-26T18:49:35.241909] [DEBUG] [LOCAL ] FGN: Primary data saved (3915 records). [2025-09-26T18:49:35.242032] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-26T18:49:35.242138] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FGN took 32.5s. Estimated remaining: 3h 24m 30s. Rate: 7.6 symbols/min [2025-09-26T18:49:35.423184] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:35.477416] [DEBUG] [LOCAL ] FHN: Loaded 53759 existing records from primary storage. [2025-09-26T18:49:35.477592] [INFO ] [MAIN ] FHN: Loaded 53759 existing records. [2025-09-26T18:49:35.661149] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:35.661443] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-26T18:49:35.661499] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-26T18:49:35.662996] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-26T18:49:35.663058] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-26T18:49:35.961852] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-26T18:49:36.036867] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:36.632757] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T18:49:36.637219] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T18:49:36.756742] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-26T18:49:37.556731] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-26T18:49:38.351604] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T18:49:38.365690] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-26T18:49:38.383709] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T18:49:38.964793] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T18:49:39.156756] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-26T18:49:39.956732] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-26T18:49:40.659232] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T18:49:40.756784] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-26T18:49:41.556715] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-26T18:49:41.616090] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T18:49:41.837702] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T18:49:41.842064] [INFO ] [REMOTE ] FG: Full fetch complete (27332 records). [2025-09-26T18:49:41.842172] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-26T18:49:42.163723] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T18:49:42.171341] [INFO ] [REMOTE ] FGSN: Full fetch complete (7583 records). [2025-09-26T18:49:42.187014] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-26T18:49:42.359281] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-26T18:49:42.359437] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-26T18:49:42.367274] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-26T18:49:42.372748] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-26T18:49:42.412984] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-26T18:49:42.459413] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-26T18:49:42.459859] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:49:42.460035] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:49:42.460123] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-26T18:49:42.460216] [DEBUG] [LOCAL ] FG: Trimmed 27332 records to 22819 (keeping 200 days of data) [2025-09-26T18:49:42.460749] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-26T18:49:42.460854] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-26T18:49:42.461133] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-26T18:49:42.461239] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FGSN took 21.8s. Estimated remaining: 3h 24m 21s. Rate: 7.6 symbols/min [2025-09-26T18:49:42.752395] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:42.817529] [DEBUG] [LOCAL ] FG: Primary data saved (22819 records). [2025-09-26T18:49:42.817721] [INFO ] [MAIN ] FG: Full history saved. [2025-09-26T18:49:42.817832] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FG took 43.2s. Estimated remaining: 3h 23m 59s. Rate: 7.6 symbols/min [2025-09-26T18:49:42.962142] [DEBUG] [LOCAL ] FI: Loaded 53894 existing records from primary storage. [2025-09-26T18:49:42.972685] [INFO ] [MAIN ] FI: Loaded 53894 existing records. [2025-09-26T18:49:43.139035] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:43.159932] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-26T18:49:43.228938] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:43.229254] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-26T18:49:43.229313] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-26T18:49:43.234743] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-26T18:49:43.234890] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-26T18:49:43.357446] [DEBUG] [LOCAL ] FICO: Loaded 20525 existing records from primary storage. [2025-09-26T18:49:43.401230] [INFO ] [MAIN ] FICO: Loaded 20525 existing records. [2025-09-26T18:49:43.786026] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:49:43.811363] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-26T18:49:43.811487] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-26T18:49:43.823044] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-26T18:49:43.833366] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-26T18:49:43.935877] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:43.985204] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-26T18:49:44.319445] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-26T18:49:44.365413] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:49:44.734509] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T18:49:44.756693] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-26T18:49:45.556701] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-26T18:49:45.626758] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T18:49:45.914971] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:49:46.356718] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-26T18:49:47.156728] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-26T18:49:47.287087] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T18:49:47.863498] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T18:49:47.956723] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-26T18:49:48.074390] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T18:49:48.756757] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-26T18:49:49.556693] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-26T18:49:49.838706] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T18:49:49.862723] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T18:49:50.356724] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-26T18:49:50.892684] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T18:49:51.156728] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-26T18:49:51.620504] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T18:49:51.956764] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-26T18:49:52.618153] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:49:52.642356] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T18:49:52.756742] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-26T18:49:53.556747] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-26T18:49:54.356753] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-26T18:49:54.638078] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T18:49:54.689129] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:49:55.156773] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-26T18:49:55.956746] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-26T18:49:56.231153] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T18:49:56.295135] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T18:49:56.756752] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-26T18:49:57.083525] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:49:57.556728] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-26T18:49:58.356722] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-26T18:49:58.768688] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T18:49:58.992589] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-26T18:49:59.000224] [INFO ] [REMOTE ] FHI: Full fetch complete (57862 records). [2025-09-26T18:49:59.000359] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-26T18:49:59.161825] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-26T18:49:59.424490] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-26T18:49:59.424575] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-26T18:49:59.425345] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-26T18:49:59.425415] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-26T18:49:59.426940] [DEBUG] [LOCAL ] FHI: Trimmed 57862 records to 41203 (keeping 200 days of data) [2025-09-26T18:49:59.692360] [DEBUG] [LOCAL ] FHI: Primary data saved (41203 records). [2025-09-26T18:49:59.692491] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-26T18:49:59.692592] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FHI took 33.3s. Estimated remaining: 3h 24m 7s. Rate: 7.5 symbols/min [2025-09-26T18:49:59.893084] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:49:59.893371] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-26T18:49:59.893475] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-26T18:49:59.894339] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-26T18:49:59.894427] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-26T18:49:59.895088] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-26T18:49:59.895178] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-26T18:49:59.969993] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-26T18:50:00.064881] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T18:50:00.329156] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:00.756739] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-26T18:50:00.982264] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T18:50:01.039907] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-26T18:50:01.556739] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-26T18:50:02.356736] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-26T18:50:02.516140] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T18:50:03.156780] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-26T18:50:03.206109] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:50:03.956743] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-26T18:50:04.271241] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-26T18:50:04.307534] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T18:50:04.587443] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T18:50:04.756726] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-26T18:50:05.005167] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-26T18:50:05.556715] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-26T18:50:06.356710] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-26T18:50:06.754817] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T18:50:07.156802] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-26T18:50:07.538593] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T18:50:07.956711] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-26T18:50:08.283220] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T18:50:08.316938] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T18:50:08.756786] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-26T18:50:09.130858] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-26T18:50:09.556726] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-26T18:50:10.356715] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-26T18:50:10.728332] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-26T18:50:11.156737] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-26T18:50:11.560693] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:50:11.561050] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-26T18:50:11.613338] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T18:50:11.956728] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-26T18:50:12.756773] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-26T18:50:13.556779] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-26T18:50:14.356697] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-26T18:50:14.743549] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T18:50:14.758181] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-26T18:50:14.774490] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T18:50:14.779160] [INFO ] [REMOTE ] FICO: Full fetch complete (28467 records). [2025-09-26T18:50:14.779283] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-26T18:50:15.165875] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-26T18:50:15.200608] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-26T18:50:15.200845] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-26T18:50:15.201449] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-26T18:50:15.201594] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-26T18:50:15.202741] [DEBUG] [LOCAL ] FICO: Trimmed 28467 records to 20674 (keeping 200 days of data) [2025-09-26T18:50:15.300756] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-26T18:50:15.347342] [INFO ] [REMOTE ] FHN: Full fetch complete (77282 records). [2025-09-26T18:50:15.352411] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-26T18:50:15.781076] [DEBUG] [LOCAL ] FICO: Primary data saved (20674 records). [2025-09-26T18:50:15.808191] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-26T18:50:15.811814] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FICO took 33.0s. Estimated remaining: 3h 24m 15s. Rate: 7.5 symbols/min [2025-09-26T18:50:15.831496] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-26T18:50:15.836993] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-26T18:50:15.854571] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-26T18:50:15.861163] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-26T18:50:15.961867] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-26T18:50:15.976264] [DEBUG] [LOCAL ] FHN: Trimmed 77282 records to 54148 (keeping 200 days of data) [2025-09-26T18:50:16.170473] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:16.360835] [DEBUG] [LOCAL ] FIGS: Loaded 49285 existing records from primary storage. [2025-09-26T18:50:16.365405] [INFO ] [MAIN ] FIGS: Loaded 49285 existing records. [2025-09-26T18:50:16.648271] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:16.651180] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-26T18:50:16.651861] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-26T18:50:16.654060] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-26T18:50:16.654568] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-26T18:50:16.858085] [DEBUG] [LOCAL ] FHN: Primary data saved (54148 records). [2025-09-26T18:50:16.859296] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-26T18:50:16.874838] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FHN took 41.6s. Estimated remaining: 3h 23m 54s. Rate: 7.5 symbols/min [2025-09-26T18:50:17.228690] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:17.263907] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:17.264674] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-26T18:50:17.310414] [DEBUG] [LOCAL ] FIHL: Loaded 40582 existing records from primary storage. [2025-09-26T18:50:17.310630] [INFO ] [MAIN ] FIHL: Loaded 40582 existing records. [2025-09-26T18:50:17.520421] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:17.520910] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-26T18:50:17.520984] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-26T18:50:17.522259] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-26T18:50:17.522323] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-26T18:50:17.828420] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-26T18:50:17.881177] [INFO ] [REMOTE ] FI: Full fetch complete (77170 records). [2025-09-26T18:50:17.896806] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-26T18:50:17.954858] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:17.955385] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-26T18:50:18.421686] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-26T18:50:18.421837] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-26T18:50:18.423233] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-26T18:50:18.423339] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-26T18:50:18.425782] [DEBUG] [LOCAL ] FI: Trimmed 77170 records to 54281 (keeping 200 days of data) [2025-09-26T18:50:18.581962] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-26T18:50:18.606036] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-26T18:50:18.754284] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T18:50:18.873666] [DEBUG] [LOCAL ] FI: Primary data saved (54281 records). [2025-09-26T18:50:18.873898] [INFO ] [MAIN ] FI: Full history saved. [2025-09-26T18:50:18.874062] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FI took 36.4s. Estimated remaining: 3h 23m 35s. Rate: 7.6 symbols/min [2025-09-26T18:50:19.070115] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:19.096170] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T18:50:19.109074] [DEBUG] [LOCAL ] FINS: Loaded 8280 existing records from primary storage. [2025-09-26T18:50:19.109226] [INFO ] [MAIN ] FINS: Loaded 8280 existing records. [2025-09-26T18:50:19.167051] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-26T18:50:19.307209] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:19.307480] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-26T18:50:19.307549] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-26T18:50:19.308006] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-26T18:50:19.308068] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-26T18:50:19.708752] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:19.956737] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-26T18:50:20.756763] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-26T18:50:20.884383] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T18:50:21.054345] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T18:50:21.096636] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-26T18:50:21.107484] [INFO ] [REMOTE ] FIG: Full fetch complete (16186 records). [2025-09-26T18:50:21.107633] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-26T18:50:21.300293] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-26T18:50:21.300622] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:50:21.300729] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:50:21.300806] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-26T18:50:21.300876] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-26T18:50:21.300913] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-26T18:50:21.300971] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-26T18:50:21.301058] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIG took 21.6s. Estimated remaining: 3h 23m 17s. Rate: 7.6 symbols/min [2025-09-26T18:50:21.483913] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:21.539526] [DEBUG] [LOCAL ] FINV: Loaded 45475 existing records from primary storage. [2025-09-26T18:50:21.539738] [INFO ] [MAIN ] FINV: Loaded 45475 existing records. [2025-09-26T18:50:21.561861] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-26T18:50:21.739950] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:21.740279] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-26T18:50:21.740332] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-26T18:50:21.741562] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-26T18:50:21.741626] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-26T18:50:22.145305] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:22.159757] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T18:50:22.356713] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-26T18:50:22.865018] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T18:50:23.156755] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-26T18:50:23.262133] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T18:50:23.614534] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T18:50:23.956779] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-26T18:50:24.756779] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-26T18:50:25.556712] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-26T18:50:25.620271] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T18:50:25.666094] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T18:50:26.356731] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-26T18:50:26.768503] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T18:50:27.156750] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-26T18:50:27.954087] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T18:50:27.963220] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-26T18:50:28.635775] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:50:28.756761] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-26T18:50:29.556921] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-26T18:50:29.592547] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:50:30.234516] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T18:50:30.234781] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T18:50:30.356716] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-26T18:50:31.156748] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-26T18:50:31.845475] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:50:31.956732] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-26T18:50:32.468017] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T18:50:32.756730] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-26T18:50:33.008975] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T18:50:33.556729] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-26T18:50:33.913597] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T18:50:34.356758] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-26T18:50:34.884232] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T18:50:35.156757] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-26T18:50:35.958049] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T18:50:35.958188] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-26T18:50:36.644338] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T18:50:36.756785] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-26T18:50:36.943907] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:50:37.556719] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-26T18:50:38.278485] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:50:38.288314] [INFO ] [REMOTE ] FIGS: Full fetch complete (71094 records). [2025-09-26T18:50:38.288486] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-26T18:50:38.365756] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-26T18:50:38.743918] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-26T18:50:38.744174] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-26T18:50:38.745464] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-26T18:50:38.745586] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-26T18:50:38.762078] [DEBUG] [LOCAL ] FIGS: Trimmed 71094 records to 49651 (keeping 200 days of data) [2025-09-26T18:50:38.774097] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T18:50:38.890457] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-26T18:50:39.095378] [DEBUG] [LOCAL ] FIGS: Primary data saved (49651 records). [2025-09-26T18:50:39.095547] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-26T18:50:39.095681] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FIGS took 23.3s. Estimated remaining: 3h 23m 27s. Rate: 7.5 symbols/min [2025-09-26T18:50:39.156776] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-26T18:50:39.290154] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:39.343765] [DEBUG] [LOCAL ] FIS: Loaded 53754 existing records from primary storage. [2025-09-26T18:50:39.344003] [INFO ] [MAIN ] FIS: Loaded 53754 existing records. [2025-09-26T18:50:39.534545] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:39.534840] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-26T18:50:39.534891] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-26T18:50:39.536486] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-26T18:50:39.536548] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-26T18:50:39.945094] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:39.956495] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:50:39.956862] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-26T18:50:40.756731] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-26T18:50:41.438516] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T18:50:41.556727] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-26T18:50:42.183431] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:50:42.356764] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-26T18:50:43.156747] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-26T18:50:43.313377] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T18:50:43.956702] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-26T18:50:44.150761] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T18:50:44.454863] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T18:50:44.756745] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-26T18:50:45.556737] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-26T18:50:45.698155] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T18:50:46.346119] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T18:50:46.356691] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-26T18:50:46.895197] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T18:50:47.092067] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T18:50:47.156697] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-26T18:50:47.902580] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-26T18:50:47.956735] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-26T18:50:48.756789] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-26T18:50:49.556716] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-26T18:50:49.844471] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T18:50:49.854109] [INFO ] [REMOTE ] FINV: Full fetch complete (63558 records). [2025-09-26T18:50:49.854271] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-26T18:50:50.012854] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T18:50:50.324380] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T18:50:50.356699] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-26T18:50:50.357671] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-26T18:50:50.358810] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-26T18:50:50.359915] [INFO ] [REMOTE ] FIHL: Full fetch complete (55868 records). [2025-09-26T18:50:50.360145] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-26T18:50:50.359748] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-26T18:50:50.360825] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-26T18:50:50.479010] [DEBUG] [LOCAL ] FINV: Trimmed 63558 records to 45772 (keeping 200 days of data) [2025-09-26T18:50:50.910742] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-26T18:50:50.912254] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-26T18:50:50.917184] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-26T18:50:50.917292] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-26T18:50:50.999912] [DEBUG] [LOCAL ] FIHL: Trimmed 55868 records to 40851 (keeping 200 days of data) [2025-09-26T18:50:51.145454] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T18:50:51.161628] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-26T18:50:51.176244] [INFO ] [REMOTE ] FINS: Full fetch complete (12488 records). [2025-09-26T18:50:51.179493] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-26T18:50:51.327252] [DEBUG] [LOCAL ] FINV: Primary data saved (45772 records). [2025-09-26T18:50:51.338507] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-26T18:50:51.339241] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINV took 30.0s. Estimated remaining: 3h 23m 27s. Rate: 7.5 symbols/min [2025-09-26T18:50:51.821562] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:50:51.926412] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-26T18:50:51.927180] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-26T18:50:51.927683] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-26T18:50:51.927958] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-26T18:50:52.018211] [DEBUG] [LOCAL ] FINS: Trimmed 12488 records to 8309 (keeping 200 days of data) [2025-09-26T18:50:52.109077] [DEBUG] [LOCAL ] FIX: Loaded 30594 existing records from primary storage. [2025-09-26T18:50:52.116013] [INFO ] [MAIN ] FIX: Loaded 30594 existing records. [2025-09-26T18:50:52.183882] [DEBUG] [LOCAL ] FIHL: Primary data saved (40851 records). [2025-09-26T18:50:52.189903] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-26T18:50:52.208773] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIHL took 35.3s. Estimated remaining: 3h 23m 6s. Rate: 7.6 symbols/min [2025-09-26T18:50:52.254745] [DEBUG] [LOCAL ] FINS: Primary data saved (8309 records). [2025-09-26T18:50:52.254956] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-26T18:50:52.255109] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FINS took 33.4s. Estimated remaining: 3h 22m 44s. Rate: 7.6 symbols/min [2025-09-26T18:50:52.355055] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:50:52.355339] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-26T18:50:52.355390] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-26T18:50:52.356393] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-26T18:50:52.356457] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-26T18:50:52.792714] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:50:52.793074] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-26T18:50:53.098983] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:50:53.109723] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-26T18:50:54.206411] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T18:50:54.212287] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-26T18:50:54.872041] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T18:50:54.884804] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-26T18:50:55.424250] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T18:50:55.433096] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-26T18:50:56.496122] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T18:50:56.508975] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-26T18:50:56.594423] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T18:50:56.756867] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-26T18:50:58.276294] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T18:50:58.288731] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-26T18:50:58.424187] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T18:50:58.433270] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-26T18:50:59.718827] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T18:50:59.730575] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-26T18:50:59.864233] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T18:50:59.956775] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-26T18:51:01.652814] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T18:51:01.654735] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T18:51:01.673965] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-26T18:51:01.675335] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-26T18:51:02.964937] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T18:51:02.971440] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-26T18:51:03.521280] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T18:51:03.536703] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-26T18:51:04.074530] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:51:04.081543] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-26T18:51:05.145519] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:51:05.154787] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-26T18:51:05.247061] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:51:05.258012] [INFO ] [REMOTE ] FIS: Full fetch complete (77176 records). [2025-09-26T18:51:05.258174] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-26T18:51:05.695224] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-26T18:51:05.695310] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-26T18:51:05.696299] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-26T18:51:05.696368] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-26T18:51:05.698033] [DEBUG] [LOCAL ] FIS: Trimmed 77176 records to 54144 (keeping 200 days of data) [2025-09-26T18:51:06.049594] [DEBUG] [LOCAL ] FIS: Primary data saved (54144 records). [2025-09-26T18:51:06.049783] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-26T18:51:06.049964] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIS took 27.0s. Estimated remaining: 3h 22m 46s. Rate: 7.6 symbols/min [2025-09-26T18:51:06.284824] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T18:51:06.291532] [INFO ] [REMOTE ] FIX: Full fetch complete (45688 records). [2025-09-26T18:51:06.291668] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-26T18:51:06.939054] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-26T18:51:06.939183] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-26T18:51:06.940027] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-26T18:51:06.940096] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-26T18:51:06.941216] [DEBUG] [LOCAL ] FIX: Trimmed 45688 records to 30763 (keeping 200 days of data) [2025-09-26T18:51:07.162254] [DEBUG] [LOCAL ] FIX: Primary data saved (30763 records). [2025-09-26T18:51:07.162394] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-26T18:51:07.162482] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FIX took 15.8s. Estimated remaining: 3h 22m 26s. Rate: 7.6 symbols/min [2025-09-26T18:51:07.944677] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:07.994158] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:08.062158] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:08.059940] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:08.062555] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-26T18:51:08.063172] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-26T18:51:08.063948] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-26T18:51:08.064056] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-26T18:51:08.064354] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-26T18:51:08.064573] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-26T18:51:08.151475] [DEBUG] [LOCAL ] FLC: Loaded 5533 existing records from primary storage. [2025-09-26T18:51:08.168194] [INFO ] [MAIN ] FLC: Loaded 5533 existing records. [2025-09-26T18:51:08.533209] [DEBUG] [LOCAL ] FLNG: Loaded 34205 existing records from primary storage. [2025-09-26T18:51:08.610030] [INFO ] [MAIN ] FLNG: Loaded 34205 existing records. [2025-09-26T18:51:08.682875] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:08.694180] [DEBUG] [LOCAL ] FLG: Loaded 53717 existing records from primary storage. [2025-09-26T18:51:08.720626] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-26T18:51:08.772350] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-26T18:51:08.791371] [INFO ] [MAIN ] FLG: Loaded 53717 existing records. [2025-09-26T18:51:08.852588] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:08.858231] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-26T18:51:08.840708] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-26T18:51:08.874162] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-26T18:51:09.185962] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:09.236682] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-26T18:51:09.273170] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-26T18:51:09.300134] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:09.418469] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-26T18:51:09.482783] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:09.461252] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-26T18:51:09.527473] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-26T18:51:09.541240] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-26T18:51:09.521270] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-26T18:51:09.554294] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-26T18:51:09.561063] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:09.587268] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-26T18:51:09.635392] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-26T18:51:09.635842] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-26T18:51:09.690180] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-26T18:51:09.796621] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:09.827814] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-26T18:51:09.970936] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:10.047533] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-26T18:51:10.160522] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-26T18:51:10.459727] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:10.483808] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-26T18:51:10.506831] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:10.508488] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-26T18:51:10.561268] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T18:51:10.561019] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:10.563840] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-26T18:51:11.156775] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-26T18:51:11.363273] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:11.363631] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-26T18:51:11.956771] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-26T18:51:12.100297] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T18:51:12.547702] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:12.548050] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-26T18:51:12.585013] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-26T18:51:12.756751] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-26T18:51:13.556738] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-26T18:51:14.000877] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T18:51:14.356742] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-26T18:51:14.740234] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-26T18:51:15.033285] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T18:51:15.156783] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-26T18:51:15.824188] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T18:51:15.956790] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-26T18:51:16.756737] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-26T18:51:17.377556] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:51:17.528151] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:51:17.556760] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-26T18:51:18.171610] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T18:51:18.356777] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-26T18:51:18.917261] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T18:51:19.156735] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-26T18:51:19.598387] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T18:51:19.956757] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-26T18:51:20.659886] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T18:51:20.756786] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-26T18:51:21.300769] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-26T18:51:21.301942] [INFO ] [REMOTE ] FIXT: Full fetch complete (1753 records). [2025-09-26T18:51:21.302015] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-26T18:51:21.496669] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-26T18:51:21.496907] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:51:21.497003] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:51:21.497126] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-26T18:51:21.497242] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-26T18:51:21.497299] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-26T18:51:21.497366] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-26T18:51:21.497469] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FIXT took 14.3s. Estimated remaining: 3h 22m 30s. Rate: 7.6 symbols/min [2025-09-26T18:51:21.563441] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-26T18:51:21.717095] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:21.778286] [DEBUG] [LOCAL ] FLO: Loaded 52270 existing records from primary storage. [2025-09-26T18:51:21.778488] [INFO ] [MAIN ] FLO: Loaded 52270 existing records. [2025-09-26T18:51:21.973336] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:21.973683] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-26T18:51:21.973744] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-26T18:51:21.975248] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-26T18:51:21.975321] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-26T18:51:22.374863] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-26T18:51:22.382015] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:22.970617] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T18:51:23.156779] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-26T18:51:23.279461] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T18:51:23.956738] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-26T18:51:24.200476] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T18:51:24.756736] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-26T18:51:25.186046] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T18:51:25.556731] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-26T18:51:25.846303] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T18:51:26.356781] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-26T18:51:27.049275] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:51:27.156743] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-26T18:51:27.651702] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T18:51:27.956764] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-26T18:51:28.527808] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T18:51:28.756699] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-26T18:51:28.852667] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T18:51:29.187300] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T18:51:29.556728] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-26T18:51:30.356727] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-26T18:51:31.156731] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-26T18:51:31.396307] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T18:51:31.793986] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:51:31.794268] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T18:51:31.956755] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-26T18:51:32.756786] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-26T18:51:33.486123] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T18:51:33.488500] [INFO ] [REMOTE ] FLC: Full fetch complete (8019 records). [2025-09-26T18:51:33.488608] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-26T18:51:33.561874] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-26T18:51:33.900932] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-26T18:51:33.901045] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-26T18:51:33.901332] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-26T18:51:33.901486] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-26T18:51:33.902293] [DEBUG] [LOCAL ] FLC: Trimmed 8019 records to 5559 (keeping 200 days of data) [2025-09-26T18:51:33.973015] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T18:51:33.993844] [DEBUG] [LOCAL ] FLC: Primary data saved (5559 records). [2025-09-26T18:51:33.994418] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-26T18:51:33.994539] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLC took 26.8s. Estimated remaining: 3h 22m 30s. Rate: 7.6 symbols/min [2025-09-26T18:51:34.182297] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:34.182579] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-26T18:51:34.182638] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-26T18:51:34.182824] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-26T18:51:34.182914] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-26T18:51:34.182969] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-26T18:51:34.183005] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-26T18:51:34.358461] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-26T18:51:34.582580] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:35.149548] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T18:51:35.157449] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-26T18:51:35.955329] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T18:51:35.966172] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-26T18:51:36.317769] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T18:51:36.756724] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-26T18:51:37.030795] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:51:37.556719] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-26T18:51:38.356713] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-26T18:51:38.815070] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-26T18:51:39.080128] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T18:51:39.088491] [INFO ] [REMOTE ] FLNG: Full fetch complete (50779 records). [2025-09-26T18:51:39.088680] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-26T18:51:39.161837] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-26T18:51:39.425613] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T18:51:39.462246] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-26T18:51:39.511216] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-26T18:51:39.511301] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-26T18:51:39.512082] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-26T18:51:39.512150] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-26T18:51:39.513473] [DEBUG] [LOCAL ] FLNG: Trimmed 50779 records to 34431 (keeping 200 days of data) [2025-09-26T18:51:39.732083] [DEBUG] [LOCAL ] FLNG: Primary data saved (34431 records). [2025-09-26T18:51:39.732243] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-26T18:51:39.732352] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLNG took 32.6s. Estimated remaining: 3h 22m 18s. Rate: 7.6 symbols/min [2025-09-26T18:51:39.924032] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:39.963234] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-26T18:51:39.970107] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T18:51:40.020211] [DEBUG] [LOCAL ] FLR: Loaded 53507 existing records from primary storage. [2025-09-26T18:51:40.020373] [INFO ] [MAIN ] FLR: Loaded 53507 existing records. [2025-09-26T18:51:40.204514] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:40.204845] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-26T18:51:40.204902] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-26T18:51:40.207243] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-26T18:51:40.207316] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-26T18:51:40.576964] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:40.756776] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-26T18:51:41.556707] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-26T18:51:41.696827] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T18:51:42.261268] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:51:42.356703] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-26T18:51:42.628276] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T18:51:43.156726] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-26T18:51:43.964613] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-26T18:51:43.971430] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T18:51:44.427996] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T18:51:44.756731] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-26T18:51:45.556741] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-26T18:51:46.100211] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T18:51:46.111148] [INFO ] [REMOTE ] FLG: Full fetch complete (77295 records). [2025-09-26T18:51:46.111340] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-26T18:51:46.381736] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-26T18:51:46.491800] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:51:46.597703] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-26T18:51:46.597818] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-26T18:51:46.598809] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-26T18:51:46.598949] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-26T18:51:46.600890] [DEBUG] [LOCAL ] FLG: Trimmed 77295 records to 54105 (keeping 200 days of data) [2025-09-26T18:51:46.883994] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T18:51:46.988267] [DEBUG] [LOCAL ] FLG: Primary data saved (54105 records). [2025-09-26T18:51:46.988419] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-26T18:51:46.988515] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLG took 39.8s. Estimated remaining: 3h 22m 9s. Rate: 7.6 symbols/min [2025-09-26T18:51:47.169879] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:47.166058] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-26T18:51:47.220430] [DEBUG] [LOCAL ] FLS: Loaded 50555 existing records from primary storage. [2025-09-26T18:51:47.220605] [INFO ] [MAIN ] FLS: Loaded 50555 existing records. [2025-09-26T18:51:47.409985] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:47.410254] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-26T18:51:47.410303] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-26T18:51:47.411856] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-26T18:51:47.411933] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-26T18:51:47.856392] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:47.956692] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-26T18:51:48.115427] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T18:51:48.430873] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T18:51:48.756768] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-26T18:51:49.556709] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-26T18:51:49.643092] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T18:51:50.356694] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-26T18:51:50.387986] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T18:51:51.048503] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:51:51.156785] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-26T18:51:51.956728] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-26T18:51:52.077022] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T18:51:52.134125] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:51:52.756747] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-26T18:51:53.193666] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:51:53.556733] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-26T18:51:54.152525] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:51:54.356726] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-26T18:51:54.693764] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T18:51:55.156747] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-26T18:51:55.956708] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-26T18:51:56.098007] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T18:51:56.757732] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-26T18:51:56.761078] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T18:51:57.284326] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T18:51:57.556739] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-26T18:51:58.356733] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-26T18:51:58.587851] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T18:51:58.641724] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T18:51:58.648892] [INFO ] [REMOTE ] FLOC: Full fetch complete (37544 records). [2025-09-26T18:51:58.648990] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-26T18:51:58.847747] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 175 unique days, need 200 days [2025-09-26T18:51:58.848230] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:51:58.848303] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:51:58.848376] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-26T18:51:58.848469] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-26T18:51:58.848528] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-26T18:51:58.848574] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-26T18:51:58.848662] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLOC took 24.9s. Estimated remaining: 3h 22m 8s. Rate: 7.5 symbols/min [2025-09-26T18:51:59.029760] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:51:59.082622] [DEBUG] [LOCAL ] FLUT: Loaded 51237 existing records from primary storage. [2025-09-26T18:51:59.082812] [INFO ] [MAIN ] FLUT: Loaded 51237 existing records. [2025-09-26T18:51:59.161783] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-26T18:51:59.267802] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:51:59.268044] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-26T18:51:59.268092] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-26T18:51:59.270224] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-26T18:51:59.270286] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-26T18:51:59.639913] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:51:59.672264] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:51:59.956722] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-26T18:52:00.676567] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T18:52:00.756725] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-26T18:52:01.286940] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T18:52:01.556743] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-26T18:52:02.322370] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:52:02.356682] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-26T18:52:03.165701] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-26T18:52:03.184808] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T18:52:03.956709] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-26T18:52:04.277492] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-26T18:52:04.722484] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T18:52:04.733339] [INFO ] [REMOTE ] FLO: Full fetch complete (74931 records). [2025-09-26T18:52:04.733515] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-26T18:52:04.768822] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-26T18:52:05.173081] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-26T18:52:05.173250] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-26T18:52:05.176540] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-26T18:52:05.176687] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-26T18:52:05.189776] [DEBUG] [LOCAL ] FLO: Trimmed 74931 records to 52656 (keeping 200 days of data) [2025-09-26T18:52:05.561335] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-26T18:52:05.588638] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:52:05.617714] [DEBUG] [LOCAL ] FLO: Primary data saved (52656 records). [2025-09-26T18:52:05.617924] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-26T18:52:05.618167] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLO took 44.1s. Estimated remaining: 3h 21m 58s. Rate: 7.6 symbols/min [2025-09-26T18:52:05.828127] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:05.851662] [DEBUG] [LOCAL ] FLXR: Loaded 20150 existing records from primary storage. [2025-09-26T18:52:05.851829] [INFO ] [MAIN ] FLXR: Loaded 20150 existing records. [2025-09-26T18:52:06.038445] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:06.038799] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-26T18:52:06.038856] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-26T18:52:06.040033] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-26T18:52:06.040112] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-26T18:52:06.357229] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-26T18:52:06.427440] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:06.545807] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T18:52:07.156741] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-26T18:52:07.274895] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:52:07.287832] [INFO ] [REMOTE ] FLR: Full fetch complete (76348 records). [2025-09-26T18:52:07.288029] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-26T18:52:07.718048] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-26T18:52:07.718571] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-26T18:52:07.719782] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-26T18:52:07.719906] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-26T18:52:07.722436] [DEBUG] [LOCAL ] FLR: Trimmed 76348 records to 53892 (keeping 200 days of data) [2025-09-26T18:52:07.850854] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T18:52:07.979239] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-26T18:52:08.104235] [DEBUG] [LOCAL ] FLR: Primary data saved (53892 records). [2025-09-26T18:52:08.104393] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-26T18:52:08.104485] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLR took 28.4s. Estimated remaining: 3h 21m 40s. Rate: 7.6 symbols/min [2025-09-26T18:52:08.294669] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:08.355108] [DEBUG] [LOCAL ] FMC: Loaded 52176 existing records from primary storage. [2025-09-26T18:52:08.355379] [INFO ] [MAIN ] FMC: Loaded 52176 existing records. [2025-09-26T18:52:08.573339] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T18:52:08.578082] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:08.583146] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-26T18:52:08.583295] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-26T18:52:08.585200] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-26T18:52:08.585280] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-26T18:52:08.757303] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-26T18:52:09.032871] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:09.066317] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T18:52:09.556794] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-26T18:52:09.592789] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T18:52:10.356760] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-26T18:52:11.128898] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T18:52:11.149818] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T18:52:11.156671] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-26T18:52:11.956725] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-26T18:52:12.163563] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T18:52:12.756758] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-26T18:52:13.556716] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-26T18:52:13.753064] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T18:52:14.357208] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-26T18:52:14.357093] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T18:52:14.394188] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-26T18:52:15.156737] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-26T18:52:15.956729] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-26T18:52:16.174841] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T18:52:16.221712] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T18:52:16.756727] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-26T18:52:17.403855] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T18:52:17.556738] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-26T18:52:17.942188] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:52:18.356779] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-26T18:52:19.156749] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-26T18:52:19.334078] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T18:52:19.669395] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-26T18:52:19.956748] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-26T18:52:20.432944] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T18:52:20.756725] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-26T18:52:21.374965] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:52:21.431426] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-26T18:52:21.556727] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-26T18:52:22.356749] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-26T18:52:22.642906] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T18:52:23.156776] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-26T18:52:23.957172] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-26T18:52:23.957030] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:52:24.229336] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T18:52:24.235447] [INFO ] [REMOTE ] FLXR: Full fetch complete (25149 records). [2025-09-26T18:52:24.235604] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-26T18:52:24.642196] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-26T18:52:24.642302] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-26T18:52:24.642856] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-26T18:52:24.642920] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-26T18:52:24.643852] [DEBUG] [LOCAL ] FLXR: Trimmed 25149 records to 20315 (keeping 200 days of data) [2025-09-26T18:52:24.756836] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-26T18:52:24.787982] [DEBUG] [LOCAL ] FLXR: Primary data saved (20315 records). [2025-09-26T18:52:24.788114] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-26T18:52:24.788237] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLXR took 19.2s. Estimated remaining: 3h 21m 48s. Rate: 7.5 symbols/min [2025-09-26T18:52:24.973697] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:24.981926] [DEBUG] [LOCAL ] FMN: Loaded 6073 existing records from primary storage. [2025-09-26T18:52:24.982057] [INFO ] [MAIN ] FMN: Loaded 6073 existing records. [2025-09-26T18:52:25.181608] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:25.181936] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-26T18:52:25.182011] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-26T18:52:25.182446] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-26T18:52:25.182506] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-26T18:52:25.566986] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-26T18:52:25.570192] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:25.610145] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:52:26.204919] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:52:26.356735] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-26T18:52:26.761502] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-26T18:52:27.156721] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-26T18:52:27.243133] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T18:52:27.956760] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-26T18:52:28.756745] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-26T18:52:28.999765] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T18:52:29.288918] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T18:52:29.556698] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-26T18:52:29.835004] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T18:52:29.845118] [INFO ] [REMOTE ] FLUT: Full fetch complete (72803 records). [2025-09-26T18:52:29.845265] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-26T18:52:30.277341] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-26T18:52:30.277458] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-26T18:52:30.278382] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-26T18:52:30.278451] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-26T18:52:30.280727] [DEBUG] [LOCAL ] FLUT: Trimmed 72803 records to 51580 (keeping 200 days of data) [2025-09-26T18:52:30.383591] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-26T18:52:30.616752] [DEBUG] [LOCAL ] FLUT: Primary data saved (51580 records). [2025-09-26T18:52:30.616899] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-26T18:52:30.617002] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FLUT took 31.8s. Estimated remaining: 3h 21m 36s. Rate: 7.5 symbols/min [2025-09-26T18:52:30.805669] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:30.842239] [DEBUG] [LOCAL ] FMS: Loaded 30619 existing records from primary storage. [2025-09-26T18:52:30.842384] [INFO ] [MAIN ] FMS: Loaded 30619 existing records. [2025-09-26T18:52:31.034379] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:31.034637] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-26T18:52:31.034720] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-26T18:52:31.035797] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-26T18:52:31.035859] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-26T18:52:31.158363] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-26T18:52:31.423493] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:31.456030] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T18:52:31.956769] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-26T18:52:32.216225] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T18:52:32.238630] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T18:52:32.756740] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-26T18:52:32.812407] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T18:52:33.556731] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-26T18:52:34.356701] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-26T18:52:34.407953] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T18:52:34.469469] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:52:35.156768] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-26T18:52:35.968186] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-26T18:52:35.975106] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T18:52:35.986194] [INFO ] [REMOTE ] FLS: Full fetch complete (71442 records). [2025-09-26T18:52:35.986420] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-26T18:52:36.421766] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-26T18:52:36.421901] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-26T18:52:36.422880] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-26T18:52:36.422992] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-26T18:52:36.424613] [DEBUG] [LOCAL ] FLS: Trimmed 71442 records to 50934 (keeping 200 days of data) [2025-09-26T18:52:36.677546] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T18:52:36.729043] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:52:36.756837] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-26T18:52:36.857398] [DEBUG] [LOCAL ] FLS: Primary data saved (50934 records). [2025-09-26T18:52:36.857614] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-26T18:52:36.857804] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FLS took 49.9s. Estimated remaining: 3h 21m 25s. Rate: 7.6 symbols/min [2025-09-26T18:52:37.054674] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:37.106250] [DEBUG] [LOCAL ] FMX: Loaded 41039 existing records from primary storage. [2025-09-26T18:52:37.106459] [INFO ] [MAIN ] FMX: Loaded 41039 existing records. [2025-09-26T18:52:37.290362] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:37.290699] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-26T18:52:37.290790] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-26T18:52:37.292359] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-26T18:52:37.292423] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-26T18:52:37.561928] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-26T18:52:37.682154] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:37.948240] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T18:52:38.108867] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:52:38.356727] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-26T18:52:39.156724] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-26T18:52:39.600837] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T18:52:39.890457] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T18:52:39.956706] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-26T18:52:40.756723] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-26T18:52:41.422180] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T18:52:41.556723] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-26T18:52:41.827877] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T18:52:41.922579] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-26T18:52:42.356730] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-26T18:52:42.985178] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T18:52:43.156712] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-26T18:52:43.956747] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-26T18:52:44.542097] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T18:52:44.756738] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-26T18:52:44.868366] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T18:52:45.283541] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-26T18:52:45.285265] [INFO ] [REMOTE ] FMN: Full fetch complete (10082 records). [2025-09-26T18:52:45.285381] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-26T18:52:45.561894] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-26T18:52:45.683337] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-26T18:52:45.683417] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-26T18:52:45.683688] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-26T18:52:45.683748] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-26T18:52:45.684201] [DEBUG] [LOCAL ] FMN: Trimmed 10082 records to 6097 (keeping 200 days of data) [2025-09-26T18:52:45.723887] [DEBUG] [LOCAL ] FMN: Primary data saved (6097 records). [2025-09-26T18:52:45.724026] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-26T18:52:45.724120] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMN took 20.9s. Estimated remaining: 3h 21m 19s. Rate: 7.6 symbols/min [2025-09-26T18:52:45.904681] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:45.908037] [DEBUG] [LOCAL ] FMY: Loaded 1394 existing records from primary storage. [2025-09-26T18:52:45.908117] [INFO ] [MAIN ] FMY: Loaded 1394 existing records. [2025-09-26T18:52:46.102986] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:46.103359] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-26T18:52:46.103427] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-26T18:52:46.103713] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-26T18:52:46.103785] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-26T18:52:46.361881] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-26T18:52:46.478292] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:47.104252] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T18:52:47.156690] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-26T18:52:47.863315] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T18:52:47.956732] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-26T18:52:48.663077] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:52:48.756712] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-26T18:52:49.063694] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:52:49.556702] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-26T18:52:49.641939] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T18:52:49.838005] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-26T18:52:50.356739] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-26T18:52:51.156722] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-26T18:52:51.549069] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-26T18:52:51.575483] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T18:52:51.956786] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-26T18:52:52.756725] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-26T18:52:53.556784] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-26T18:52:53.659375] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:52:53.670436] [INFO ] [REMOTE ] FMC: Full fetch complete (75002 records). [2025-09-26T18:52:53.670618] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-26T18:52:54.147868] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-26T18:52:54.148040] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-26T18:52:54.149142] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-26T18:52:54.149259] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-26T18:52:54.151276] [DEBUG] [LOCAL ] FMC: Trimmed 75002 records to 52560 (keeping 200 days of data) [2025-09-26T18:52:54.266533] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T18:52:54.365589] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-26T18:52:54.443841] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T18:52:54.549417] [DEBUG] [LOCAL ] FMC: Primary data saved (52560 records). [2025-09-26T18:52:54.549630] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-26T18:52:54.549871] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMC took 46.4s. Estimated remaining: 3h 21m 13s. Rate: 7.5 symbols/min [2025-09-26T18:52:54.739663] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:54.781411] [DEBUG] [LOCAL ] FN: Loaded 39626 existing records from primary storage. [2025-09-26T18:52:54.781561] [INFO ] [MAIN ] FN: Loaded 39626 existing records. [2025-09-26T18:52:54.871091] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T18:52:54.993204] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:52:54.993477] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-26T18:52:54.993528] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-26T18:52:54.995028] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-26T18:52:54.995092] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-26T18:52:55.156789] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-26T18:52:55.366529] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:55.956744] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-26T18:52:56.472785] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T18:52:56.479589] [INFO ] [REMOTE ] FMS: Full fetch complete (42330 records). [2025-09-26T18:52:56.479721] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-26T18:52:56.760693] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-26T18:52:56.992607] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-26T18:52:56.992850] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-26T18:52:56.994004] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-26T18:52:56.994106] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-26T18:52:56.995701] [DEBUG] [LOCAL ] FMS: Trimmed 42330 records to 30771 (keeping 200 days of data) [2025-09-26T18:52:57.119623] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T18:52:57.226472] [DEBUG] [LOCAL ] FMS: Primary data saved (30771 records). [2025-09-26T18:52:57.226669] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-26T18:52:57.226809] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMS took 26.6s. Estimated remaining: 3h 20m 55s. Rate: 7.6 symbols/min [2025-09-26T18:52:57.411376] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:52:57.411573] [DEBUG] [LOCAL ] FNB: No existing data file found in primary storage. [2025-09-26T18:52:57.411612] [WARN ] [MAIN ] FNB: No existing data found, performing full refresh instead. [2025-09-26T18:52:57.411826] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-26T18:52:57.411870] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-26T18:52:57.411961] [DEBUG] [LOCAL ] FNB: No primary data file found to delete. [2025-09-26T18:52:57.412011] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-26T18:52:57.561839] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-26T18:52:57.805997] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:52:57.829056] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T18:52:57.919574] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T18:52:58.356760] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-26T18:52:58.810947] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T18:52:59.156732] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-26T18:52:59.455678] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-26T18:52:59.956800] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-26T18:53:00.756744] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-26T18:53:01.438194] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T18:53:01.465743] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T18:53:01.556788] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-26T18:53:02.356771] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-26T18:53:03.055516] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T18:53:03.093357] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T18:53:03.156769] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-26T18:53:03.956759] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-26T18:53:04.709006] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T18:53:04.756722] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-26T18:53:05.270477] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T18:53:05.556720] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-26T18:53:06.135521] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T18:53:06.356762] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-26T18:53:07.156757] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-26T18:53:07.396569] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T18:53:07.406071] [INFO ] [REMOTE ] FMX: Full fetch complete (57624 records). [2025-09-26T18:53:07.406235] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-26T18:53:07.700034] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T18:53:07.839767] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-26T18:53:07.839927] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-26T18:53:07.840886] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-26T18:53:07.840994] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-26T18:53:07.842479] [DEBUG] [LOCAL ] FMX: Trimmed 57624 records to 41276 (keeping 200 days of data) [2025-09-26T18:53:07.956706] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-26T18:53:08.000783] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T18:53:08.158367] [DEBUG] [LOCAL ] FMX: Primary data saved (41276 records). [2025-09-26T18:53:08.158506] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-26T18:53:08.158615] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FMX took 31.3s. Estimated remaining: 3h 20m 53s. Rate: 7.6 symbols/min [2025-09-26T18:53:08.348178] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:08.400626] [DEBUG] [LOCAL ] FND: Loaded 52511 existing records from primary storage. [2025-09-26T18:53:08.400885] [INFO ] [MAIN ] FND: Loaded 52511 existing records. [2025-09-26T18:53:08.598526] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T18:53:08.619795] [INFO ] [REMOTE ] FMY: Full fetch complete (1962 records). [2025-09-26T18:53:08.620444] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-26T18:53:08.620155] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:08.621103] [FATAL] [VALIDATOR ] FMY: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:53:08.621458] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-26T18:53:08.621727] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-26T18:53:08.621576] [FATAL] [MAIN ] FMY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:53:08.621872] [WARN ] [MAIN ] FMY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:53:08.622004] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-26T18:53:08.622078] [DEBUG] [LOCAL ] FMY: No primary data file found to delete. [2025-09-26T18:53:08.622137] [INFO ] [LOCAL ] FMY: Starting deletion of derivative data. [2025-09-26T18:53:08.622586] [DEBUG] [LOCAL ] FMY: Deleted derivative data file. [2025-09-26T18:53:08.622840] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FMY took 22.9s. Estimated remaining: 3h 20m 31s. Rate: 7.6 symbols/min [2025-09-26T18:53:08.628761] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-26T18:53:08.658966] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-26T18:53:08.771992] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-26T18:53:08.979242] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:09.282291] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:09.303624] [DEBUG] [LOCAL ] FNF: Loaded 49513 existing records from primary storage. [2025-09-26T18:53:09.303801] [INFO ] [MAIN ] FNF: Loaded 49513 existing records. [2025-09-26T18:53:09.489822] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:09.490315] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-26T18:53:09.490402] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-26T18:53:09.492135] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-26T18:53:09.492202] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-26T18:53:09.561832] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-26T18:53:09.892006] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:10.356700] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-26T18:53:10.552841] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T18:53:10.749901] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T18:53:11.156766] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-26T18:53:11.956783] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-26T18:53:12.405527] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-26T18:53:12.756757] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-26T18:53:12.894506] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T18:53:13.556731] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-26T18:53:13.716685] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T18:53:14.288791] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T18:53:14.356772] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-26T18:53:14.839920] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T18:53:15.156784] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-26T18:53:15.956695] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-26T18:53:16.065072] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T18:53:16.760158] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-26T18:53:16.765904] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T18:53:17.556734] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-26T18:53:17.858270] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T18:53:18.363580] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-26T18:53:18.383040] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T18:53:18.522926] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-26T18:53:19.156723] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-26T18:53:19.956707] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-26T18:53:20.235184] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T18:53:20.756744] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-26T18:53:20.850243] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T18:53:21.419097] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T18:53:21.556725] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-26T18:53:22.113379] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-26T18:53:22.356726] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-26T18:53:22.638828] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T18:53:23.156776] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-26T18:53:23.634047] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T18:53:23.956759] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-26T18:53:24.538438] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T18:53:24.756786] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-26T18:53:25.556735] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-26T18:53:25.891685] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-26T18:53:26.261908] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T18:53:26.356762] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-26T18:53:26.854674] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T18:53:27.156727] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-26T18:53:27.671048] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-26T18:53:27.956738] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-26T18:53:28.534684] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T18:53:28.542352] [INFO ] [REMOTE ] FN: Full fetch complete (56488 records). [2025-09-26T18:53:28.542492] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-26T18:53:28.766028] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-26T18:53:28.951240] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-26T18:53:28.951348] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-26T18:53:28.952221] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-26T18:53:28.952288] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-26T18:53:28.953568] [DEBUG] [LOCAL ] FN: Trimmed 56488 records to 39795 (keeping 200 days of data) [2025-09-26T18:53:29.203420] [DEBUG] [LOCAL ] FN: Primary data saved (39795 records). [2025-09-26T18:53:29.203682] [INFO ] [MAIN ] FN: Full history saved. [2025-09-26T18:53:29.203982] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FN took 34.7s. Estimated remaining: 3h 20m 46s. Rate: 7.5 symbols/min [2025-09-26T18:53:29.396045] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:29.427396] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T18:53:29.483168] [DEBUG] [LOCAL ] FNV: Loaded 46719 existing records from primary storage. [2025-09-26T18:53:29.483351] [INFO ] [MAIN ] FNV: Loaded 46719 existing records. [2025-09-26T18:53:29.561936] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-26T18:53:29.688988] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:29.689264] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-26T18:53:29.689313] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-26T18:53:29.690832] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-26T18:53:29.690895] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-26T18:53:30.080441] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:30.142885] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T18:53:30.356727] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-26T18:53:31.036846] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T18:53:31.156740] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-26T18:53:31.731835] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T18:53:31.956733] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-26T18:53:32.460602] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T18:53:32.756728] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-26T18:53:33.389993] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T18:53:33.556724] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-26T18:53:33.877296] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T18:53:34.356730] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-26T18:53:35.100990] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T18:53:35.112762] [INFO ] [REMOTE ] FNB: Full fetch complete (75763 records). [2025-09-26T18:53:35.112951] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-26T18:53:35.163860] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-26T18:53:35.547485] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-26T18:53:35.547679] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-26T18:53:35.548856] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-26T18:53:35.549048] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-26T18:53:35.550975] [DEBUG] [LOCAL ] FNB: Trimmed 75763 records to 53226 (keeping 200 days of data) [2025-09-26T18:53:35.676057] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T18:53:35.924695] [DEBUG] [LOCAL ] FNB: Primary data saved (53226 records). [2025-09-26T18:53:35.924858] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-26T18:53:35.924942] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FNB took 38.7s. Estimated remaining: 3h 20m 36s. Rate: 7.5 symbols/min [2025-09-26T18:53:35.961919] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-26T18:53:36.106566] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:36.121137] [DEBUG] [LOCAL ] FOA: Loaded 13368 existing records from primary storage. [2025-09-26T18:53:36.121255] [INFO ] [MAIN ] FOA: Loaded 13368 existing records. [2025-09-26T18:53:36.307794] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:36.308117] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-26T18:53:36.308176] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-26T18:53:36.308769] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-26T18:53:36.308831] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-26T18:53:36.685803] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:36.720874] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T18:53:36.756721] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-26T18:53:37.362978] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T18:53:37.487378] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-26T18:53:37.556690] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-26T18:53:38.356722] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-26T18:53:38.648193] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:53:39.156735] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-26T18:53:39.956697] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-26T18:53:40.149571] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:53:40.159964] [INFO ] [REMOTE ] FND: Full fetch complete (74441 records). [2025-09-26T18:53:40.160100] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-26T18:53:40.579428] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-26T18:53:40.579667] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-26T18:53:40.580795] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-26T18:53:40.580899] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-26T18:53:40.582740] [DEBUG] [LOCAL ] FND: Trimmed 74441 records to 52871 (keeping 200 days of data) [2025-09-26T18:53:40.761397] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-26T18:53:40.836389] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T18:53:40.951349] [DEBUG] [LOCAL ] FND: Primary data saved (52871 records). [2025-09-26T18:53:40.951502] [INFO ] [MAIN ] FND: Full history saved. [2025-09-26T18:53:40.951608] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FND took 32.8s. Estimated remaining: 3h 20m 23s. Rate: 7.6 symbols/min [2025-09-26T18:53:41.137129] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:41.147898] [DEBUG] [LOCAL ] FOF: Loaded 8438 existing records from primary storage. [2025-09-26T18:53:41.148027] [INFO ] [MAIN ] FOF: Loaded 8438 existing records. [2025-09-26T18:53:41.340500] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:41.341100] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-26T18:53:41.341232] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-26T18:53:41.341806] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-26T18:53:41.341869] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-26T18:53:41.567082] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T18:53:41.565097] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-26T18:53:41.788986] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:42.016786] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T18:53:42.356731] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-26T18:53:43.156675] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-26T18:53:43.423763] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T18:53:43.956704] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-26T18:53:44.038486] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T18:53:44.068696] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T18:53:44.078340] [INFO ] [REMOTE ] FNF: Full fetch complete (69570 records). [2025-09-26T18:53:44.078485] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-26T18:53:44.498486] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-26T18:53:44.498586] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-26T18:53:44.499472] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-26T18:53:44.499548] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-26T18:53:44.501169] [DEBUG] [LOCAL ] FNF: Trimmed 69570 records to 49871 (keeping 200 days of data) [2025-09-26T18:53:44.756769] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-26T18:53:44.831252] [DEBUG] [LOCAL ] FNF: Primary data saved (49871 records). [2025-09-26T18:53:44.831413] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-26T18:53:44.831527] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FNF took 36.2s. Estimated remaining: 3h 20m 8s. Rate: 7.6 symbols/min [2025-09-26T18:53:45.012872] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:53:45.033142] [DEBUG] [LOCAL ] FOR: Loaded 20256 existing records from primary storage. [2025-09-26T18:53:45.033295] [INFO ] [MAIN ] FOR: Loaded 20256 existing records. [2025-09-26T18:53:45.223850] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:53:45.224351] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-26T18:53:45.224605] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-26T18:53:45.225402] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-26T18:53:45.225483] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-26T18:53:45.580485] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-26T18:53:45.620736] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:53:45.629682] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T18:53:45.662904] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:53:46.356686] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-26T18:53:46.749635] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T18:53:47.056962] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T18:53:47.156755] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-26T18:53:47.956766] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-26T18:53:48.245134] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T18:53:48.756745] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-26T18:53:49.495270] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T18:53:49.556714] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-26T18:53:49.873987] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:53:50.356712] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-26T18:53:50.432034] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T18:53:51.144661] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T18:53:51.156673] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-26T18:53:51.956754] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-26T18:53:52.756721] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-26T18:53:52.810309] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T18:53:52.843239] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T18:53:53.430197] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T18:53:53.556733] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-26T18:53:54.356805] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-26T18:53:54.373617] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T18:53:55.156811] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-26T18:53:55.614423] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T18:53:55.956766] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-26T18:53:55.959897] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T18:53:56.756749] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-26T18:53:56.950602] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T18:53:57.556724] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-26T18:53:57.994257] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T18:53:58.070313] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-26T18:53:58.356742] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-26T18:53:59.156742] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-26T18:53:59.389122] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T18:53:59.641314] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-26T18:53:59.956714] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-26T18:54:00.756705] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-26T18:54:00.914500] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T18:54:01.556719] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-26T18:54:01.997960] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:54:02.016157] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-26T18:54:02.356751] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-26T18:54:03.152612] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T18:54:03.156672] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-26T18:54:03.836146] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:54:03.956717] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-26T18:54:04.756741] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-26T18:54:04.936566] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T18:54:04.939351] [INFO ] [REMOTE ] FOF: Full fetch complete (11899 records). [2025-09-26T18:54:04.939432] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-26T18:54:05.368428] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-26T18:54:05.368510] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-26T18:54:05.368817] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-26T18:54:05.368878] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-26T18:54:05.369376] [DEBUG] [LOCAL ] FOF: Trimmed 11899 records to 8510 (keeping 200 days of data) [2025-09-26T18:54:05.422877] [DEBUG] [LOCAL ] FOF: Primary data saved (8510 records). [2025-09-26T18:54:05.423037] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-26T18:54:05.423135] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FOF took 24.5s. Estimated remaining: 3h 20m 22s. Rate: 7.5 symbols/min [2025-09-26T18:54:05.572039] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-26T18:54:05.608266] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:05.659375] [DEBUG] [LOCAL ] FOUR: Loaded 49917 existing records from primary storage. [2025-09-26T18:54:05.659550] [INFO ] [MAIN ] FOUR: Loaded 49917 existing records. [2025-09-26T18:54:05.844834] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:05.845134] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-26T18:54:05.845191] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-26T18:54:05.846408] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-26T18:54:05.846471] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-26T18:54:06.225231] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:06.356749] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-26T18:54:06.513349] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T18:54:06.524705] [INFO ] [REMOTE ] FNV: Full fetch complete (66099 records). [2025-09-26T18:54:06.524954] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-26T18:54:06.539247] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T18:54:06.978782] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T18:54:06.979082] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-26T18:54:06.979343] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-26T18:54:06.984375] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-26T18:54:06.984608] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-26T18:54:06.988701] [DEBUG] [LOCAL ] FNV: Trimmed 66099 records to 47028 (keeping 200 days of data) [2025-09-26T18:54:07.185855] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-26T18:54:07.307554] [DEBUG] [LOCAL ] FNV: Primary data saved (47028 records). [2025-09-26T18:54:07.307758] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-26T18:54:07.307865] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FNV took 38.1s. Estimated remaining: 3h 20m 3s. Rate: 7.5 symbols/min [2025-09-26T18:54:07.500239] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:07.523452] [DEBUG] [LOCAL ] FPF: Loaded 17789 existing records from primary storage. [2025-09-26T18:54:07.523628] [INFO ] [MAIN ] FPF: Loaded 17789 existing records. [2025-09-26T18:54:07.755031] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:07.755790] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-26T18:54:07.755847] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-26T18:54:07.756753] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-26T18:54:07.756818] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-26T18:54:07.966469] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-26T18:54:08.156789] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:08.257622] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-26T18:54:08.756768] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-26T18:54:09.148862] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-26T18:54:09.152722] [INFO ] [REMOTE ] FOA: Full fetch complete (22485 records). [2025-09-26T18:54:09.152809] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-26T18:54:09.558637] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-26T18:54:09.590541] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-26T18:54:09.593777] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-26T18:54:09.595795] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-26T18:54:09.596082] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-26T18:54:09.600060] [DEBUG] [LOCAL ] FOA: Trimmed 22485 records to 13484 (keeping 200 days of data) [2025-09-26T18:54:09.691398] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T18:54:09.721393] [DEBUG] [LOCAL ] FOA: Primary data saved (13484 records). [2025-09-26T18:54:09.721576] [INFO ] [REMOTE ] FOR: Full fetch complete (29904 records). [2025-09-26T18:54:09.721795] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-26T18:54:09.722148] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FOA took 33.8s. Estimated remaining: 3h 19m 46s. Rate: 7.6 symbols/min [2025-09-26T18:54:09.722263] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-26T18:54:10.125495] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:10.337754] [DEBUG] [LOCAL ] FPH: Loaded 19773 existing records from primary storage. [2025-09-26T18:54:10.348830] [INFO ] [MAIN ] FPH: Loaded 19773 existing records. [2025-09-26T18:54:10.361262] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-26T18:54:10.368032] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-26T18:54:10.390185] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-26T18:54:10.437595] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-26T18:54:10.455424] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-26T18:54:10.486761] [DEBUG] [LOCAL ] FOR: Trimmed 29904 records to 20362 (keeping 200 days of data) [2025-09-26T18:54:10.617916] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:10.640127] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T18:54:10.668073] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-26T18:54:10.682448] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-26T18:54:10.687777] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-26T18:54:10.687885] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-26T18:54:11.092362] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:11.100927] [DEBUG] [LOCAL ] FOR: Primary data saved (20362 records). [2025-09-26T18:54:11.101101] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-26T18:54:11.101275] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FOR took 26.3s. Estimated remaining: 3h 19m 26s. Rate: 7.6 symbols/min [2025-09-26T18:54:11.164762] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-26T18:54:11.297117] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:11.341212] [DEBUG] [LOCAL ] FPI: Loaded 31331 existing records from primary storage. [2025-09-26T18:54:11.341361] [INFO ] [MAIN ] FPI: Loaded 31331 existing records. [2025-09-26T18:54:11.531490] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:11.531885] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-26T18:54:11.531942] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-26T18:54:11.533532] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-26T18:54:11.533599] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-26T18:54:11.911104] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:11.956700] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-26T18:54:12.252953] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-26T18:54:12.280071] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T18:54:12.756759] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-26T18:54:13.195887] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T18:54:13.556748] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-26T18:54:13.907093] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:54:14.356776] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-26T18:54:14.516573] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T18:54:15.156768] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-26T18:54:15.704257] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:54:15.831231] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T18:54:15.956748] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-26T18:54:16.756689] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-26T18:54:17.153782] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T18:54:17.429145] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T18:54:17.556724] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-26T18:54:18.356730] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-26T18:54:18.698467] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T18:54:19.156732] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-26T18:54:19.958360] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-26T18:54:19.961330] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:54:20.010084] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T18:54:20.756759] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-26T18:54:21.331385] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T18:54:21.556723] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-26T18:54:22.160291] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T18:54:22.356745] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-26T18:54:22.513346] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T18:54:23.156739] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-26T18:54:23.770037] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:54:23.956742] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-26T18:54:24.128160] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:54:24.756759] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-26T18:54:25.218698] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T18:54:25.556685] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-26T18:54:25.598633] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T18:54:26.356754] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-26T18:54:27.156757] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-26T18:54:27.233291] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T18:54:27.268500] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-26T18:54:27.783261] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-26T18:54:27.956748] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-26T18:54:28.756723] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-26T18:54:29.556726] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-26T18:54:29.674063] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T18:54:29.732359] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:54:30.251429] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-26T18:54:30.356733] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-26T18:54:31.156726] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-26T18:54:31.776973] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T18:54:31.798426] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T18:54:31.956723] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-26T18:54:32.756685] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-26T18:54:33.196387] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:54:33.480579] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-26T18:54:33.556752] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-26T18:54:34.356747] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-26T18:54:34.912395] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T18:54:34.918588] [INFO ] [REMOTE ] FPI: Full fetch complete (44127 records). [2025-09-26T18:54:34.918730] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-26T18:54:35.164053] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-26T18:54:35.338202] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-26T18:54:35.338310] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-26T18:54:35.339078] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-26T18:54:35.339147] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-26T18:54:35.340446] [DEBUG] [LOCAL ] FPI: Trimmed 44127 records to 31525 (keeping 200 days of data) [2025-09-26T18:54:35.550467] [DEBUG] [LOCAL ] FPI: Primary data saved (31525 records). [2025-09-26T18:54:35.550720] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-26T18:54:35.550858] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPI took 24.4s. Estimated remaining: 3h 19m 47s. Rate: 7.5 symbols/min [2025-09-26T18:54:35.731678] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:35.778852] [DEBUG] [LOCAL ] FR: Loaded 46867 existing records from primary storage. [2025-09-26T18:54:35.779008] [INFO ] [MAIN ] FR: Loaded 46867 existing records. [2025-09-26T18:54:35.979857] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-26T18:54:35.979620] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:35.981870] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-26T18:54:35.982159] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-26T18:54:35.993705] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-26T18:54:35.995171] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-26T18:54:35.995275] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-26T18:54:36.210583] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T18:54:36.439495] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:36.756704] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-26T18:54:37.063251] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T18:54:37.556724] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-26T18:54:38.352461] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-26T18:54:38.361837] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-26T18:54:39.156703] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-26T18:54:39.286931] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-26T18:54:39.477087] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T18:54:39.487311] [INFO ] [REMOTE ] FOUR: Full fetch complete (71961 records). [2025-09-26T18:54:39.487519] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-26T18:54:39.932789] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-26T18:54:39.932926] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-26T18:54:39.934030] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-26T18:54:39.934123] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-26T18:54:39.947369] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T18:54:39.951773] [DEBUG] [LOCAL ] FOUR: Trimmed 71961 records to 50306 (keeping 200 days of data) [2025-09-26T18:54:39.954240] [INFO ] [REMOTE ] FPF: Full fetch complete (26346 records). [2025-09-26T18:54:39.954396] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-26T18:54:40.016201] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-26T18:54:40.558887] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-26T18:54:40.585536] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-26T18:54:40.587113] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-26T18:54:40.587238] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-26T18:54:40.594515] [DEBUG] [LOCAL ] FPF: Trimmed 26346 records to 17998 (keeping 200 days of data) [2025-09-26T18:54:40.740625] [DEBUG] [LOCAL ] FPF: Primary data saved (17998 records). [2025-09-26T18:54:40.765950] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-26T18:54:40.771225] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-26T18:54:40.785504] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FPF took 33.5s. Estimated remaining: 3h 19m 34s. Rate: 7.5 symbols/min [2025-09-26T18:54:41.000884] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:41.016560] [DEBUG] [LOCAL ] FOUR: Primary data saved (50306 records). [2025-09-26T18:54:41.016820] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-26T18:54:41.016982] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FOUR took 35.6s. Estimated remaining: 3h 19m 13s. Rate: 7.6 symbols/min [2025-09-26T18:54:41.116394] [DEBUG] [LOCAL ] FRA: Loaded 14610 existing records from primary storage. [2025-09-26T18:54:41.139583] [INFO ] [MAIN ] FRA: Loaded 14610 existing records. [2025-09-26T18:54:41.333955] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:41.421916] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:41.422773] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-26T18:54:41.422882] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-26T18:54:41.427786] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-26T18:54:41.427896] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-26T18:54:41.544571] [DEBUG] [LOCAL ] FRGE: Loaded 18502 existing records from primary storage. [2025-09-26T18:54:41.548491] [INFO ] [MAIN ] FRGE: Loaded 18502 existing records. [2025-09-26T18:54:41.993219] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:42.078628] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-26T18:54:42.084123] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-26T18:54:42.085955] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-26T18:54:42.127078] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-26T18:54:42.096827] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T18:54:42.136184] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:42.143322] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-26T18:54:42.144682] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-26T18:54:42.357693] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-26T18:54:42.573358] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:43.156753] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-26T18:54:43.532588] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T18:54:43.699980] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T18:54:43.956734] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-26T18:54:44.218602] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T18:54:44.566947] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T18:54:44.756734] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-26T18:54:45.556737] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-26T18:54:46.024016] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T18:54:46.356736] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-26T18:54:46.885063] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T18:54:46.979784] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:54:47.156733] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-26T18:54:47.956788] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-26T18:54:48.756776] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-26T18:54:49.106605] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T18:54:49.174441] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:54:49.556733] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-26T18:54:49.742118] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T18:54:50.356768] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-26T18:54:51.156695] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-26T18:54:51.195143] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T18:54:51.233512] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T18:54:51.910789] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T18:54:51.915953] [INFO ] [REMOTE ] FPH: Full fetch complete (31463 records). [2025-09-26T18:54:51.916094] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-26T18:54:51.961866] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-26T18:54:52.330058] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-26T18:54:52.330140] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-26T18:54:52.330752] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-26T18:54:52.330815] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-26T18:54:52.331572] [DEBUG] [LOCAL ] FPH: Trimmed 31463 records to 19890 (keeping 200 days of data) [2025-09-26T18:54:52.450514] [DEBUG] [LOCAL ] FPH: Primary data saved (19890 records). [2025-09-26T18:54:52.450699] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-26T18:54:52.450805] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FPH took 42.7s. Estimated remaining: 3h 19m 11s. Rate: 7.6 symbols/min [2025-09-26T18:54:52.636531] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:54:52.646750] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-26T18:54:52.708090] [DEBUG] [LOCAL ] FRO: Loaded 52243 existing records from primary storage. [2025-09-26T18:54:52.708284] [INFO ] [MAIN ] FRO: Loaded 52243 existing records. [2025-09-26T18:54:52.756824] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-26T18:54:52.897855] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:54:52.898180] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-26T18:54:52.898240] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-26T18:54:52.899735] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-26T18:54:52.899801] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-26T18:54:53.288115] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:54:53.556733] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-26T18:54:54.356691] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-26T18:54:54.538117] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:54:54.656090] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T18:54:55.156730] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-26T18:54:55.956700] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-26T18:54:56.298816] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T18:54:56.377829] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T18:54:56.756778] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-26T18:54:57.231380] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T18:54:57.556732] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-26T18:54:57.797553] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-26T18:54:58.169872] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T18:54:58.356750] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-26T18:54:59.156771] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-26T18:54:59.956730] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-26T18:54:59.989274] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T18:55:00.239394] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T18:55:00.756763] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-26T18:55:00.882623] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T18:55:01.556727] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-26T18:55:02.361093] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-26T18:55:02.383235] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T18:55:02.401511] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T18:55:02.405098] [INFO ] [REMOTE ] FRA: Full fetch complete (24096 records). [2025-09-26T18:55:02.405196] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-26T18:55:02.811161] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-26T18:55:02.811259] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-26T18:55:02.811836] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-26T18:55:02.811900] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-26T18:55:02.813174] [DEBUG] [LOCAL ] FRA: Trimmed 24096 records to 14717 (keeping 200 days of data) [2025-09-26T18:55:02.914281] [DEBUG] [LOCAL ] FRA: Primary data saved (14717 records). [2025-09-26T18:55:02.914437] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-26T18:55:02.914589] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FRA took 22.1s. Estimated remaining: 3h 19m 8s. Rate: 7.5 symbols/min [2025-09-26T18:55:03.105487] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:03.153765] [DEBUG] [LOCAL ] FRT: Loaded 42561 existing records from primary storage. [2025-09-26T18:55:03.153917] [INFO ] [MAIN ] FRT: Loaded 42561 existing records. [2025-09-26T18:55:03.166739] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-26T18:55:03.353992] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:03.354303] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-26T18:55:03.354420] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-26T18:55:03.355530] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-26T18:55:03.355594] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-26T18:55:03.542804] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T18:55:03.767594] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:03.956784] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-26T18:55:04.756750] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-26T18:55:05.299099] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-26T18:55:05.479517] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T18:55:05.556743] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-26T18:55:05.613933] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T18:55:06.356769] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-26T18:55:06.921626] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T18:55:07.156745] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-26T18:55:07.956737] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-26T18:55:08.535688] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-26T18:55:08.714528] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T18:55:08.756735] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-26T18:55:09.425184] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-26T18:55:09.434312] [INFO ] [REMOTE ] FR: Full fetch complete (66550 records). [2025-09-26T18:55:09.434491] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-26T18:55:09.561815] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-26T18:55:09.870965] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-26T18:55:09.871111] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-26T18:55:09.872093] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-26T18:55:09.872161] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-26T18:55:09.873634] [DEBUG] [LOCAL ] FR: Trimmed 66550 records to 47174 (keeping 200 days of data) [2025-09-26T18:55:10.178931] [DEBUG] [LOCAL ] FR: Primary data saved (47174 records). [2025-09-26T18:55:10.179086] [INFO ] [MAIN ] FR: Full history saved. [2025-09-26T18:55:10.179192] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FR took 34.6s. Estimated remaining: 3h 18m 58s. Rate: 7.5 symbols/min [2025-09-26T18:55:10.375290] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:10.370561] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-26T18:55:10.413441] [DEBUG] [LOCAL ] FSCO: Loaded 37342 existing records from primary storage. [2025-09-26T18:55:10.413662] [INFO ] [MAIN ] FSCO: Loaded 37342 existing records. [2025-09-26T18:55:10.619543] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:10.635856] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-26T18:55:10.656250] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T18:55:10.655067] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-26T18:55:10.665674] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-26T18:55:10.657956] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T18:55:10.666396] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-26T18:55:11.061735] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:11.156755] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-26T18:55:11.956769] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-26T18:55:12.272791] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T18:55:12.365593] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T18:55:12.756772] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-26T18:55:13.107720] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:55:13.556735] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-26T18:55:14.361811] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-26T18:55:14.381742] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T18:55:14.956406] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:55:15.031390] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-26T18:55:15.156747] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-26T18:55:15.956731] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-26T18:55:16.673273] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T18:55:16.756778] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-26T18:55:17.340338] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T18:55:17.556734] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-26T18:55:18.216393] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:55:18.356751] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-26T18:55:19.156794] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-26T18:55:19.536108] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T18:55:19.599576] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:55:19.769958] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T18:55:19.774260] [INFO ] [REMOTE ] FRGE: Full fetch complete (33478 records). [2025-09-26T18:55:19.774477] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-26T18:55:19.956735] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-26T18:55:20.199478] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-26T18:55:20.199568] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-26T18:55:20.200241] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-26T18:55:20.200310] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-26T18:55:20.201376] [DEBUG] [LOCAL ] FRGE: Trimmed 33478 records to 18571 (keeping 200 days of data) [2025-09-26T18:55:20.320943] [DEBUG] [LOCAL ] FRGE: Primary data saved (18571 records). [2025-09-26T18:55:20.321099] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-26T18:55:20.321226] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FRGE took 39.3s. Estimated remaining: 3h 18m 54s. Rate: 7.5 symbols/min [2025-09-26T18:55:20.538751] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:20.594303] [DEBUG] [LOCAL ] FSK: Loaded 49795 existing records from primary storage. [2025-09-26T18:55:20.594460] [INFO ] [MAIN ] FSK: Loaded 49795 existing records. [2025-09-26T18:55:20.786197] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-26T18:55:20.793574] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:20.794872] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-26T18:55:20.794941] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-26T18:55:20.796704] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-26T18:55:20.796781] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-26T18:55:21.216135] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:21.556719] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-26T18:55:21.967929] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-26T18:55:22.045958] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T18:55:22.356737] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-26T18:55:22.662807] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T18:55:23.156738] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-26T18:55:23.956699] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-26T18:55:24.053763] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T18:55:24.064496] [INFO ] [REMOTE ] FRO: Full fetch complete (75362 records). [2025-09-26T18:55:24.064692] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-26T18:55:24.568223] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-26T18:55:24.568429] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-26T18:55:24.569635] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-26T18:55:24.569796] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-26T18:55:24.572018] [DEBUG] [LOCAL ] FRO: Trimmed 75362 records to 52603 (keeping 200 days of data) [2025-09-26T18:55:24.710938] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T18:55:24.808227] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-26T18:55:24.963048] [DEBUG] [LOCAL ] FRO: Primary data saved (52603 records). [2025-09-26T18:55:24.963201] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-26T18:55:24.964382] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRO took 32.5s. Estimated remaining: 3h 18m 41s. Rate: 7.5 symbols/min [2025-09-26T18:55:25.151609] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:25.206335] [DEBUG] [LOCAL ] FSLY: Loaded 51629 existing records from primary storage. [2025-09-26T18:55:25.206494] [INFO ] [MAIN ] FSLY: Loaded 51629 existing records. [2025-09-26T18:55:25.369526] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:55:25.451901] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:25.452206] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-26T18:55:25.452256] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-26T18:55:25.453819] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-26T18:55:25.453883] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-26T18:55:25.561872] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-26T18:55:25.859819] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:26.229603] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T18:55:26.356775] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-26T18:55:26.800062] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T18:55:27.156751] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-26T18:55:27.956734] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-26T18:55:28.113957] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T18:55:28.171175] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T18:55:28.756744] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-26T18:55:29.255027] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T18:55:29.556725] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-26T18:55:30.080403] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T18:55:30.088601] [INFO ] [REMOTE ] FRT: Full fetch complete (60264 records). [2025-09-26T18:55:30.088814] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-26T18:55:30.365083] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-26T18:55:30.516706] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-26T18:55:30.516826] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-26T18:55:30.517834] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-26T18:55:30.517958] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-26T18:55:30.526764] [DEBUG] [LOCAL ] FRT: Trimmed 60264 records to 42808 (keeping 200 days of data) [2025-09-26T18:55:30.541241] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T18:55:30.816859] [DEBUG] [LOCAL ] FRT: Primary data saved (42808 records). [2025-09-26T18:55:30.816998] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-26T18:55:30.817086] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FRT took 27.9s. Estimated remaining: 3h 18m 29s. Rate: 7.6 symbols/min [2025-09-26T18:55:31.003544] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:31.060230] [DEBUG] [LOCAL ] FSM: Loaded 53675 existing records from primary storage. [2025-09-26T18:55:31.060415] [INFO ] [MAIN ] FSM: Loaded 53675 existing records. [2025-09-26T18:55:31.161962] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-26T18:55:31.262720] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:31.262990] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-26T18:55:31.263039] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-26T18:55:31.264992] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-26T18:55:31.265091] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-26T18:55:31.646925] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:31.956754] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-26T18:55:32.218632] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T18:55:32.753142] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T18:55:32.761865] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-26T18:55:33.319059] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T18:55:33.556742] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-26T18:55:34.145452] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T18:55:34.356757] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-26T18:55:35.057548] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T18:55:35.156784] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-26T18:55:35.781422] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T18:55:35.956726] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-26T18:55:36.667166] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T18:55:36.756685] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-26T18:55:37.556727] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-26T18:55:37.612349] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-26T18:55:38.070053] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T18:55:38.078524] [INFO ] [REMOTE ] FSCO: Full fetch complete (54152 records). [2025-09-26T18:55:38.078684] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-26T18:55:38.365592] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-26T18:55:38.494065] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-26T18:55:38.494205] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-26T18:55:38.495299] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-26T18:55:38.495377] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-26T18:55:38.497223] [DEBUG] [LOCAL ] FSCO: Trimmed 54152 records to 37725 (keeping 200 days of data) [2025-09-26T18:55:38.753378] [DEBUG] [LOCAL ] FSCO: Primary data saved (37725 records). [2025-09-26T18:55:38.753577] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-26T18:55:38.753725] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSCO took 28.6s. Estimated remaining: 3h 18m 21s. Rate: 7.6 symbols/min [2025-09-26T18:55:38.936473] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:38.981254] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T18:55:39.026245] [DEBUG] [LOCAL ] FSS: Loaded 34689 existing records from primary storage. [2025-09-26T18:55:39.026457] [INFO ] [MAIN ] FSS: Loaded 34689 existing records. [2025-09-26T18:55:39.173908] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-26T18:55:39.222150] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:39.222552] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-26T18:55:39.222616] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-26T18:55:39.224264] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-26T18:55:39.224332] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-26T18:55:39.598542] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:39.743007] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T18:55:39.956769] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-26T18:55:40.756782] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-26T18:55:40.997175] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T18:55:41.565895] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-26T18:55:41.572426] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T18:55:41.639146] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T18:55:42.356789] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-26T18:55:43.040234] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T18:55:43.156827] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-26T18:55:43.640962] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T18:55:43.956799] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-26T18:55:44.756742] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-26T18:55:45.159184] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T18:55:45.556808] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-26T18:55:45.655486] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T18:55:46.275776] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T18:55:46.356768] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-26T18:55:46.508354] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T18:55:47.156767] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-26T18:55:47.956814] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-26T18:55:48.330997] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T18:55:48.429700] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-26T18:55:48.440446] [INFO ] [REMOTE ] FSK: Full fetch complete (71431 records). [2025-09-26T18:55:48.440681] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-26T18:55:48.756988] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-26T18:55:48.861350] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-26T18:55:48.861477] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-26T18:55:48.862462] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-26T18:55:48.862555] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-26T18:55:48.864148] [DEBUG] [LOCAL ] FSK: Trimmed 71431 records to 50173 (keeping 200 days of data) [2025-09-26T18:55:49.192101] [DEBUG] [LOCAL ] FSK: Primary data saved (50173 records). [2025-09-26T18:55:49.192294] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-26T18:55:49.192413] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSK took 28.9s. Estimated remaining: 3h 18m 17s. Rate: 7.5 symbols/min [2025-09-26T18:55:49.381138] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:55:49.390236] [DEBUG] [LOCAL ] FT: Loaded 6371 existing records from primary storage. [2025-09-26T18:55:49.390373] [INFO ] [MAIN ] FT: Loaded 6371 existing records. [2025-09-26T18:55:49.599188] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:55:49.578051] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-26T18:55:49.626574] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-26T18:55:49.626779] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-26T18:55:49.627765] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-26T18:55:49.630350] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T18:55:49.630517] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-26T18:55:50.029417] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:55:50.205432] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:55:50.356728] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-26T18:55:50.934463] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T18:55:51.156781] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-26T18:55:51.834949] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T18:55:51.956760] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-26T18:55:52.370497] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T18:55:52.393474] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-26T18:55:52.756787] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-26T18:55:53.556728] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-26T18:55:54.356800] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-26T18:55:54.587226] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T18:55:54.635961] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T18:55:55.007235] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T18:55:55.156809] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-26T18:55:55.756408] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T18:55:55.956775] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-26T18:55:56.756760] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-26T18:55:57.556712] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-26T18:55:57.681018] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T18:55:58.145427] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T18:55:58.356766] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-26T18:55:58.409683] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T18:55:59.157423] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-26T18:55:59.157320] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T18:55:59.956853] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-26T18:56:00.756784] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-26T18:56:00.771436] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:56:01.020600] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-26T18:56:01.031114] [INFO ] [REMOTE ] FSLY: Full fetch complete (74919 records). [2025-09-26T18:56:01.031264] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-26T18:56:01.443318] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-26T18:56:01.443419] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-26T18:56:01.444340] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-26T18:56:01.444406] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-26T18:56:01.446013] [DEBUG] [LOCAL ] FSLY: Trimmed 74919 records to 51989 (keeping 200 days of data) [2025-09-26T18:56:01.560884] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-26T18:56:01.773280] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T18:56:01.794423] [DEBUG] [LOCAL ] FSLY: Primary data saved (51989 records). [2025-09-26T18:56:01.794557] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-26T18:56:01.795016] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FSLY took 36.8s. Estimated remaining: 3h 18m 17s. Rate: 7.5 symbols/min [2025-09-26T18:56:01.977397] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:01.992267] [DEBUG] [LOCAL ] FTHY: Loaded 11807 existing records from primary storage. [2025-09-26T18:56:01.992400] [INFO ] [MAIN ] FTHY: Loaded 11807 existing records. [2025-09-26T18:56:02.107476] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-26T18:56:02.188039] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:02.188333] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-26T18:56:02.188383] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-26T18:56:02.188963] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-26T18:56:02.189024] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-26T18:56:02.358780] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-26T18:56:02.616470] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:03.156745] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-26T18:56:03.837342] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T18:56:03.956741] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-26T18:56:04.122081] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T18:56:04.438596] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-26T18:56:04.756753] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-26T18:56:05.556737] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-26T18:56:05.631534] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-26T18:56:05.633534] [INFO ] [REMOTE ] FT: Full fetch complete (9046 records). [2025-09-26T18:56:05.633607] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-26T18:56:06.014510] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-26T18:56:06.014590] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-26T18:56:06.014838] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-26T18:56:06.014898] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-26T18:56:06.015340] [DEBUG] [LOCAL ] FT: Trimmed 9046 records to 6432 (keeping 200 days of data) [2025-09-26T18:56:06.067754] [DEBUG] [LOCAL ] FT: Primary data saved (6432 records). [2025-09-26T18:56:06.068195] [INFO ] [MAIN ] FT: Full history saved. [2025-09-26T18:56:06.068865] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FT took 16.9s. Estimated remaining: 3h 18m 3s. Rate: 7.5 symbols/min [2025-09-26T18:56:06.263305] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:06.263541] [DEBUG] [LOCAL ] FTI: No existing data file found in primary storage. [2025-09-26T18:56:06.263594] [WARN ] [MAIN ] FTI: No existing data found, performing full refresh instead. [2025-09-26T18:56:06.263774] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-26T18:56:06.263822] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-26T18:56:06.263892] [DEBUG] [LOCAL ] FTI: No primary data file found to delete. [2025-09-26T18:56:06.263960] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-26T18:56:06.362684] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-26T18:56:06.646376] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:06.919753] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T18:56:07.015496] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T18:56:07.156754] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-26T18:56:07.956736] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-26T18:56:08.756738] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-26T18:56:09.072760] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T18:56:09.260269] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-26T18:56:09.556721] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-26T18:56:10.356752] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-26T18:56:10.691164] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-26T18:56:10.864422] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T18:56:10.886166] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T18:56:11.156749] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-26T18:56:11.956734] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-26T18:56:12.756745] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-26T18:56:13.335267] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-26T18:56:13.346183] [INFO ] [REMOTE ] FSM: Full fetch complete (76729 records). [2025-09-26T18:56:13.346351] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-26T18:56:13.484252] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T18:56:13.559306] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-26T18:56:13.742261] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T18:56:13.781240] [INFO ] [REMOTE ] FSS: Full fetch complete (48248 records). [2025-09-26T18:56:13.791782] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-26T18:56:13.953669] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-26T18:56:13.965364] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-26T18:56:13.993304] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-26T18:56:13.999218] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-26T18:56:14.085480] [DEBUG] [LOCAL ] FSM: Trimmed 76729 records to 54065 (keeping 200 days of data) [2025-09-26T18:56:14.361042] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-26T18:56:14.433387] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-26T18:56:14.434099] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-26T18:56:14.435297] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-26T18:56:14.435617] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-26T18:56:14.445070] [DEBUG] [LOCAL ] FSS: Trimmed 48248 records to 34888 (keeping 200 days of data) [2025-09-26T18:56:14.906107] [DEBUG] [LOCAL ] FSM: Primary data saved (54065 records). [2025-09-26T18:56:14.906900] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-26T18:56:14.907084] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FSM took 44.1s. Estimated remaining: 3h 17m 57s. Rate: 7.5 symbols/min [2025-09-26T18:56:14.919457] [DEBUG] [LOCAL ] FSS: Primary data saved (34888 records). [2025-09-26T18:56:14.919595] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-26T18:56:14.919736] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FSS took 36.2s. Estimated remaining: 3h 17m 35s. Rate: 7.6 symbols/min [2025-09-26T18:56:15.177547] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T18:56:15.180604] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-26T18:56:15.290588] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T18:56:15.956696] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-26T18:56:16.096199] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T18:56:16.756735] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-26T18:56:17.471444] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T18:56:17.527369] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T18:56:17.556734] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-26T18:56:18.356787] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-26T18:56:18.389876] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T18:56:19.156753] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-26T18:56:20.090756] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T18:56:20.094072] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-26T18:56:20.188843] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T18:56:20.756748] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-26T18:56:21.031712] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T18:56:21.556735] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-26T18:56:22.319930] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T18:56:22.340936] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-26T18:56:22.345294] [INFO ] [REMOTE ] FTHY: Full fetch complete (17597 records). [2025-09-26T18:56:22.345449] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-26T18:56:22.383971] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-26T18:56:22.804901] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-26T18:56:22.805019] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-26T18:56:22.805421] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-26T18:56:22.805561] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-26T18:56:22.806526] [DEBUG] [LOCAL ] FTHY: Trimmed 17597 records to 11947 (keeping 200 days of data) [2025-09-26T18:56:22.891423] [DEBUG] [LOCAL ] FTHY: Primary data saved (11947 records). [2025-09-26T18:56:22.891575] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-26T18:56:22.891691] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTHY took 21.1s. Estimated remaining: 3h 17m 27s. Rate: 7.6 symbols/min [2025-09-26T18:56:24.206784] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-26T18:56:24.218470] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-26T18:56:25.959797] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T18:56:25.973416] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-26T18:56:27.823689] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T18:56:27.835411] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-26T18:56:29.796593] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T18:56:29.807474] [INFO ] [REMOTE ] FTI: Full fetch complete (77124 records). [2025-09-26T18:56:29.807706] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-26T18:56:30.239891] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-26T18:56:30.240021] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-26T18:56:30.241053] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-26T18:56:30.241123] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-26T18:56:30.242708] [DEBUG] [LOCAL ] FTI: Trimmed 77124 records to 54078 (keeping 200 days of data) [2025-09-26T18:56:30.602696] [DEBUG] [LOCAL ] FTI: Primary data saved (54078 records). [2025-09-26T18:56:30.602927] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-26T18:56:30.603039] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTI took 24.5s. Estimated remaining: 3h 17m 19s. Rate: 7.6 symbols/min [2025-09-26T18:56:31.259798] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:31.327234] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:31.333334] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:31.385435] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:31.394351] [DEBUG] [LOCAL ] FTWO: Loaded 1806 existing records from primary storage. [2025-09-26T18:56:31.394724] [INFO ] [MAIN ] FTWO: Loaded 1806 existing records. [2025-09-26T18:56:31.549458] [DEBUG] [LOCAL ] FTK: Loaded 32527 existing records from primary storage. [2025-09-26T18:56:31.582210] [INFO ] [MAIN ] FTK: Loaded 32527 existing records. [2025-09-26T18:56:31.747197] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:31.758875] [DEBUG] [LOCAL ] FTS: Loaded 42414 existing records from primary storage. [2025-09-26T18:56:31.826882] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-26T18:56:31.821521] [INFO ] [MAIN ] FTS: Loaded 42414 existing records. [2025-09-26T18:56:31.862761] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-26T18:56:31.874799] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-26T18:56:31.869071] [DEBUG] [LOCAL ] FTV: Loaded 53303 existing records from primary storage. [2025-09-26T18:56:31.974467] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-26T18:56:31.970921] [INFO ] [MAIN ] FTV: Loaded 53303 existing records. [2025-09-26T18:56:31.984469] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:32.099288] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-26T18:56:32.142608] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-26T18:56:32.234709] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-26T18:56:32.274287] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-26T18:56:32.504247] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:32.671180] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-26T18:56:32.690066] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-26T18:56:32.652001] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:32.716817] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-26T18:56:32.711601] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-26T18:56:32.733449] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-26T18:56:32.766247] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-26T18:56:32.849006] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-26T18:56:32.925000] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-26T18:56:33.355325] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:33.418625] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-26T18:56:33.570780] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:33.616877] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-26T18:56:33.964169] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:33.961345] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:33.964528] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-26T18:56:33.964826] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-26T18:56:34.186555] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T18:56:34.188279] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-26T18:56:34.883018] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-26T18:56:34.884732] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-26T18:56:35.002803] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:56:35.008150] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-26T18:56:35.441100] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T18:56:35.442616] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-26T18:56:35.551330] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T18:56:35.559735] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-26T18:56:35.702516] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T18:56:35.713731] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-26T18:56:35.764552] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-26T18:56:35.765834] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-26T18:56:36.001503] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T18:56:36.007280] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-26T18:56:36.107937] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-26T18:56:36.109234] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-26T18:56:36.403234] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-26T18:56:36.404318] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-26T18:56:36.703323] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T18:56:36.723719] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T18:56:36.739303] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-26T18:56:36.756727] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-26T18:56:36.974619] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T18:56:37.556753] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-26T18:56:38.356723] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-26T18:56:38.402943] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T18:56:38.795043] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T18:56:39.156744] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-26T18:56:39.851896] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-26T18:56:39.956762] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-26T18:56:40.317109] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T18:56:40.344478] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T18:56:40.756773] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-26T18:56:41.556714] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-26T18:56:41.907280] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T18:56:42.356760] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-26T18:56:43.150718] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:56:43.161536] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-26T18:56:43.577066] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T18:56:43.956745] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-26T18:56:44.292503] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-26T18:56:44.756760] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-26T18:56:45.173560] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-26T18:56:45.556749] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-26T18:56:45.878848] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-26T18:56:45.917748] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T18:56:46.356748] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-26T18:56:47.156730] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-26T18:56:47.709460] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T18:56:47.710542] [INFO ] [REMOTE ] FTWO: Full fetch complete (3466 records). [2025-09-26T18:56:47.710618] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-26T18:56:47.958113] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-26T18:56:48.106226] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-26T18:56:48.106432] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-26T18:56:48.106615] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-26T18:56:48.106706] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-26T18:56:48.107073] [DEBUG] [LOCAL ] FTWO: Trimmed 3466 records to 1837 (keeping 200 days of data) [2025-09-26T18:56:48.118678] [DEBUG] [LOCAL ] FTWO: Primary data saved (1837 records). [2025-09-26T18:56:48.118755] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-26T18:56:48.118835] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 17.5s. Estimated remaining: 3h 17m 27s. Rate: 7.5 symbols/min [2025-09-26T18:56:48.297607] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:48.330610] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T18:56:48.390551] [DEBUG] [LOCAL ] FUBO: Loaded 54088 existing records from primary storage. [2025-09-26T18:56:48.390779] [INFO ] [MAIN ] FUBO: Loaded 54088 existing records. [2025-09-26T18:56:48.575374] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:48.575667] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-26T18:56:48.575728] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-26T18:56:48.577119] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-26T18:56:48.577213] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-26T18:56:48.766019] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-26T18:56:48.949613] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:49.508508] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T18:56:49.556679] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-26T18:56:50.356703] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-26T18:56:50.428499] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T18:56:51.123521] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-26T18:56:51.156684] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-26T18:56:51.956723] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-26T18:56:52.300114] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T18:56:52.661848] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T18:56:52.756798] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-26T18:56:53.556735] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-26T18:56:53.721397] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T18:56:54.005637] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:56:54.015962] [INFO ] [REMOTE ] FTS: Full fetch complete (60082 records). [2025-09-26T18:56:54.016169] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-26T18:56:54.361877] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-26T18:56:54.523235] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-26T18:56:54.523335] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-26T18:56:54.524325] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-26T18:56:54.524414] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-26T18:56:54.526185] [DEBUG] [LOCAL ] FTS: Trimmed 60082 records to 42695 (keeping 200 days of data) [2025-09-26T18:56:54.809614] [DEBUG] [LOCAL ] FTS: Primary data saved (42695 records). [2025-09-26T18:56:54.809830] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-26T18:56:54.809971] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FTS took 24.2s. Estimated remaining: 3h 17m 17s. Rate: 7.5 symbols/min [2025-09-26T18:56:55.014695] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:56:55.037577] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T18:56:55.077716] [DEBUG] [LOCAL ] FUL: Loaded 33285 existing records from primary storage. [2025-09-26T18:56:55.077889] [INFO ] [MAIN ] FUL: Loaded 33285 existing records. [2025-09-26T18:56:55.161849] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-26T18:56:55.275211] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:56:55.275482] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-26T18:56:55.275532] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-26T18:56:55.276578] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-26T18:56:55.276678] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-26T18:56:55.674300] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:56:55.956761] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-26T18:56:56.271066] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T18:56:56.756797] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-26T18:56:56.820382] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T18:56:57.225214] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T18:56:57.556738] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-26T18:56:58.167212] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T18:56:58.356753] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-26T18:56:58.557045] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-26T18:56:59.156742] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-26T18:56:59.956731] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-26T18:57:00.300119] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-26T18:57:00.756742] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-26T18:57:00.857504] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T18:57:01.163780] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T18:57:01.171407] [INFO ] [REMOTE ] FTK: Full fetch complete (42697 records). [2025-09-26T18:57:01.171542] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-26T18:57:01.561840] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-26T18:57:01.685796] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-26T18:57:01.685895] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-26T18:57:01.686634] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-26T18:57:01.686739] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-26T18:57:01.688198] [DEBUG] [LOCAL ] FTK: Trimmed 42697 records to 32755 (keeping 200 days of data) [2025-09-26T18:57:01.910063] [DEBUG] [LOCAL ] FTK: Primary data saved (32755 records). [2025-09-26T18:57:01.910215] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-26T18:57:01.910308] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTK took 31.3s. Estimated remaining: 3h 17m 8s. Rate: 7.5 symbols/min [2025-09-26T18:57:02.097599] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:02.149693] [DEBUG] [LOCAL ] FUN: Loaded 51960 existing records from primary storage. [2025-09-26T18:57:02.149866] [INFO ] [MAIN ] FUN: Loaded 51960 existing records. [2025-09-26T18:57:02.342970] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:02.343245] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-26T18:57:02.343301] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-26T18:57:02.344831] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-26T18:57:02.344900] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-26T18:57:02.379018] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-26T18:57:02.819934] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:02.854719] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T18:57:02.960181] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T18:57:03.156733] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-26T18:57:03.956721] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-26T18:57:04.182717] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T18:57:04.194029] [INFO ] [REMOTE ] FTV: Full fetch complete (76285 records). [2025-09-26T18:57:04.194200] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-26T18:57:04.617602] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-26T18:57:04.617751] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-26T18:57:04.618816] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-26T18:57:04.618886] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-26T18:57:04.620913] [DEBUG] [LOCAL ] FTV: Trimmed 76285 records to 53686 (keeping 200 days of data) [2025-09-26T18:57:04.757679] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-26T18:57:04.977704] [DEBUG] [LOCAL ] FTV: Primary data saved (53686 records). [2025-09-26T18:57:04.977861] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-26T18:57:04.978617] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FTV took 34.4s. Estimated remaining: 3h 16m 52s. Rate: 7.6 symbols/min [2025-09-26T18:57:05.211016] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:05.214878] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T18:57:05.250438] [DEBUG] [LOCAL ] FVR: Loaded 22268 existing records from primary storage. [2025-09-26T18:57:05.250583] [INFO ] [MAIN ] FVR: Loaded 22268 existing records. [2025-09-26T18:57:05.460390] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:05.460867] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-26T18:57:05.461024] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-26T18:57:05.461860] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-26T18:57:05.461982] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-26T18:57:05.542076] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T18:57:05.567983] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-26T18:57:05.920223] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:06.146501] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T18:57:06.356732] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-26T18:57:07.159490] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-26T18:57:07.163990] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T18:57:07.584968] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-26T18:57:07.956760] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-26T18:57:08.421818] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T18:57:08.756781] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-26T18:57:09.556737] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-26T18:57:09.766517] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T18:57:09.874963] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T18:57:10.356728] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-26T18:57:10.686307] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T18:57:11.156760] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-26T18:57:11.804804] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T18:57:11.956738] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-26T18:57:12.756744] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-26T18:57:12.988925] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T18:57:13.556697] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-26T18:57:13.624144] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-26T18:57:14.189435] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T18:57:14.365460] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-26T18:57:14.369625] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-26T18:57:15.156760] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-26T18:57:15.956695] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-26T18:57:16.060968] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T18:57:16.596313] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T18:57:16.756710] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-26T18:57:17.556731] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-26T18:57:18.161511] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-26T18:57:18.360821] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-26T18:57:18.366982] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-26T18:57:19.027554] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-26T18:57:19.156715] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-26T18:57:19.190941] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T18:57:19.956733] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-26T18:57:20.568244] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-26T18:57:20.756702] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-26T18:57:21.062403] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T18:57:21.556757] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-26T18:57:22.356788] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-26T18:57:23.090357] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-26T18:57:23.101117] [INFO ] [REMOTE ] FUBO: Full fetch complete (77759 records). [2025-09-26T18:57:23.101267] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-26T18:57:23.170023] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-26T18:57:23.620831] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-26T18:57:23.623109] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T18:57:23.630028] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-26T18:57:23.654763] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-26T18:57:23.656874] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-26T18:57:23.656736] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T18:57:23.666090] [INFO ] [REMOTE ] FUL: Full fetch complete (47194 records). [2025-09-26T18:57:23.666516] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-26T18:57:23.666841] [DEBUG] [LOCAL ] FUBO: Trimmed 77759 records to 54476 (keeping 200 days of data) [2025-09-26T18:57:23.962630] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-26T18:57:24.215385] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-26T18:57:24.218471] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-26T18:57:24.224388] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-26T18:57:24.229456] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-26T18:57:24.229543] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-26T18:57:24.239302] [DEBUG] [LOCAL ] FUL: Trimmed 47194 records to 33570 (keeping 200 days of data) [2025-09-26T18:57:24.559960] [DEBUG] [LOCAL ] FUL: Primary data saved (33570 records). [2025-09-26T18:57:24.561020] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-26T18:57:24.561423] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FUL took 29.8s. Estimated remaining: 3h 17m 3s. Rate: 7.5 symbols/min [2025-09-26T18:57:24.775855] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:24.767765] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-26T18:57:24.885315] [DEBUG] [LOCAL ] FUBO: Primary data saved (54476 records). [2025-09-26T18:57:24.885526] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-26T18:57:24.885704] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FUBO took 36.8s. Estimated remaining: 3h 16m 43s. Rate: 7.5 symbols/min [2025-09-26T18:57:25.011447] [DEBUG] [LOCAL ] FVRR: Loaded 40472 existing records from primary storage. [2025-09-26T18:57:25.017441] [INFO ] [MAIN ] FVRR: Loaded 40472 existing records. [2025-09-26T18:57:25.186455] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:25.198988] [DEBUG] [LOCAL ] FXED: No existing data file found in primary storage. [2025-09-26T18:57:25.199397] [WARN ] [MAIN ] FXED: No existing data found, performing full refresh instead. [2025-09-26T18:57:25.210373] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-26T18:57:25.220774] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-26T18:57:25.240071] [DEBUG] [LOCAL ] FXED: No primary data file found to delete. [2025-09-26T18:57:25.240137] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-26T18:57:25.346089] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:25.385363] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-26T18:57:25.393364] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-26T18:57:25.403629] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-26T18:57:25.414037] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-26T18:57:26.019996] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:26.051841] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-26T18:57:26.127628] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T18:57:26.254503] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:26.257400] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-26T18:57:26.356735] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-26T18:57:26.719131] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T18:57:27.156721] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-26T18:57:27.947062] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T18:57:27.956689] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-26T18:57:28.756688] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-26T18:57:29.145309] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T18:57:29.262022] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-26T18:57:29.273047] [INFO ] [REMOTE ] FUN: Full fetch complete (72662 records). [2025-09-26T18:57:29.273200] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-26T18:57:29.562572] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-26T18:57:29.710014] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-26T18:57:29.710109] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-26T18:57:29.711013] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-26T18:57:29.711079] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-26T18:57:29.712565] [DEBUG] [LOCAL ] FUN: Trimmed 72662 records to 52349 (keeping 200 days of data) [2025-09-26T18:57:29.973609] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-26T18:57:30.069970] [DEBUG] [LOCAL ] FUN: Primary data saved (52349 records). [2025-09-26T18:57:30.070135] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-26T18:57:30.070279] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FUN took 28.2s. Estimated remaining: 3h 16m 30s. Rate: 7.6 symbols/min [2025-09-26T18:57:30.256989] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:30.307487] [DEBUG] [LOCAL ] G: Loaded 50170 existing records from primary storage. [2025-09-26T18:57:30.307757] [INFO ] [MAIN ] G: Loaded 50170 existing records. [2025-09-26T18:57:30.361804] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-26T18:57:30.451598] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-26T18:57:30.540928] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:30.541280] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-26T18:57:30.541333] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-26T18:57:30.543070] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-26T18:57:30.543142] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-26T18:57:30.853823] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-26T18:57:30.939044] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:31.156723] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-26T18:57:31.496223] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-26T18:57:31.956716] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-26T18:57:32.756730] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-26T18:57:33.512519] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T18:57:33.559974] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-26T18:57:33.562157] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T18:57:34.356759] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-26T18:57:35.159123] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-26T18:57:35.165208] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T18:57:35.686109] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T18:57:35.956750] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-26T18:57:36.311678] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T18:57:36.756758] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-26T18:57:37.134797] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T18:57:37.467611] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T18:57:37.471809] [INFO ] [REMOTE ] FVR: Full fetch complete (30421 records). [2025-09-26T18:57:37.471944] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-26T18:57:37.561809] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-26T18:57:37.891789] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-26T18:57:37.891875] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-26T18:57:37.892457] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-26T18:57:37.892529] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-26T18:57:37.893398] [DEBUG] [LOCAL ] FVR: Trimmed 30421 records to 22328 (keeping 200 days of data) [2025-09-26T18:57:38.031961] [DEBUG] [LOCAL ] FVR: Primary data saved (22328 records). [2025-09-26T18:57:38.032098] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-26T18:57:38.032199] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FVR took 33.1s. Estimated remaining: 3h 16m 22s. Rate: 7.6 symbols/min [2025-09-26T18:57:38.224365] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:38.252179] [DEBUG] [LOCAL ] GAB: Loaded 28167 existing records from primary storage. [2025-09-26T18:57:38.252323] [INFO ] [MAIN ] GAB: Loaded 28167 existing records. [2025-09-26T18:57:38.361802] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-26T18:57:38.458732] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:38.459033] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-26T18:57:38.459135] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-26T18:57:38.460063] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-26T18:57:38.460126] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-26T18:57:38.861466] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T18:57:38.867721] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:39.160040] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-26T18:57:39.162821] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T18:57:39.519304] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T18:57:39.956749] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-26T18:57:40.756724] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-26T18:57:41.424957] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T18:57:41.556710] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-26T18:57:41.921431] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T18:57:42.356736] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-26T18:57:42.692906] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T18:57:43.156699] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-26T18:57:43.258487] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T18:57:43.956728] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-26T18:57:44.757186] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-26T18:57:44.757019] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T18:57:45.186431] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-26T18:57:45.556739] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-26T18:57:45.695845] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T18:57:46.356803] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-26T18:57:47.156708] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-26T18:57:47.198185] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:57:47.206431] [INFO ] [REMOTE ] FVRR: Full fetch complete (58753 records). [2025-09-26T18:57:47.206596] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-26T18:57:47.626046] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-26T18:57:47.626124] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-26T18:57:47.626916] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-26T18:57:47.626985] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-26T18:57:47.628596] [DEBUG] [LOCAL ] FVRR: Trimmed 58753 records to 40749 (keeping 200 days of data) [2025-09-26T18:57:47.870785] [DEBUG] [LOCAL ] FVRR: Primary data saved (40749 records). [2025-09-26T18:57:47.870921] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-26T18:57:47.871017] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. FVRR took 23.3s. Estimated remaining: 3h 16m 17s. Rate: 7.6 symbols/min [2025-09-26T18:57:47.962747] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-26T18:57:48.068247] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:48.101669] [DEBUG] [LOCAL ] GAM: Loaded 4142 existing records from primary storage. [2025-09-26T18:57:48.105674] [INFO ] [MAIN ] GAM: Loaded 4142 existing records. [2025-09-26T18:57:48.162233] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T18:57:48.280764] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T18:57:48.327512] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-26T18:57:48.386851] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:48.387121] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-26T18:57:48.387217] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-26T18:57:48.387545] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-26T18:57:48.387606] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-26T18:57:48.761883] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-26T18:57:48.793963] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:49.231959] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T18:57:49.556724] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-26T18:57:50.356727] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-26T18:57:50.626631] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-26T18:57:50.774863] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-26T18:57:50.775801] [INFO ] [REMOTE ] FXED: Full fetch complete (1798 records). [2025-09-26T18:57:50.775876] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-26T18:57:51.161881] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-26T18:57:51.204465] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-26T18:57:51.204564] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-26T18:57:51.204708] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-26T18:57:51.204772] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-26T18:57:51.205152] [DEBUG] [LOCAL ] FXED: Trimmed 1798 records to 1259 (keeping 200 days of data) [2025-09-26T18:57:51.214218] [DEBUG] [LOCAL ] FXED: Primary data saved (1259 records). [2025-09-26T18:57:51.214291] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-26T18:57:51.214417] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. FXED took 26.3s. Estimated remaining: 3h 16m 2s. Rate: 7.6 symbols/min [2025-09-26T18:57:51.402513] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:57:51.457789] [DEBUG] [LOCAL ] GAP: Loaded 54045 existing records from primary storage. [2025-09-26T18:57:51.457972] [INFO ] [MAIN ] GAP: Loaded 54045 existing records. [2025-09-26T18:57:51.653692] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:57:51.653965] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-26T18:57:51.654015] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-26T18:57:51.655517] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-26T18:57:51.655595] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-26T18:57:51.963545] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-26T18:57:52.100155] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:57:52.520346] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T18:57:52.756782] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-26T18:57:53.437725] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T18:57:53.556731] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-26T18:57:54.356771] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-26T18:57:54.815732] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T18:57:54.965837] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T18:57:55.156722] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-26T18:57:55.956733] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-26T18:57:56.086284] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T18:57:56.467624] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-26T18:57:56.756760] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-26T18:57:57.415744] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T18:57:57.556741] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-26T18:57:57.979325] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T18:57:57.996964] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-26T18:57:58.356753] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-26T18:57:59.156777] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-26T18:57:59.597721] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T18:57:59.956729] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-26T18:58:00.756702] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-26T18:58:00.936541] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T18:58:00.991549] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T18:58:01.556722] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-26T18:58:02.356704] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-26T18:58:02.451177] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T18:58:02.742000] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T18:58:03.156750] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-26T18:58:03.688891] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T18:58:03.956737] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-26T18:58:04.091950] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T18:58:04.448290] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-26T18:58:04.756728] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-26T18:58:05.503416] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T18:58:05.556701] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-26T18:58:06.103792] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:58:06.356793] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-26T18:58:07.156749] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-26T18:58:07.956838] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-26T18:58:08.328239] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T18:58:08.578054] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T18:58:08.756768] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-26T18:58:08.904089] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T18:58:09.556736] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-26T18:58:09.730567] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T18:58:09.737018] [INFO ] [REMOTE ] GAB: Full fetch complete (39665 records). [2025-09-26T18:58:09.737213] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-26T18:58:10.165364] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-26T18:58:10.165468] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-26T18:58:10.166143] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-26T18:58:10.166226] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-26T18:58:10.167364] [DEBUG] [LOCAL ] GAB: Trimmed 39665 records to 28493 (keeping 200 days of data) [2025-09-26T18:58:10.258921] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-26T18:58:10.350488] [DEBUG] [LOCAL ] GAB: Primary data saved (28493 records). [2025-09-26T18:58:10.350667] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-26T18:58:10.350782] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. GAB took 32.3s. Estimated remaining: 3h 16m 12s. Rate: 7.5 symbols/min [2025-09-26T18:58:10.361901] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-26T18:58:10.539492] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:10.562297] [DEBUG] [LOCAL ] GATX: Loaded 18290 existing records from primary storage. [2025-09-26T18:58:10.562441] [INFO ] [MAIN ] GATX: Loaded 18290 existing records. [2025-09-26T18:58:10.753071] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:10.753389] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-26T18:58:10.753473] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-26T18:58:10.754313] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-26T18:58:10.754390] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-26T18:58:11.067452] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T18:58:11.150714] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:11.156679] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-26T18:58:11.956800] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-26T18:58:12.216593] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T18:58:12.540750] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T18:58:12.756741] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-26T18:58:13.556741] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-26T18:58:13.806146] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T18:58:14.035939] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-26T18:58:14.037540] [INFO ] [REMOTE ] GAM: Full fetch complete (6855 records). [2025-09-26T18:58:14.037627] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-26T18:58:14.365028] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-26T18:58:14.470243] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-26T18:58:14.470328] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-26T18:58:14.470516] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-26T18:58:14.470556] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-26T18:58:14.471188] [DEBUG] [LOCAL ] GAM: Trimmed 6855 records to 4174 (keeping 200 days of data) [2025-09-26T18:58:14.497045] [DEBUG] [LOCAL ] GAM: Primary data saved (4174 records). [2025-09-26T18:58:14.497240] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-26T18:58:14.497366] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAM took 26.6s. Estimated remaining: 3h 15m 58s. Rate: 7.5 symbols/min [2025-09-26T18:58:14.692302] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:14.709333] [DEBUG] [LOCAL ] GBAB: Loaded 13056 existing records from primary storage. [2025-09-26T18:58:14.709474] [INFO ] [MAIN ] GBAB: Loaded 13056 existing records. [2025-09-26T18:58:14.900115] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:14.900376] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-26T18:58:14.900425] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-26T18:58:14.900967] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-26T18:58:14.901029] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-26T18:58:15.162466] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-26T18:58:15.288228] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:15.956694] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-26T18:58:16.494007] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-26T18:58:16.707761] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T18:58:16.719989] [INFO ] [REMOTE ] G: Full fetch complete (71596 records). [2025-09-26T18:58:16.720190] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-26T18:58:16.761248] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-26T18:58:17.158326] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-26T18:58:17.158453] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-26T18:58:17.159513] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-26T18:58:17.159609] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-26T18:58:17.174617] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T18:58:17.181083] [DEBUG] [LOCAL ] G: Trimmed 71596 records to 50547 (keeping 200 days of data) [2025-09-26T18:58:17.509062] [DEBUG] [LOCAL ] G: Primary data saved (50547 records). [2025-09-26T18:58:17.509274] [INFO ] [MAIN ] G: Full history saved. [2025-09-26T18:58:17.509385] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. G took 47.4s. Estimated remaining: 3h 15m 42s. Rate: 7.6 symbols/min [2025-09-26T18:58:17.558788] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-26T18:58:17.715939] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:17.729191] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T18:58:17.772970] [DEBUG] [LOCAL ] GBCI: Loaded 40385 existing records from primary storage. [2025-09-26T18:58:17.773170] [INFO ] [MAIN ] GBCI: Loaded 40385 existing records. [2025-09-26T18:58:17.974978] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:17.975316] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-26T18:58:17.975373] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-26T18:58:17.976629] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-26T18:58:17.976735] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-26T18:58:18.366112] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-26T18:58:18.372160] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:19.156794] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-26T18:58:19.274428] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-26T18:58:19.463471] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T18:58:19.835478] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-26T18:58:19.956765] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-26T18:58:20.756741] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-26T18:58:21.556706] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-26T18:58:21.700040] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T18:58:21.904797] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T18:58:22.356739] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-26T18:58:22.952495] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T18:58:23.156728] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-26T18:58:23.956703] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-26T18:58:23.986505] [DEBUG] [REMOTE ] GATX: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-26T18:58:23.994283] [WARN ] [REMOTE ] GATX: No data returned for month 2025-05 [2025-09-26T18:58:24.009111] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:58:24.756736] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-26T18:58:25.466860] [DEBUG] [REMOTE ] GAP: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-26T18:58:25.467075] [WARN ] [REMOTE ] GAP: No data returned for month 2025-08 [2025-09-26T18:58:25.556726] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-26T18:58:26.267610] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T18:58:26.356714] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-26T18:58:27.156718] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-26T18:58:27.432633] [DEBUG] [REMOTE ] GBCI: Error fetching primary data for 2025-02: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-26T18:58:27.432968] [WARN ] [REMOTE ] GBCI: No data returned for month 2025-02 [2025-09-26T18:58:27.467630] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T18:58:27.482141] [INFO ] [REMOTE ] GAP: Full fetch complete (69448 records). [2025-09-26T18:58:27.482353] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-26T18:58:27.706891] [WARN ] [VALIDATOR ] GAP: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T18:58:27.707818] [FATAL] [MAIN ] GAP: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:58:27.707942] [WARN ] [MAIN ] GAP: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:58:27.708115] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-26T18:58:27.708212] [DEBUG] [LOCAL ] GAP: No primary data file found to delete. [2025-09-26T18:58:27.708273] [INFO ] [LOCAL ] GAP: Starting deletion of derivative data. [2025-09-26T18:58:27.708923] [DEBUG] [LOCAL ] GAP: Deleted derivative data file. [2025-09-26T18:58:27.709147] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GAP took 36.5s. Estimated remaining: 3h 15m 38s. Rate: 7.5 symbols/min [2025-09-26T18:58:27.904105] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:27.904330] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-26T18:58:27.904387] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-26T18:58:27.904591] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-26T18:58:27.904672] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-26T18:58:27.904745] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-26T18:58:27.904782] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-26T18:58:27.963308] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-26T18:58:28.072342] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T18:58:28.312623] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:28.756696] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-26T18:58:29.061936] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T18:58:29.556727] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-26T18:58:29.740940] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T18:58:30.034075] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-26T18:58:30.356721] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-26T18:58:31.156738] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-26T18:58:31.177464] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T18:58:31.686671] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-26T18:58:31.956776] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-26T18:58:32.756730] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-26T18:58:32.993864] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T18:58:33.556726] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-26T18:58:34.237779] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:58:34.356749] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-26T18:58:34.601365] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-26T18:58:34.687600] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-26T18:58:35.156740] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-26T18:58:35.956732] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-26T18:58:36.115925] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T18:58:36.297464] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-26T18:58:36.756772] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-26T18:58:37.556722] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-26T18:58:37.777750] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T18:58:38.356749] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-26T18:58:39.096364] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T18:58:39.156800] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-26T18:58:39.594815] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T18:58:39.602201] [INFO ] [REMOTE ] GATX: Full fetch complete (22643 records). [2025-09-26T18:58:39.602384] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-26T18:58:39.708782] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T18:58:39.919976] [WARN ] [VALIDATOR ] GATX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T18:58:39.920675] [FATAL] [MAIN ] GATX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:58:39.920755] [WARN ] [MAIN ] GATX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:58:39.920869] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-26T18:58:39.920974] [DEBUG] [LOCAL ] GATX: No primary data file found to delete. [2025-09-26T18:58:39.921079] [INFO ] [LOCAL ] GATX: Starting deletion of derivative data. [2025-09-26T18:58:39.921856] [DEBUG] [LOCAL ] GATX: Deleted derivative data file. [2025-09-26T18:58:39.922033] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GATX took 29.6s. Estimated remaining: 3h 15m 37s. Rate: 7.5 symbols/min [2025-09-26T18:58:39.961931] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-26T18:58:40.121863] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:40.179404] [DEBUG] [LOCAL ] GBTG: Loaded 40531 existing records from primary storage. [2025-09-26T18:58:40.179557] [INFO ] [MAIN ] GBTG: Loaded 40531 existing records. [2025-09-26T18:58:40.370355] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:40.370608] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-26T18:58:40.370686] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-26T18:58:40.371839] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-26T18:58:40.371903] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-26T18:58:40.752930] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:40.756678] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-26T18:58:41.485307] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T18:58:41.556730] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-26T18:58:42.136538] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T18:58:42.356747] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-26T18:58:42.879531] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T18:58:43.156768] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-26T18:58:43.794308] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T18:58:43.956726] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-26T18:58:44.756734] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-26T18:58:44.807734] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T18:58:45.237614] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T18:58:45.352391] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T18:58:45.556722] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-26T18:58:45.988235] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-26T18:58:46.356731] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-26T18:58:46.628000] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-26T18:58:47.156752] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-26T18:58:47.956771] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-26T18:58:48.653456] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T18:58:48.752376] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T18:58:48.756675] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-26T18:58:49.556740] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-26T18:58:49.693739] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T18:58:49.697833] [INFO ] [REMOTE ] GBAB: Full fetch complete (20050 records). [2025-09-26T18:58:49.697942] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-26T18:58:50.086280] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-26T18:58:50.086410] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-26T18:58:50.086981] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-26T18:58:50.087051] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-26T18:58:50.087992] [DEBUG] [LOCAL ] GBAB: Trimmed 20050 records to 13142 (keeping 200 days of data) [2025-09-26T18:58:50.181307] [DEBUG] [LOCAL ] GBAB: Primary data saved (13142 records). [2025-09-26T18:58:50.181468] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-26T18:58:50.181581] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBAB took 35.7s. Estimated remaining: 3h 15m 33s. Rate: 7.5 symbols/min [2025-09-26T18:58:50.363518] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-26T18:58:50.367437] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:50.416550] [DEBUG] [LOCAL ] GBX: Loaded 29340 existing records from primary storage. [2025-09-26T18:58:50.416745] [INFO ] [MAIN ] GBX: Loaded 29340 existing records. [2025-09-26T18:58:50.611078] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:50.611415] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-26T18:58:50.611488] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-26T18:58:50.612414] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-26T18:58:50.612480] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-26T18:58:51.006420] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:51.032435] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:58:51.156744] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-26T18:58:51.956742] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-26T18:58:52.001312] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T18:58:52.009828] [INFO ] [REMOTE ] GBCI: Full fetch complete (52469 records). [2025-09-26T18:58:52.009993] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-26T18:58:52.224685] [WARN ] [VALIDATOR ] GBCI: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T18:58:52.225355] [FATAL] [MAIN ] GBCI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:58:52.225435] [WARN ] [MAIN ] GBCI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:58:52.225544] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-26T18:58:52.225638] [DEBUG] [LOCAL ] GBCI: No primary data file found to delete. [2025-09-26T18:58:52.225723] [INFO ] [LOCAL ] GBCI: Starting deletion of derivative data. [2025-09-26T18:58:52.226077] [DEBUG] [LOCAL ] GBCI: Deleted derivative data file. [2025-09-26T18:58:52.226207] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBCI took 34.7s. Estimated remaining: 3h 15m 15s. Rate: 7.5 symbols/min [2025-09-26T18:58:52.445045] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:52.447946] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T18:58:52.500589] [DEBUG] [LOCAL ] GCI: Loaded 44530 existing records from primary storage. [2025-09-26T18:58:52.500795] [INFO ] [MAIN ] GCI: Loaded 44530 existing records. [2025-09-26T18:58:52.688044] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:52.688300] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-26T18:58:52.688349] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-26T18:58:52.689588] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-26T18:58:52.689683] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-26T18:58:52.761821] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-26T18:58:53.078890] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:53.107707] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T18:58:53.146049] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-26T18:58:53.556720] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-26T18:58:54.356742] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-26T18:58:54.901905] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T18:58:55.156779] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-26T18:58:55.775401] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T18:58:55.956698] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-26T18:58:56.373604] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-26T18:58:56.756738] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-26T18:58:57.314129] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T18:58:57.556751] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-26T18:58:57.823162] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T18:58:58.356760] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-26T18:58:58.793212] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-26T18:58:58.794029] [INFO ] [REMOTE ] GBLI: Full fetch complete (1330 records). [2025-09-26T18:58:58.794099] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-26T18:58:58.986201] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-26T18:58:58.986542] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:58:58.986621] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:58:58.986715] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-26T18:58:58.986961] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-26T18:58:58.987022] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-26T18:58:59.010629] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-26T18:58:59.010875] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBLI took 31.3s. Estimated remaining: 3h 15m 5s. Rate: 7.6 symbols/min [2025-09-26T18:58:59.012802] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T18:58:59.165917] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-26T18:58:59.199353] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:58:59.228507] [DEBUG] [LOCAL ] GCO: Loaded 25567 existing records from primary storage. [2025-09-26T18:58:59.228670] [INFO ] [MAIN ] GCO: Loaded 25567 existing records. [2025-09-26T18:58:59.410418] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:58:59.410704] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-26T18:58:59.410762] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-26T18:58:59.411476] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-26T18:58:59.411538] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-26T18:58:59.784583] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:58:59.956776] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-26T18:59:00.657523] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T18:59:00.756737] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-26T18:59:01.103994] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T18:59:01.556737] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-26T18:59:02.356711] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-26T18:59:02.469540] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T18:59:03.031932] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T18:59:03.156704] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-26T18:59:03.510141] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T18:59:03.956760] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-26T18:59:04.529198] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T18:59:04.644024] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T18:59:04.756735] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-26T18:59:05.556755] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-26T18:59:06.365986] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-26T18:59:06.387059] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T18:59:06.606274] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T18:59:07.156738] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-26T18:59:07.813486] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T18:59:07.956743] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-26T18:59:08.611822] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T18:59:08.678982] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T18:59:08.756780] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-26T18:59:09.545920] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T18:59:09.556673] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-26T18:59:10.356761] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-26T18:59:10.787484] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T18:59:10.792893] [INFO ] [REMOTE ] GBX: Full fetch complete (42746 records). [2025-09-26T18:59:10.793059] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-26T18:59:11.164408] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-26T18:59:11.209864] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-26T18:59:11.209973] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-26T18:59:11.210690] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-26T18:59:11.210755] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-26T18:59:11.211925] [DEBUG] [LOCAL ] GBX: Trimmed 42746 records to 29497 (keeping 200 days of data) [2025-09-26T18:59:11.406858] [DEBUG] [LOCAL ] GBX: Primary data saved (29497 records). [2025-09-26T18:59:11.407014] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-26T18:59:11.407105] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GBX took 21.2s. Estimated remaining: 3h 15m 5s. Rate: 7.5 symbols/min [2025-09-26T18:59:11.596298] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:11.617402] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T18:59:11.646508] [DEBUG] [LOCAL ] GCTS: Loaded 19961 existing records from primary storage. [2025-09-26T18:59:11.646757] [INFO ] [MAIN ] GCTS: Loaded 19961 existing records. [2025-09-26T18:59:11.855020] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:11.855350] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-26T18:59:11.855404] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-26T18:59:11.856195] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-26T18:59:11.856259] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-26T18:59:11.963081] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-26T18:59:12.234805] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:12.621186] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T18:59:12.756793] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-26T18:59:13.477241] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T18:59:13.531780] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T18:59:13.556683] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-26T18:59:14.356717] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-26T18:59:14.614923] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T18:59:15.156748] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-26T18:59:15.870503] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T18:59:15.878592] [INFO ] [REMOTE ] GBTG: Full fetch complete (56631 records). [2025-09-26T18:59:15.878746] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-26T18:59:15.963208] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-26T18:59:16.311537] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-26T18:59:16.311828] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-26T18:59:16.312750] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-26T18:59:16.312818] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-26T18:59:16.315194] [DEBUG] [LOCAL ] GBTG: Trimmed 56631 records to 40807 (keeping 200 days of data) [2025-09-26T18:59:16.596517] [DEBUG] [LOCAL ] GBTG: Primary data saved (40807 records). [2025-09-26T18:59:16.596682] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-26T18:59:16.597748] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GBTG took 36.7s. Estimated remaining: 3h 14m 52s. Rate: 7.5 symbols/min [2025-09-26T18:59:16.764302] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-26T18:59:16.809507] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T18:59:16.841820] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T18:59:16.840189] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:16.860465] [DEBUG] [LOCAL ] GCV: Loaded 7245 existing records from primary storage. [2025-09-26T18:59:16.860699] [INFO ] [MAIN ] GCV: Loaded 7245 existing records. [2025-09-26T18:59:17.056479] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:17.056824] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-26T18:59:17.056879] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-26T18:59:17.057310] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-26T18:59:17.057372] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-26T18:59:17.470080] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:17.556681] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-26T18:59:18.083630] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T18:59:18.257500] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T18:59:18.356724] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-26T18:59:19.156732] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-26T18:59:19.880973] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T18:59:19.956700] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-26T18:59:20.074142] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T18:59:20.756721] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-26T18:59:21.358135] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T18:59:21.423624] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T18:59:21.556743] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-26T18:59:22.356722] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-26T18:59:22.965277] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T18:59:22.980349] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-26T18:59:22.983113] [INFO ] [REMOTE ] GCI: Full fetch complete (63120 records). [2025-09-26T18:59:22.983370] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-26T18:59:23.163995] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-26T18:59:23.401676] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-26T18:59:23.401799] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-26T18:59:23.403042] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-26T18:59:23.403113] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-26T18:59:23.405232] [DEBUG] [LOCAL ] GCI: Trimmed 63120 records to 44828 (keeping 200 days of data) [2025-09-26T18:59:23.670620] [DEBUG] [LOCAL ] GCI: Primary data saved (44828 records). [2025-09-26T18:59:23.670834] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-26T18:59:23.670971] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCI took 31.4s. Estimated remaining: 3h 14m 43s. Rate: 7.5 symbols/min [2025-09-26T18:59:23.849383] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:23.900093] [DEBUG] [LOCAL ] GD: Loaded 47620 existing records from primary storage. [2025-09-26T18:59:23.900332] [INFO ] [MAIN ] GD: Loaded 47620 existing records. [2025-09-26T18:59:23.964007] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-26T18:59:24.085668] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:24.085968] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-26T18:59:24.086019] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-26T18:59:24.087683] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-26T18:59:24.087747] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-26T18:59:24.434777] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-26T18:59:24.482542] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:24.489143] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T18:59:24.756780] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-26T18:59:25.556736] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-26T18:59:26.356741] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-26T18:59:26.471677] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T18:59:26.524282] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T18:59:27.085463] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T18:59:27.156715] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-26T18:59:27.888474] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T18:59:27.956738] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-26T18:59:28.756702] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-26T18:59:29.065706] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T18:59:29.480363] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T18:59:29.556724] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-26T18:59:30.059617] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-26T18:59:30.356724] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-26T18:59:31.156717] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-26T18:59:31.541693] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T18:59:31.956764] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-26T18:59:32.701409] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-26T18:59:32.756676] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-26T18:59:33.009070] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T18:59:33.556705] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-26T18:59:33.694904] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T18:59:33.697430] [INFO ] [REMOTE ] GCV: Full fetch complete (9256 records). [2025-09-26T18:59:33.697515] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-26T18:59:33.698083] [FATAL] [VALIDATOR ] GCV: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T18:59:33.698224] [FATAL] [MAIN ] GCV: Fetched primary data is invalid. Refusing to save it. [2025-09-26T18:59:33.698295] [WARN ] [MAIN ] GCV: Deleting existing primary and derivative data due to validation failure. [2025-09-26T18:59:33.698406] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-26T18:59:33.698496] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-09-26T18:59:33.698554] [INFO ] [LOCAL ] GCV: Starting deletion of derivative data. [2025-09-26T18:59:33.699073] [DEBUG] [LOCAL ] GCV: Deleted derivative data file. [2025-09-26T18:59:33.699202] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCV took 17.1s. Estimated remaining: 3h 14m 38s. Rate: 7.5 symbols/min [2025-09-26T18:59:33.889301] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:33.942564] [DEBUG] [LOCAL ] GDDY: Loaded 50073 existing records from primary storage. [2025-09-26T18:59:33.942780] [INFO ] [MAIN ] GDDY: Loaded 50073 existing records. [2025-09-26T18:59:34.144538] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:34.144814] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-26T18:59:34.144867] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-26T18:59:34.146363] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-26T18:59:34.146429] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-26T18:59:34.361931] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-26T18:59:34.579016] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:34.939956] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T18:59:35.156794] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-26T18:59:35.511178] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T18:59:35.956730] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-26T18:59:36.756742] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-26T18:59:36.939162] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T18:59:37.556747] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-26T18:59:37.605101] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T18:59:37.813974] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T18:59:38.356723] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-26T18:59:39.156701] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-26T18:59:39.340543] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T18:59:39.462967] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T18:59:39.956793] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-26T18:59:40.756711] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-26T18:59:40.797867] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T18:59:41.556704] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-26T18:59:41.902977] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T18:59:41.961981] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-26T18:59:42.356746] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-26T18:59:43.156743] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-26T18:59:43.260389] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T18:59:43.956733] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-26T18:59:44.150368] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T18:59:44.193349] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T18:59:44.198453] [INFO ] [REMOTE ] GCO: Full fetch complete (35752 records). [2025-09-26T18:59:44.198564] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-26T18:59:44.597427] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-26T18:59:44.597514] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-26T18:59:44.598205] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-26T18:59:44.598270] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-26T18:59:44.599256] [DEBUG] [LOCAL ] GCO: Trimmed 35752 records to 25686 (keeping 200 days of data) [2025-09-26T18:59:44.763774] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-26T18:59:44.775895] [DEBUG] [LOCAL ] GCO: Primary data saved (25686 records). [2025-09-26T18:59:44.776051] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-26T18:59:44.776165] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GCO took 45.8s. Estimated remaining: 3h 14m 35s. Rate: 7.5 symbols/min [2025-09-26T18:59:44.971464] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:44.977942] [DEBUG] [LOCAL ] GDIV: Loaded 3707 existing records from primary storage. [2025-09-26T18:59:44.978044] [INFO ] [MAIN ] GDIV: Loaded 3707 existing records. [2025-09-26T18:59:45.196117] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:45.201916] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-26T18:59:45.208849] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-26T18:59:45.209599] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-26T18:59:45.209721] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-26T18:59:45.210143] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T18:59:45.277849] [INFO ] [REMOTE ] GCTS: Full fetch complete (27043 records). [2025-09-26T18:59:45.292688] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-26T18:59:45.581898] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-26T18:59:46.044599] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:46.057976] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-26T18:59:46.058040] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-26T18:59:46.058616] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-26T18:59:46.058728] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-26T18:59:46.059453] [DEBUG] [LOCAL ] GCTS: Trimmed 27043 records to 20060 (keeping 200 days of data) [2025-09-26T18:59:46.177011] [DEBUG] [LOCAL ] GCTS: Primary data saved (20060 records). [2025-09-26T18:59:46.177171] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-26T18:59:46.177301] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GCTS took 34.8s. Estimated remaining: 3h 14m 17s. Rate: 7.6 symbols/min [2025-09-26T18:59:46.359436] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:46.357964] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-26T18:59:46.364811] [DEBUG] [LOCAL ] GDL: Loaded 2556 existing records from primary storage. [2025-09-26T18:59:46.364949] [INFO ] [MAIN ] GDL: Loaded 2556 existing records. [2025-09-26T18:59:46.578497] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:46.579031] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-26T18:59:46.579102] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-26T18:59:46.579513] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-26T18:59:46.579576] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-26T18:59:46.809759] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T18:59:47.012679] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:47.006941] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T18:59:47.156692] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-26T18:59:47.596661] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T18:59:47.956736] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-26T18:59:48.528972] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T18:59:48.756711] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-26T18:59:49.008956] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T18:59:49.167263] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T18:59:49.556723] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-26T18:59:50.356734] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-26T18:59:51.156788] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-26T18:59:51.290930] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T18:59:51.927458] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T18:59:51.956770] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-26T18:59:52.117777] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T18:59:52.330130] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-26T18:59:52.756743] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-26T18:59:53.194760] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T18:59:53.556740] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-26T18:59:54.010709] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-26T18:59:54.356752] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-26T18:59:55.156764] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-26T18:59:55.728043] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T18:59:55.956723] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-26T18:59:56.089015] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T18:59:56.756735] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-26T18:59:57.119285] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-26T18:59:57.556742] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-26T18:59:57.787888] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T18:59:57.799545] [INFO ] [REMOTE ] GD: Full fetch complete (70452 records). [2025-09-26T18:59:57.799773] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-26T18:59:57.958111] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T18:59:58.224349] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-26T18:59:58.224467] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-26T18:59:58.225508] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-26T18:59:58.225578] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-26T18:59:58.227155] [DEBUG] [LOCAL ] GD: Trimmed 70452 records to 47940 (keeping 200 days of data) [2025-09-26T18:59:58.356736] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-26T18:59:58.531716] [DEBUG] [LOCAL ] GD: Primary data saved (47940 records). [2025-09-26T18:59:58.531870] [INFO ] [MAIN ] GD: Full history saved. [2025-09-26T18:59:58.531998] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GD took 34.9s. Estimated remaining: 3h 14m 16s. Rate: 7.5 symbols/min [2025-09-26T18:59:58.710980] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T18:59:58.720034] [DEBUG] [LOCAL ] GDO: Loaded 6055 existing records from primary storage. [2025-09-26T18:59:58.720168] [INFO ] [MAIN ] GDO: Loaded 6055 existing records. [2025-09-26T18:59:58.908902] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T18:59:58.909317] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-26T18:59:58.913199] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-26T18:59:58.913367] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T18:59:58.915016] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-26T18:59:58.915095] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-26T18:59:59.161864] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-26T18:59:59.303779] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T18:59:59.715260] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-26T18:59:59.956743] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-26T19:00:00.460747] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T19:00:00.756756] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-26T19:00:01.556733] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-26T19:00:01.749006] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T19:00:02.356769] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-26T19:00:03.118795] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T19:00:03.156726] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-26T19:00:03.369194] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T19:00:03.956761] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-26T19:00:03.990741] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-26T19:00:03.992155] [INFO ] [REMOTE ] GDL: Full fetch complete (3688 records). [2025-09-26T19:00:03.992231] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-26T19:00:04.384586] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-26T19:00:04.384699] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-26T19:00:04.384854] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-26T19:00:04.384897] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-26T19:00:04.385321] [DEBUG] [LOCAL ] GDL: Trimmed 3688 records to 2572 (keeping 200 days of data) [2025-09-26T19:00:04.402008] [DEBUG] [LOCAL ] GDL: Primary data saved (2572 records). [2025-09-26T19:00:04.402167] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-26T19:00:04.402264] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GDL took 18.2s. Estimated remaining: 3h 14m 5s. Rate: 7.5 symbols/min [2025-09-26T19:00:04.600547] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:04.648865] [DEBUG] [LOCAL ] GDOT: Loaded 38946 existing records from primary storage. [2025-09-26T19:00:04.649631] [INFO ] [MAIN ] GDOT: Loaded 38946 existing records. [2025-09-26T19:00:04.649937] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T19:00:04.764775] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-26T19:00:04.852388] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:04.852664] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-26T19:00:04.852727] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-26T19:00:04.853877] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-26T19:00:04.853939] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-26T19:00:05.255155] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:05.455200] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-26T19:00:05.556741] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-26T19:00:06.356745] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-26T19:00:07.002687] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T19:00:07.061591] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T19:00:07.156733] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-26T19:00:07.956811] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-26T19:00:08.429766] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T19:00:08.599983] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T19:00:08.756763] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-26T19:00:09.556723] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-26T19:00:10.055984] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T19:00:10.356729] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-26T19:00:10.619172] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T19:00:10.931974] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T19:00:11.156769] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-26T19:00:11.913392] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T19:00:11.956786] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-26T19:00:12.756757] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-26T19:00:13.331209] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-26T19:00:13.556729] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-26T19:00:13.681289] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T19:00:14.181666] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-26T19:00:14.356739] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-26T19:00:15.156703] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-26T19:00:15.482789] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T19:00:15.956739] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-26T19:00:16.443324] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T19:00:16.756746] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-26T19:00:17.029333] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T19:00:17.039515] [INFO ] [REMOTE ] GDDY: Full fetch complete (71267 records). [2025-09-26T19:00:17.039752] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-26T19:00:17.433659] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-26T19:00:17.456724] [INFO ] [REMOTE ] GDIV: Full fetch complete (5448 records). [2025-09-26T19:00:17.460897] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-26T19:00:17.538911] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-26T19:00:17.560314] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-26T19:00:17.560196] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-26T19:00:17.573728] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-26T19:00:17.591261] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-26T19:00:17.654882] [DEBUG] [LOCAL ] GDDY: Trimmed 71267 records to 50449 (keeping 200 days of data) [2025-09-26T19:00:17.982214] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-26T19:00:17.983950] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-26T19:00:17.984710] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-26T19:00:17.986206] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-26T19:00:17.988259] [DEBUG] [LOCAL ] GDIV: Trimmed 5448 records to 3724 (keeping 200 days of data) [2025-09-26T19:00:18.015013] [DEBUG] [LOCAL ] GDIV: Primary data saved (3724 records). [2025-09-26T19:00:18.016519] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-26T19:00:18.016993] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDIV took 33.2s. Estimated remaining: 3h 14m 6s. Rate: 7.5 symbols/min [2025-09-26T19:00:18.097789] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T19:00:18.246965] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:18.335294] [DEBUG] [LOCAL ] GDV: Loaded 19887 existing records from primary storage. [2025-09-26T19:00:18.362424] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-26T19:00:18.363381] [INFO ] [MAIN ] GDV: Loaded 19887 existing records. [2025-09-26T19:00:18.574890] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:18.576493] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-26T19:00:18.576839] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-26T19:00:18.578380] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-26T19:00:18.578709] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-26T19:00:18.983707] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:19.076390] [DEBUG] [LOCAL ] GDDY: Primary data saved (50449 records). [2025-09-26T19:00:19.076549] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-26T19:00:19.077794] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDDY took 45.4s. Estimated remaining: 3h 13m 47s. Rate: 7.5 symbols/min [2025-09-26T19:00:19.169897] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-26T19:00:19.170260] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T19:00:19.278563] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:19.342430] [DEBUG] [LOCAL ] GE: Loaded 54103 existing records from primary storage. [2025-09-26T19:00:19.342603] [INFO ] [MAIN ] GE: Loaded 54103 existing records. [2025-09-26T19:00:19.538178] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:19.538592] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-26T19:00:19.538679] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-26T19:00:19.540809] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-26T19:00:19.540942] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-26T19:00:19.925774] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:19.956691] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-26T19:00:20.756709] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-26T19:00:20.843692] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T19:00:21.477542] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T19:00:21.479478] [INFO ] [REMOTE ] GDO: Full fetch complete (9333 records). [2025-09-26T19:00:21.479556] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-26T19:00:21.561854] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-26T19:00:21.919865] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-26T19:00:21.919985] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-26T19:00:21.920319] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-26T19:00:21.920402] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-26T19:00:21.921447] [DEBUG] [LOCAL ] GDO: Trimmed 9333 records to 6076 (keeping 200 days of data) [2025-09-26T19:00:21.962743] [DEBUG] [LOCAL ] GDO: Primary data saved (6076 records). [2025-09-26T19:00:21.962903] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-26T19:00:21.963022] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDO took 23.4s. Estimated remaining: 3h 13m 31s. Rate: 7.6 symbols/min [2025-09-26T19:00:22.191149] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:22.278678] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-26T19:00:22.308195] [DEBUG] [LOCAL ] GEF: Loaded 20843 existing records from primary storage. [2025-09-26T19:00:22.308346] [INFO ] [MAIN ] GEF: Loaded 20843 existing records. [2025-09-26T19:00:22.368823] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-26T19:00:22.510613] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:22.510941] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-26T19:00:22.510992] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-26T19:00:22.511804] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-26T19:00:22.511869] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-26T19:00:22.922616] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:23.063930] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T19:00:23.156747] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-26T19:00:23.956748] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-26T19:00:24.301086] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T19:00:24.424555] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T19:00:24.756723] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-26T19:00:25.415051] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T19:00:25.474140] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-26T19:00:25.556736] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-26T19:00:26.356732] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-26T19:00:27.156738] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-26T19:00:27.664186] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-26T19:00:27.740550] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T19:00:27.956707] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-26T19:00:28.303969] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T19:00:28.756764] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-26T19:00:29.486681] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:00:29.556724] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-26T19:00:29.889127] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-26T19:00:30.356731] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-26T19:00:31.156699] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-26T19:00:31.381966] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:00:31.456940] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T19:00:31.956770] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-26T19:00:32.588276] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T19:00:32.756761] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-26T19:00:33.556706] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-26T19:00:33.876780] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T19:00:34.210851] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-26T19:00:34.356740] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-26T19:00:34.637826] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T19:00:35.156763] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-26T19:00:35.956748] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-26T19:00:36.138823] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T19:00:36.525726] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-26T19:00:36.756763] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-26T19:00:37.564296] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-26T19:00:37.567529] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-26T19:00:37.576401] [INFO ] [REMOTE ] GDOT: Full fetch complete (52897 records). [2025-09-26T19:00:37.576537] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-26T19:00:37.997065] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-26T19:00:37.997234] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-26T19:00:37.998200] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-26T19:00:37.998290] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-26T19:00:37.999913] [DEBUG] [LOCAL ] GDOT: Trimmed 52897 records to 39279 (keeping 200 days of data) [2025-09-26T19:00:38.102062] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T19:00:38.253078] [DEBUG] [LOCAL ] GDOT: Primary data saved (39279 records). [2025-09-26T19:00:38.253249] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-26T19:00:38.253339] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GDOT took 33.9s. Estimated remaining: 3h 13m 36s. Rate: 7.5 symbols/min [2025-09-26T19:00:38.362855] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-26T19:00:38.443104] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:38.481456] [DEBUG] [LOCAL ] GEL: Loaded 34035 existing records from primary storage. [2025-09-26T19:00:38.481630] [INFO ] [MAIN ] GEL: Loaded 34035 existing records. [2025-09-26T19:00:38.629049] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T19:00:38.709270] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:38.709547] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-26T19:00:38.709600] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-26T19:00:38.710736] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-26T19:00:38.710837] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-26T19:00:39.114746] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:39.156800] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-26T19:00:39.527813] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T19:00:39.956753] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-26T19:00:40.377615] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T19:00:40.756763] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-26T19:00:41.556711] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-26T19:00:41.920293] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T19:00:42.138912] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T19:00:42.330421] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:00:42.356683] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-26T19:00:43.156752] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-26T19:00:43.777405] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T19:00:43.784412] [INFO ] [REMOTE ] GEF: Full fetch complete (29416 records). [2025-09-26T19:00:43.784601] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-26T19:00:43.979056] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-26T19:00:44.458621] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-26T19:00:44.459946] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T19:00:44.465893] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-26T19:00:44.468333] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-26T19:00:44.468896] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-26T19:00:44.473480] [DEBUG] [LOCAL ] GEF: Trimmed 29416 records to 20965 (keeping 200 days of data) [2025-09-26T19:00:44.703906] [DEBUG] [LOCAL ] GEF: Primary data saved (20965 records). [2025-09-26T19:00:44.704111] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-26T19:00:44.704388] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GEF took 22.7s. Estimated remaining: 3h 13m 26s. Rate: 7.5 symbols/min [2025-09-26T19:00:44.762829] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-26T19:00:45.018289] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:45.111385] [DEBUG] [LOCAL ] GENI: Loaded 53298 existing records from primary storage. [2025-09-26T19:00:45.111560] [INFO ] [MAIN ] GENI: Loaded 53298 existing records. [2025-09-26T19:00:45.363370] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:45.363854] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-26T19:00:45.363912] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-26T19:00:45.365525] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-26T19:00:45.365637] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-26T19:00:45.561200] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-26T19:00:45.803352] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:46.052208] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T19:00:46.155626] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T19:00:46.356763] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-26T19:00:46.992012] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:00:47.156773] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-26T19:00:47.956701] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-26T19:00:48.086678] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:00:48.179935] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T19:00:48.756746] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-26T19:00:49.556746] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-26T19:00:50.082885] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T19:00:50.294592] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:00:50.356699] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-26T19:00:50.582974] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T19:00:51.156756] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-26T19:00:51.460229] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T19:00:51.956771] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-26T19:00:52.621605] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T19:00:52.756765] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-26T19:00:53.463493] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T19:00:53.556891] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-26T19:00:54.073893] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T19:00:54.356779] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-26T19:00:55.156736] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-26T19:00:55.463969] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T19:00:55.928857] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-26T19:00:55.941835] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-09-26T19:00:55.942017] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-26T19:00:55.966946] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-26T19:00:56.438727] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-26T19:00:56.438857] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-26T19:00:56.440068] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-26T19:00:56.440326] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-26T19:00:56.442224] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 54493 (keeping 200 days of data) [2025-09-26T19:00:56.712924] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:00:56.757981] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-26T19:00:56.861441] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:00:56.871764] [DEBUG] [LOCAL ] GE: Primary data saved (54493 records). [2025-09-26T19:00:56.871937] [INFO ] [MAIN ] GE: Full history saved. [2025-09-26T19:00:56.873056] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GE took 37.8s. Estimated remaining: 3h 13m 24s. Rate: 7.5 symbols/min [2025-09-26T19:00:57.062330] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:57.125138] [DEBUG] [LOCAL ] GEO: Loaded 52453 existing records from primary storage. [2025-09-26T19:00:57.125315] [INFO ] [MAIN ] GEO: Loaded 52453 existing records. [2025-09-26T19:00:57.320254] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:57.320633] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-26T19:00:57.320719] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-26T19:00:57.322805] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-26T19:00:57.322875] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-26T19:00:57.561963] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-26T19:00:57.718314] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:00:58.205683] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T19:00:58.356710] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-26T19:00:58.691931] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:00:58.695928] [INFO ] [REMOTE ] GDV: Full fetch complete (28788 records). [2025-09-26T19:00:58.696022] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-26T19:00:59.091030] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-26T19:00:59.091129] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-26T19:00:59.091767] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-26T19:00:59.091829] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-26T19:00:59.092925] [DEBUG] [LOCAL ] GDV: Trimmed 28788 records to 19971 (keeping 200 days of data) [2025-09-26T19:00:59.160739] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-26T19:00:59.235568] [DEBUG] [LOCAL ] GDV: Primary data saved (19971 records). [2025-09-26T19:00:59.235750] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-26T19:00:59.235848] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GDV took 41.2s. Estimated remaining: 3h 13m 8s. Rate: 7.5 symbols/min [2025-09-26T19:00:59.414206] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:00:59.464252] [DEBUG] [LOCAL ] GES: Loaded 40204 existing records from primary storage. [2025-09-26T19:00:59.464402] [INFO ] [MAIN ] GES: Loaded 40204 existing records. [2025-09-26T19:00:59.657921] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:00:59.658164] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-26T19:00:59.658213] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-26T19:00:59.659425] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-26T19:00:59.659493] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-26T19:00:59.961229] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-26T19:01:00.048907] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:00.281981] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T19:01:00.560844] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T19:01:00.756740] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-26T19:01:01.556732] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-26T19:01:01.939467] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T19:01:02.356696] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-26T19:01:02.454717] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T19:01:02.898526] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-26T19:01:02.907060] [INFO ] [REMOTE ] GEL: Full fetch complete (48664 records). [2025-09-26T19:01:02.907271] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-26T19:01:03.161840] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-26T19:01:03.354158] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-26T19:01:03.354255] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-26T19:01:03.355129] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-26T19:01:03.355231] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-26T19:01:03.358498] [DEBUG] [LOCAL ] GEL: Trimmed 48664 records to 34252 (keeping 200 days of data) [2025-09-26T19:01:03.587841] [DEBUG] [LOCAL ] GEL: Primary data saved (34252 records). [2025-09-26T19:01:03.588014] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-26T19:01:03.588155] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GEL took 25.3s. Estimated remaining: 3h 12m 54s. Rate: 7.6 symbols/min [2025-09-26T19:01:03.782597] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:03.828578] [DEBUG] [LOCAL ] GETY: Loaded 36145 existing records from primary storage. [2025-09-26T19:01:03.828747] [INFO ] [MAIN ] GETY: Loaded 36145 existing records. [2025-09-26T19:01:03.961824] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-26T19:01:04.033893] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:04.034123] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-26T19:01:04.034191] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-26T19:01:04.035413] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-26T19:01:04.035490] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-26T19:01:04.450022] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:04.485254] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-26T19:01:04.756782] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-26T19:01:05.004192] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T19:01:05.556739] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-26T19:01:05.997560] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-26T19:01:06.356732] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-26T19:01:06.473333] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T19:01:07.156706] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-26T19:01:07.260285] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:01:07.841806] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T19:01:07.956786] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-26T19:01:08.756795] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-26T19:01:09.012091] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T19:01:09.556727] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-26T19:01:09.731219] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T19:01:10.166480] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:01:10.356758] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-26T19:01:11.156753] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-26T19:01:11.702875] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-26T19:01:11.956757] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-26T19:01:12.239809] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T19:01:12.407264] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T19:01:12.756754] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-26T19:01:13.556754] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-26T19:01:13.772277] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T19:01:14.226249] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T19:01:14.356738] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-26T19:01:15.156725] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-26T19:01:15.314201] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:01:15.956692] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-26T19:01:16.144765] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T19:01:16.155884] [INFO ] [REMOTE ] GENI: Full fetch complete (75443 records). [2025-09-26T19:01:16.156077] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-26T19:01:16.657790] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-26T19:01:16.658013] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-26T19:01:16.659214] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-26T19:01:16.659357] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-26T19:01:16.661391] [DEBUG] [LOCAL ] GENI: Trimmed 75443 records to 53679 (keeping 200 days of data) [2025-09-26T19:01:16.763740] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-26T19:01:16.789803] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:01:17.033783] [DEBUG] [LOCAL ] GENI: Primary data saved (53679 records). [2025-09-26T19:01:17.033955] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-26T19:01:17.034045] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GENI took 32.3s. Estimated remaining: 3h 12m 55s. Rate: 7.5 symbols/min [2025-09-26T19:01:17.224030] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:17.288152] [DEBUG] [LOCAL ] GEV: Loaded 53499 existing records from primary storage. [2025-09-26T19:01:17.288318] [INFO ] [MAIN ] GEV: Loaded 53499 existing records. [2025-09-26T19:01:17.487162] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:17.487467] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-26T19:01:17.487523] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-26T19:01:17.489227] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-26T19:01:17.489315] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-26T19:01:17.574830] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-26T19:01:17.876737] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:17.912245] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T19:01:18.315472] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T19:01:18.356746] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-26T19:01:19.156744] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-26T19:01:19.301759] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T19:01:19.956723] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-26T19:01:20.582987] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-26T19:01:20.756731] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-26T19:01:21.057836] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-26T19:01:21.556718] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-26T19:01:21.743391] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T19:01:22.356732] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-26T19:01:22.875757] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T19:01:23.092944] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T19:01:23.156700] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-26T19:01:23.842264] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T19:01:23.956735] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-26T19:01:24.735014] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:01:24.756728] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-26T19:01:25.556725] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-26T19:01:25.757836] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T19:01:26.356733] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-26T19:01:27.122382] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-26T19:01:27.161956] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-26T19:01:27.177565] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T19:01:27.956708] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-26T19:01:27.981870] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:01:28.756814] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-26T19:01:29.093192] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T19:01:29.104393] [INFO ] [REMOTE ] GEO: Full fetch complete (75513 records). [2025-09-26T19:01:29.104733] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-26T19:01:29.566250] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-26T19:01:29.572339] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-26T19:01:29.572491] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-26T19:01:29.573878] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-26T19:01:29.574204] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-26T19:01:29.599637] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:01:29.608547] [DEBUG] [LOCAL ] GEO: Trimmed 75513 records to 52812 (keeping 200 days of data) [2025-09-26T19:01:29.940471] [DEBUG] [LOCAL ] GEO: Primary data saved (52812 records). [2025-09-26T19:01:29.940636] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-26T19:01:29.941320] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GEO took 33.1s. Estimated remaining: 3h 12m 55s. Rate: 7.5 symbols/min [2025-09-26T19:01:30.119894] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:30.125564] [DEBUG] [LOCAL ] GF: Loaded 3206 existing records from primary storage. [2025-09-26T19:01:30.125693] [INFO ] [MAIN ] GF: Loaded 3206 existing records. [2025-09-26T19:01:30.310514] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:30.310846] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-26T19:01:30.310919] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-26T19:01:30.311203] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-26T19:01:30.311286] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-26T19:01:30.370284] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-26T19:01:30.733193] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:31.131679] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-26T19:01:31.156672] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-26T19:01:31.213198] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:01:31.220827] [INFO ] [REMOTE ] GES: Full fetch complete (59820 records). [2025-09-26T19:01:31.221013] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-26T19:01:31.646517] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-26T19:01:31.646621] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-26T19:01:31.647735] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-26T19:01:31.647808] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-26T19:01:31.649266] [DEBUG] [LOCAL ] GES: Trimmed 59820 records to 40424 (keeping 200 days of data) [2025-09-26T19:01:31.964957] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-26T19:01:31.988392] [DEBUG] [LOCAL ] GES: Primary data saved (40424 records). [2025-09-26T19:01:31.988986] [INFO ] [MAIN ] GES: Full history saved. [2025-09-26T19:01:31.989865] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GES took 32.8s. Estimated remaining: 3h 12m 37s. Rate: 7.5 symbols/min [2025-09-26T19:01:31.991964] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T19:01:32.653097] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-26T19:01:32.756738] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-26T19:01:33.557002] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-26T19:01:33.557152] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-26T19:01:34.050915] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T19:01:34.098715] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-26T19:01:34.356763] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-26T19:01:34.954285] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T19:01:35.156773] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-26T19:01:35.956745] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-26T19:01:36.756755] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-26T19:01:36.962220] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:01:36.969603] [INFO ] [REMOTE ] GETY: Full fetch complete (55714 records). [2025-09-26T19:01:36.969786] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-26T19:01:37.417261] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-26T19:01:37.417377] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-26T19:01:37.418327] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-26T19:01:37.418398] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-26T19:01:37.419963] [DEBUG] [LOCAL ] GETY: Trimmed 55714 records to 36378 (keeping 200 days of data) [2025-09-26T19:01:37.611415] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T19:01:37.643791] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-26T19:01:37.672954] [DEBUG] [LOCAL ] GETY: Primary data saved (36378 records). [2025-09-26T19:01:37.673159] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-26T19:01:37.673310] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GETY took 34.1s. Estimated remaining: 3h 12m 26s. Rate: 7.6 symbols/min [2025-09-26T19:01:38.158618] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-26T19:01:38.230842] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-26T19:01:38.356784] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-26T19:01:38.739918] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-26T19:01:39.156902] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-26T19:01:39.956775] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-26T19:01:40.465078] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-26T19:01:40.756743] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-26T19:01:41.228821] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T19:01:41.389336] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-26T19:01:41.556717] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-26T19:01:42.042572] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-26T19:01:42.356766] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-26T19:01:42.842430] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-26T19:01:42.843408] [INFO ] [REMOTE ] GF: Full fetch complete (5292 records). [2025-09-26T19:01:42.843484] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-26T19:01:43.163446] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-26T19:01:43.254262] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-26T19:01:43.254419] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-26T19:01:43.254605] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-26T19:01:43.254695] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-26T19:01:43.255169] [DEBUG] [LOCAL ] GF: Trimmed 5292 records to 3220 (keeping 200 days of data) [2025-09-26T19:01:43.277330] [DEBUG] [LOCAL ] GF: Primary data saved (3220 records). [2025-09-26T19:01:43.277466] [INFO ] [MAIN ] GF: Full history saved. [2025-09-26T19:01:43.277553] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GF took 13.3s. Estimated remaining: 3h 12m 14s. Rate: 7.6 symbols/min [2025-09-26T19:01:45.675150] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-26T19:01:45.688055] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-26T19:01:48.191344] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-26T19:01:48.203338] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-26T19:01:50.826943] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-26T19:01:50.838106] [INFO ] [REMOTE ] GEV: Full fetch complete (76964 records). [2025-09-26T19:01:50.838303] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-26T19:01:51.283625] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-26T19:01:51.283761] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-26T19:01:51.284872] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-26T19:01:51.284943] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-26T19:01:51.286739] [DEBUG] [LOCAL ] GEV: Trimmed 76964 records to 53878 (keeping 200 days of data) [2025-09-26T19:01:51.649438] [DEBUG] [LOCAL ] GEV: Primary data saved (53878 records). [2025-09-26T19:01:51.649593] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-26T19:01:51.649719] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GEV took 34.6s. Estimated remaining: 3h 12m 7s. Rate: 7.6 symbols/min [2025-09-26T19:01:52.358073] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:52.409518] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:52.431227] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:52.426852] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:01:52.443264] [DEBUG] [LOCAL ] GFR: Loaded 8522 existing records from primary storage. [2025-09-26T19:01:52.443624] [INFO ] [MAIN ] GFR: Loaded 8522 existing records. [2025-09-26T19:01:52.633305] [DEBUG] [LOCAL ] GFF: Loaded 30968 existing records from primary storage. [2025-09-26T19:01:52.638947] [INFO ] [MAIN ] GFF: Loaded 30968 existing records. [2025-09-26T19:01:52.843639] [DEBUG] [LOCAL ] GFL: Loaded 48414 existing records from primary storage. [2025-09-26T19:01:52.847786] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:52.842762] [DEBUG] [LOCAL ] GFI: Loaded 53499 existing records from primary storage. [2025-09-26T19:01:52.864181] [INFO ] [MAIN ] GFI: Loaded 53499 existing records. [2025-09-26T19:01:52.869505] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-26T19:01:52.891314] [INFO ] [MAIN ] GFL: Loaded 48414 existing records. [2025-09-26T19:01:52.981398] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-26T19:01:53.123008] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-26T19:01:53.184107] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-26T19:01:53.234510] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:53.246826] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-26T19:01:53.303510] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-26T19:01:53.391904] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-26T19:01:53.438115] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:53.483597] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-26T19:01:53.489017] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-26T19:01:53.494285] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-26T19:01:53.529295] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-26T19:01:53.624896] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-26T19:01:53.789081] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:01:53.946843] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-26T19:01:53.972862] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-26T19:01:54.075512] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-26T19:01:54.172712] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-26T19:01:54.547213] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:54.590584] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-26T19:01:54.903889] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:54.954540] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-26T19:01:55.020604] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:55.035461] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-26T19:01:55.204631] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:01:55.205005] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-26T19:01:55.541249] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:01:55.544749] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-26T19:01:56.315242] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-26T19:01:56.318105] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-26T19:01:56.384583] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:01:56.390922] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-26T19:01:56.672862] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T19:01:56.682428] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-26T19:01:56.767013] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:01:56.777593] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-26T19:01:57.145045] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-26T19:01:57.147586] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-26T19:01:57.555814] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T19:01:57.563279] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-26T19:01:57.988913] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T19:01:57.999813] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-26T19:01:58.009285] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T19:01:58.012993] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-26T19:01:58.414550] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T19:01:58.421770] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-26T19:01:58.609533] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:01:58.613533] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-26T19:01:58.694083] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T19:01:58.705878] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-26T19:01:59.245886] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T19:01:59.255535] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-26T19:01:59.398848] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T19:01:59.402058] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-26T19:01:59.841384] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T19:01:59.956763] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-26T19:02:00.171680] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T19:02:00.619620] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T19:02:00.756727] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-26T19:02:01.084358] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:02:01.526276] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:02:01.556775] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-26T19:02:02.356777] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-26T19:02:02.627768] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T19:02:02.950213] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T19:02:03.157828] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:02:03.157921] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-26T19:02:03.956725] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-26T19:02:04.493638] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T19:02:04.756769] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-26T19:02:05.376219] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T19:02:05.556729] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-26T19:02:06.174800] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-26T19:02:06.175599] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T19:02:06.189126] [INFO ] [REMOTE ] GFR: Full fetch complete (12786 records). [2025-09-26T19:02:06.189684] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-26T19:02:06.359695] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-26T19:02:06.587605] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-26T19:02:06.587725] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-26T19:02:06.588122] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-26T19:02:06.588167] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-26T19:02:06.588682] [DEBUG] [LOCAL ] GFR: Trimmed 12786 records to 8572 (keeping 200 days of data) [2025-09-26T19:02:06.640087] [DEBUG] [LOCAL ] GFR: Primary data saved (8572 records). [2025-09-26T19:02:06.640257] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-26T19:02:06.640467] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 15.0s. Estimated remaining: 3h 12m 10s. Rate: 7.5 symbols/min [2025-09-26T19:02:06.834542] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:06.886633] [DEBUG] [LOCAL ] GGB: Loaded 51429 existing records from primary storage. [2025-09-26T19:02:06.886851] [INFO ] [MAIN ] GGB: Loaded 51429 existing records. [2025-09-26T19:02:07.080032] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:07.080388] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-26T19:02:07.080462] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-26T19:02:07.081909] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-26T19:02:07.081974] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-26T19:02:07.161910] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-26T19:02:07.476931] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:07.956727] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-26T19:02:08.161279] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T19:02:08.756765] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-26T19:02:09.270142] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-26T19:02:09.310354] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T19:02:09.556731] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-26T19:02:10.229545] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T19:02:10.356800] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-26T19:02:10.375783] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-26T19:02:11.156751] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-26T19:02:11.956734] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-26T19:02:12.472124] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T19:02:12.585169] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-26T19:02:12.756758] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-26T19:02:13.188856] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T19:02:13.556746] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-26T19:02:14.356830] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-26T19:02:14.465061] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:02:14.470876] [INFO ] [REMOTE ] GFF: Full fetch complete (44164 records). [2025-09-26T19:02:14.471022] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-26T19:02:14.930308] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-26T19:02:14.930703] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-26T19:02:14.931617] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-26T19:02:14.931751] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-26T19:02:14.933290] [DEBUG] [LOCAL ] GFF: Trimmed 44164 records to 31088 (keeping 200 days of data) [2025-09-26T19:02:15.062088] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T19:02:15.156839] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-26T19:02:15.179991] [DEBUG] [LOCAL ] GFF: Primary data saved (31088 records). [2025-09-26T19:02:15.180252] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-26T19:02:15.180363] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFF took 23.5s. Estimated remaining: 3h 12m 3s. Rate: 7.5 symbols/min [2025-09-26T19:02:15.361412] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:15.407586] [DEBUG] [LOCAL ] GGG: Loaded 41294 existing records from primary storage. [2025-09-26T19:02:15.407805] [INFO ] [MAIN ] GGG: Loaded 41294 existing records. [2025-09-26T19:02:15.603690] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:15.604086] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-26T19:02:15.604147] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-26T19:02:15.605755] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-26T19:02:15.605824] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-26T19:02:15.961133] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-26T19:02:16.027969] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:16.072743] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-26T19:02:16.756715] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-26T19:02:17.193856] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-26T19:02:17.556742] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-26T19:02:17.619887] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T19:02:18.361817] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-26T19:02:18.379280] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:02:19.057470] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T19:02:19.156728] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-26T19:02:19.956721] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-26T19:02:20.326874] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T19:02:20.337326] [INFO ] [REMOTE ] GFL: Full fetch complete (68877 records). [2025-09-26T19:02:20.337535] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-26T19:02:20.756767] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-26T19:02:20.757145] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-26T19:02:20.757235] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-26T19:02:20.759018] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-26T19:02:20.759155] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-26T19:02:20.760734] [DEBUG] [LOCAL ] GFL: Trimmed 68877 records to 48755 (keeping 200 days of data) [2025-09-26T19:02:21.121948] [DEBUG] [LOCAL ] GFL: Primary data saved (48755 records). [2025-09-26T19:02:21.122810] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-26T19:02:21.123923] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T19:02:21.124190] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GFL took 29.5s. Estimated remaining: 3h 11m 52s. Rate: 7.5 symbols/min [2025-09-26T19:02:21.324400] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:21.363214] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T19:02:21.381540] [DEBUG] [LOCAL ] GGT: Loaded 14231 existing records from primary storage. [2025-09-26T19:02:21.381714] [INFO ] [MAIN ] GGT: Loaded 14231 existing records. [2025-09-26T19:02:21.574168] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-26T19:02:21.580776] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:21.582224] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-26T19:02:21.582315] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-26T19:02:21.583056] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-26T19:02:21.583128] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-26T19:02:21.993291] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:22.284895] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:02:22.356725] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-26T19:02:23.156697] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-26T19:02:23.405157] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:02:23.873587] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:02:23.956752] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-26T19:02:24.102050] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:02:24.756762] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-26T19:02:25.556700] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-26T19:02:25.728890] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T19:02:25.872624] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T19:02:26.356778] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-26T19:02:27.156785] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-26T19:02:27.765509] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-26T19:02:27.776687] [INFO ] [REMOTE ] GFI: Full fetch complete (76340 records). [2025-09-26T19:02:27.776862] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-26T19:02:27.960497] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-26T19:02:28.100836] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T19:02:28.263525] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T19:02:28.322029] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-26T19:02:28.322144] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-26T19:02:28.323827] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-26T19:02:28.323925] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-26T19:02:28.325532] [DEBUG] [LOCAL ] GFI: Trimmed 76340 records to 53887 (keeping 200 days of data) [2025-09-26T19:02:28.664289] [DEBUG] [LOCAL ] GFI: Primary data saved (53887 records). [2025-09-26T19:02:28.664459] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-26T19:02:28.664556] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GFI took 37.0s. Estimated remaining: 3h 11m 43s. Rate: 7.5 symbols/min [2025-09-26T19:02:28.761862] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-26T19:02:28.865363] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:28.869824] [DEBUG] [LOCAL ] GGZ: Loaded 2457 existing records from primary storage. [2025-09-26T19:02:28.869904] [INFO ] [MAIN ] GGZ: Loaded 2457 existing records. [2025-09-26T19:02:29.061554] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:29.061885] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-26T19:02:29.061942] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-26T19:02:29.062229] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-26T19:02:29.062290] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-26T19:02:29.442555] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:29.556707] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-26T19:02:29.875802] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T19:02:30.148022] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T19:02:30.356781] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-26T19:02:30.974524] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T19:02:31.158124] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-26T19:02:31.168299] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-26T19:02:31.956786] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-26T19:02:32.751242] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:02:32.759945] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-26T19:02:32.780688] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:02:33.556725] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-26T19:02:34.356783] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-26T19:02:34.591842] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:02:35.047021] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T19:02:35.156718] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-26T19:02:35.337294] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T19:02:35.956763] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-26T19:02:36.702277] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:02:36.756720] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-26T19:02:36.903004] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T19:02:37.206298] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T19:02:37.556724] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-26T19:02:38.031986] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-26T19:02:38.356760] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-26T19:02:39.156743] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-26T19:02:39.395845] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T19:02:39.956772] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-26T19:02:40.531665] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T19:02:40.756750] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-26T19:02:40.876862] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:02:40.887364] [INFO ] [REMOTE ] GGB: Full fetch complete (74027 records). [2025-09-26T19:02:40.887543] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-26T19:02:41.302510] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-26T19:02:41.302604] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-26T19:02:41.303539] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-26T19:02:41.303628] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-26T19:02:41.305329] [DEBUG] [LOCAL ] GGB: Trimmed 74027 records to 51813 (keeping 200 days of data) [2025-09-26T19:02:41.556712] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-26T19:02:41.651494] [DEBUG] [LOCAL ] GGB: Primary data saved (51813 records). [2025-09-26T19:02:41.651697] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-26T19:02:41.651851] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGB took 35.0s. Estimated remaining: 3h 11m 43s. Rate: 7.5 symbols/min [2025-09-26T19:02:41.850906] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T19:02:41.854346] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:41.863177] [DEBUG] [LOCAL ] GHC: Loaded 2651 existing records from primary storage. [2025-09-26T19:02:41.863257] [INFO ] [MAIN ] GHC: Loaded 2651 existing records. [2025-09-26T19:02:42.055468] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:42.055850] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-26T19:02:42.055906] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-26T19:02:42.056177] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-26T19:02:42.056249] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-26T19:02:42.176176] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T19:02:42.361908] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-26T19:02:42.478980] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:43.156737] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-26T19:02:43.624424] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-26T19:02:43.956737] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-26T19:02:44.110896] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T19:02:44.756753] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-26T19:02:45.187545] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T19:02:45.556734] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-26T19:02:46.151876] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-26T19:02:46.356755] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-26T19:02:46.411247] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:02:46.418980] [INFO ] [REMOTE ] GGG: Full fetch complete (59038 records). [2025-09-26T19:02:46.419125] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-26T19:02:46.419972] [FATAL] [VALIDATOR ] GGG: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:02:46.420067] [FATAL] [MAIN ] GGG: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:02:46.420114] [WARN ] [MAIN ] GGG: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:02:46.420185] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-26T19:02:46.420260] [DEBUG] [LOCAL ] GGG: No primary data file found to delete. [2025-09-26T19:02:46.420300] [INFO ] [LOCAL ] GGG: Starting deletion of derivative data. [2025-09-26T19:02:46.420886] [DEBUG] [LOCAL ] GGG: Deleted derivative data file. [2025-09-26T19:02:46.420992] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GGG took 31.2s. Estimated remaining: 3h 11m 30s. Rate: 7.5 symbols/min [2025-09-26T19:02:46.611717] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:46.616770] [DEBUG] [LOCAL ] GHG: Loaded 3210 existing records from primary storage. [2025-09-26T19:02:46.616863] [INFO ] [MAIN ] GHG: Loaded 3210 existing records. [2025-09-26T19:02:46.814260] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:46.814542] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-26T19:02:46.814592] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-26T19:02:46.814858] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-26T19:02:46.814922] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-26T19:02:47.164867] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-26T19:02:47.213163] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:47.278871] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T19:02:47.602239] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-26T19:02:47.956772] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-26T19:02:48.756743] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-26T19:02:49.090480] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-26T19:02:49.090309] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:02:49.096556] [INFO ] [REMOTE ] GGT: Full fetch complete (18707 records). [2025-09-26T19:02:49.096698] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-26T19:02:49.532491] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-26T19:02:49.532636] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-26T19:02:49.533171] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-26T19:02:49.533238] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-26T19:02:49.535264] [DEBUG] [LOCAL ] GGT: Trimmed 18707 records to 14309 (keeping 200 days of data) [2025-09-26T19:02:49.571118] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-26T19:02:49.627202] [DEBUG] [LOCAL ] GGT: Primary data saved (14309 records). [2025-09-26T19:02:49.627373] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-26T19:02:49.627475] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGT took 28.5s. Estimated remaining: 3h 11m 15s. Rate: 7.6 symbols/min [2025-09-26T19:02:49.809818] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:49.819254] [DEBUG] [LOCAL ] GHI: Loaded 6903 existing records from primary storage. [2025-09-26T19:02:49.819360] [INFO ] [MAIN ] GHI: Loaded 6903 existing records. [2025-09-26T19:02:50.008528] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:50.008885] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-26T19:02:50.008945] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-26T19:02:50.009390] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-26T19:02:50.009493] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-26T19:02:50.118326] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-26T19:02:50.361908] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-26T19:02:50.394927] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:50.822245] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-26T19:02:51.156786] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-26T19:02:51.709973] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-26T19:02:51.711214] [INFO ] [REMOTE ] GGZ: Full fetch complete (4163 records). [2025-09-26T19:02:51.711317] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-26T19:02:51.961992] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-26T19:02:52.101696] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-26T19:02:52.101791] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-26T19:02:52.101939] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-26T19:02:52.101983] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-26T19:02:52.102413] [DEBUG] [LOCAL ] GGZ: Trimmed 4163 records to 2465 (keeping 200 days of data) [2025-09-26T19:02:52.118295] [DEBUG] [LOCAL ] GGZ: Primary data saved (2465 records). [2025-09-26T19:02:52.118396] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-26T19:02:52.118495] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GGZ took 23.5s. Estimated remaining: 3h 10m 59s. Rate: 7.6 symbols/min [2025-09-26T19:02:52.311017] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:02:52.317346] [DEBUG] [LOCAL ] GHLD: Loaded 4144 existing records from primary storage. [2025-09-26T19:02:52.317459] [INFO ] [MAIN ] GHLD: Loaded 4144 existing records. [2025-09-26T19:02:52.530908] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:02:52.537407] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T19:02:52.537893] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-26T19:02:52.539554] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-26T19:02:52.539942] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-26T19:02:52.540032] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-26T19:02:52.762626] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-26T19:02:52.930463] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:02:53.274477] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T19:02:53.556732] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-26T19:02:54.161496] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T19:02:54.356772] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-26T19:02:54.867807] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-26T19:02:55.156762] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-26T19:02:55.612266] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T19:02:55.956721] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-26T19:02:56.391023] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T19:02:56.756769] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-26T19:02:57.113839] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-26T19:02:57.556743] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-26T19:02:58.103056] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T19:02:58.356741] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-26T19:02:58.916498] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-26T19:02:59.156765] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-26T19:02:59.726063] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T19:02:59.956765] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-26T19:03:00.725741] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T19:03:00.756754] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-26T19:03:01.370006] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T19:03:01.556772] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-26T19:03:02.064100] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-26T19:03:02.356775] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-26T19:03:02.978780] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T19:03:03.156776] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-26T19:03:03.956712] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-26T19:03:04.146541] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T19:03:04.403541] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T19:03:04.756741] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-26T19:03:05.382791] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T19:03:05.556725] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-26T19:03:05.994404] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-26T19:03:06.356723] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-26T19:03:06.938889] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T19:03:07.156733] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-26T19:03:07.769429] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T19:03:07.956735] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-26T19:03:08.549810] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-26T19:03:08.756736] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-26T19:03:09.420844] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T19:03:09.556724] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-26T19:03:10.066681] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-26T19:03:10.356753] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-26T19:03:11.156693] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-26T19:03:11.166062] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T19:03:11.944810] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-26T19:03:11.956728] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-26T19:03:12.526940] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T19:03:12.756736] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-26T19:03:13.556729] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-26T19:03:13.660424] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T19:03:14.089119] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-26T19:03:14.356730] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-26T19:03:15.061549] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T19:03:15.062786] [INFO ] [REMOTE ] GHC: Full fetch complete (3271 records). [2025-09-26T19:03:15.062882] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-26T19:03:15.161857] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-26T19:03:15.461543] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-26T19:03:15.461665] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-26T19:03:15.461837] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-26T19:03:15.461924] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-26T19:03:15.462382] [DEBUG] [LOCAL ] GHC: Trimmed 3271 records to 2664 (keeping 200 days of data) [2025-09-26T19:03:15.482217] [DEBUG] [LOCAL ] GHC: Primary data saved (2664 records). [2025-09-26T19:03:15.482320] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-26T19:03:15.482540] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHC took 33.8s. Estimated remaining: 3h 11m 15s. Rate: 7.5 symbols/min [2025-09-26T19:03:15.676702] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:15.699445] [DEBUG] [LOCAL ] GHM: Loaded 14240 existing records from primary storage. [2025-09-26T19:03:15.699586] [INFO ] [MAIN ] GHM: Loaded 14240 existing records. [2025-09-26T19:03:15.900605] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:15.900926] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-26T19:03:15.900978] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-26T19:03:15.901542] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-26T19:03:15.901604] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-26T19:03:15.961839] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-26T19:03:16.203368] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:03:16.229861] [INFO ] [REMOTE ] GHG: Full fetch complete (4028 records). [2025-09-26T19:03:16.246634] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-26T19:03:16.410441] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:16.747966] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-26T19:03:16.748174] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-26T19:03:16.748376] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-26T19:03:16.748419] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-26T19:03:16.749081] [DEBUG] [LOCAL ] GHG: Trimmed 4028 records to 3226 (keeping 200 days of data) [2025-09-26T19:03:16.758981] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-26T19:03:16.772591] [DEBUG] [LOCAL ] GHG: Primary data saved (3226 records). [2025-09-26T19:03:16.772772] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-26T19:03:16.772929] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHG took 30.4s. Estimated remaining: 3h 10m 56s. Rate: 7.5 symbols/min [2025-09-26T19:03:16.886611] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-26T19:03:16.976825] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:17.006085] [DEBUG] [LOCAL ] GHY: Loaded 20903 existing records from primary storage. [2025-09-26T19:03:17.006236] [INFO ] [MAIN ] GHY: Loaded 20903 existing records. [2025-09-26T19:03:17.199863] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:17.200310] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-26T19:03:17.200432] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-26T19:03:17.201349] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-26T19:03:17.201413] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-26T19:03:17.528636] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T19:03:17.551326] [INFO ] [REMOTE ] GHLD: Full fetch complete (4769 records). [2025-09-26T19:03:17.569326] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-26T19:03:17.576764] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-26T19:03:17.616015] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:18.031740] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-26T19:03:18.031831] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-26T19:03:18.031975] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-26T19:03:18.032014] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-26T19:03:18.032416] [DEBUG] [LOCAL ] GHLD: Trimmed 4769 records to 4168 (keeping 200 days of data) [2025-09-26T19:03:18.062189] [DEBUG] [LOCAL ] GHLD: Primary data saved (4168 records). [2025-09-26T19:03:18.062347] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-26T19:03:18.062460] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHLD took 25.9s. Estimated remaining: 3h 10m 38s. Rate: 7.6 symbols/min [2025-09-26T19:03:18.257716] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:18.308334] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-26T19:03:18.322595] [DEBUG] [LOCAL ] GIB: Loaded 32311 existing records from primary storage. [2025-09-26T19:03:18.322781] [INFO ] [MAIN ] GIB: Loaded 32311 existing records. [2025-09-26T19:03:18.362418] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-26T19:03:18.509975] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:18.510226] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-26T19:03:18.510287] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-26T19:03:18.511539] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-26T19:03:18.511602] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-26T19:03:18.908821] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:19.073797] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-26T19:03:19.156723] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-26T19:03:19.944137] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:03:19.956677] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-26T19:03:20.756696] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-26T19:03:21.050573] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T19:03:21.556731] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-26T19:03:21.868865] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T19:03:22.356728] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-26T19:03:22.453346] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T19:03:23.156783] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-26T19:03:23.528075] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T19:03:23.956710] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-26T19:03:24.086472] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-26T19:03:24.756694] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-26T19:03:25.148702] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:03:25.556703] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-26T19:03:25.930377] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T19:03:26.356707] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-26T19:03:26.369720] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T19:03:26.371547] [INFO ] [REMOTE ] GHI: Full fetch complete (11647 records). [2025-09-26T19:03:26.371622] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-26T19:03:26.792051] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-26T19:03:26.792147] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-26T19:03:26.792465] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-26T19:03:26.792518] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-26T19:03:26.793567] [DEBUG] [LOCAL ] GHI: Trimmed 11647 records to 6963 (keeping 200 days of data) [2025-09-26T19:03:26.841866] [DEBUG] [LOCAL ] GHI: Primary data saved (6963 records). [2025-09-26T19:03:26.842038] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-26T19:03:26.842163] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHI took 37.2s. Estimated remaining: 3h 10m 31s. Rate: 7.6 symbols/min [2025-09-26T19:03:27.043113] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:27.060938] [DEBUG] [LOCAL ] GIC: Loaded 13732 existing records from primary storage. [2025-09-26T19:03:27.061085] [INFO ] [MAIN ] GIC: Loaded 13732 existing records. [2025-09-26T19:03:27.161786] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-26T19:03:27.261739] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:27.262088] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-26T19:03:27.262204] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-26T19:03:27.262909] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-26T19:03:27.262972] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-26T19:03:27.538203] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T19:03:27.677190] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:27.956781] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-26T19:03:28.311917] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T19:03:28.756742] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-26T19:03:29.065978] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T19:03:29.556749] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-26T19:03:30.051101] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:03:30.356736] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-26T19:03:30.548044] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T19:03:31.156760] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-26T19:03:31.567541] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T19:03:31.956754] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-26T19:03:32.560725] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-26T19:03:32.756718] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-26T19:03:32.834588] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-26T19:03:33.556737] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-26T19:03:34.296358] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:03:34.356747] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-26T19:03:34.722594] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T19:03:35.156718] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-26T19:03:35.331363] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:03:35.956712] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-26T19:03:36.388206] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-26T19:03:36.756737] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-26T19:03:37.526417] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:03:37.556709] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-26T19:03:37.792723] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-26T19:03:38.356703] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-26T19:03:38.440919] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T19:03:39.156729] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-26T19:03:39.656374] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:03:39.956755] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-26T19:03:40.219152] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-26T19:03:40.756729] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-26T19:03:40.873859] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T19:03:41.556730] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-26T19:03:42.155215] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T19:03:42.356765] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-26T19:03:42.591519] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T19:03:43.156727] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-26T19:03:43.574030] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-26T19:03:43.956754] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-26T19:03:44.240638] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T19:03:44.756767] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-26T19:03:45.043027] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T19:03:45.556734] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-26T19:03:45.602437] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-26T19:03:46.356743] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-26T19:03:46.939479] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:03:47.156710] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-26T19:03:47.401135] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T19:03:47.956693] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-26T19:03:48.185556] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T19:03:48.756766] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-26T19:03:49.552316] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T19:03:49.558796] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-26T19:03:49.560473] [INFO ] [REMOTE ] GIB: Full fetch complete (45368 records). [2025-09-26T19:03:49.560592] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-26T19:03:49.897526] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-26T19:03:49.942044] [INFO ] [REMOTE ] GHM: Full fetch complete (21666 records). [2025-09-26T19:03:49.976787] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-26T19:03:49.995201] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-26T19:03:50.031250] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-26T19:03:50.058337] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-26T19:03:50.073563] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-26T19:03:50.120357] [DEBUG] [LOCAL ] GIB: Trimmed 45368 records to 32653 (keeping 200 days of data) [2025-09-26T19:03:50.361709] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-26T19:03:50.513432] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-26T19:03:50.513791] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-26T19:03:50.514548] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-26T19:03:50.516078] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-26T19:03:50.520503] [DEBUG] [LOCAL ] GHM: Trimmed 21666 records to 14350 (keeping 200 days of data) [2025-09-26T19:03:50.691675] [DEBUG] [LOCAL ] GHM: Primary data saved (14350 records). [2025-09-26T19:03:50.692449] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-26T19:03:50.692629] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GHM took 35.2s. Estimated remaining: 3h 10m 48s. Rate: 7.5 symbols/min [2025-09-26T19:03:50.828362] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-26T19:03:50.850298] [INFO ] [REMOTE ] GHY: Full fetch complete (32103 records). [2025-09-26T19:03:50.861507] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-26T19:03:50.953262] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:51.254438] [DEBUG] [LOCAL ] GIB: Primary data saved (32653 records). [2025-09-26T19:03:51.260067] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-26T19:03:51.282989] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GIB took 33.2s. Estimated remaining: 3h 10m 29s. Rate: 7.5 symbols/min [2025-09-26T19:03:51.355459] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:03:51.306528] [DEBUG] [LOCAL ] GIL: Loaded 43565 existing records from primary storage. [2025-09-26T19:03:51.383715] [INFO ] [MAIN ] GIL: Loaded 43565 existing records. [2025-09-26T19:03:51.393844] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-26T19:03:51.613011] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-26T19:03:51.654505] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-26T19:03:51.711453] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:51.717613] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-26T19:03:51.730588] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-26T19:03:51.765436] [DEBUG] [LOCAL ] GHY: Trimmed 32103 records to 21190 (keeping 200 days of data) [2025-09-26T19:03:51.863753] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:51.864392] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-26T19:03:51.864445] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-26T19:03:51.866169] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-26T19:03:51.866255] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-26T19:03:52.187363] [DEBUG] [LOCAL ] GIS: Loaded 54065 existing records from primary storage. [2025-09-26T19:03:52.209435] [INFO ] [MAIN ] GIS: Loaded 54065 existing records. [2025-09-26T19:03:52.681108] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:52.687579] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:52.688081] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-26T19:03:52.688966] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-26T19:03:52.691668] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T19:03:52.691762] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-26T19:03:52.699842] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-26T19:03:52.700458] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-26T19:03:52.762242] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-26T19:03:53.109232] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:53.124013] [DEBUG] [LOCAL ] GHY: Primary data saved (21190 records). [2025-09-26T19:03:53.124148] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-26T19:03:53.124238] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GHY took 36.4s. Estimated remaining: 3h 10m 11s. Rate: 7.6 symbols/min [2025-09-26T19:03:53.306030] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:53.347748] [DEBUG] [LOCAL ] GKOS: Loaded 43265 existing records from primary storage. [2025-09-26T19:03:53.347895] [INFO ] [MAIN ] GKOS: Loaded 43265 existing records. [2025-09-26T19:03:53.557023] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-26T19:03:53.557266] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:53.558780] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-26T19:03:53.558849] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-26T19:03:53.560046] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-26T19:03:53.560114] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-26T19:03:53.974838] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T19:03:54.005108] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:54.032075] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T19:03:54.356761] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-26T19:03:55.156760] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-26T19:03:55.406325] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:03:55.410689] [INFO ] [REMOTE ] GIC: Full fetch complete (20297 records). [2025-09-26T19:03:55.410955] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-26T19:03:55.866927] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-26T19:03:55.890691] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-26T19:03:55.890801] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-26T19:03:55.891285] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-26T19:03:55.891329] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-26T19:03:55.892005] [DEBUG] [LOCAL ] GIC: Trimmed 20297 records to 13796 (keeping 200 days of data) [2025-09-26T19:03:55.960337] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-26T19:03:55.993493] [DEBUG] [LOCAL ] GIC: Primary data saved (13796 records). [2025-09-26T19:03:55.993770] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-26T19:03:55.993912] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GIC took 29.2s. Estimated remaining: 3h 9m 56s. Rate: 7.6 symbols/min [2025-09-26T19:03:56.197986] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:03:56.261979] [DEBUG] [LOCAL ] GL: Loaded 38157 existing records from primary storage. [2025-09-26T19:03:56.262222] [INFO ] [MAIN ] GL: Loaded 38157 existing records. [2025-09-26T19:03:56.463396] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:03:56.464026] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-26T19:03:56.464139] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-26T19:03:56.465629] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-26T19:03:56.465733] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-26T19:03:56.617275] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:03:56.767347] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-26T19:03:56.907706] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:03:57.556738] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-26T19:03:57.637913] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T19:03:58.319447] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T19:03:58.356765] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-26T19:03:59.156753] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-26T19:03:59.524084] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T19:03:59.875365] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:03:59.956756] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-26T19:04:00.726505] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T19:04:00.756686] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-26T19:04:01.556702] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-26T19:04:01.872861] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T19:04:02.356740] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-26T19:04:02.401181] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T19:04:03.155779] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:04:03.165739] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-26T19:04:03.961208] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-26T19:04:03.972248] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T19:04:04.625360] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T19:04:04.756777] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-26T19:04:05.556742] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-26T19:04:05.888321] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T19:04:06.356716] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-26T19:04:06.398316] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:04:07.156738] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-26T19:04:07.222871] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:04:07.956732] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-26T19:04:08.330361] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T19:04:08.751185] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:04:08.760587] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-26T19:04:09.542418] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:04:09.556687] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-26T19:04:10.356721] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-26T19:04:10.918418] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-26T19:04:11.025937] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T19:04:11.156767] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-26T19:04:11.844527] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-26T19:04:11.956809] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-26T19:04:12.756793] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-26T19:04:12.989909] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:04:13.556747] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-26T19:04:13.878797] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T19:04:14.251816] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:04:14.356678] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-26T19:04:15.122551] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T19:04:15.156740] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-26T19:04:15.961861] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-26T19:04:15.978224] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:04:16.756734] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-26T19:04:16.966846] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:04:16.975849] [INFO ] [REMOTE ] GKOS: Full fetch complete (59879 records). [2025-09-26T19:04:16.976032] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-26T19:04:17.401440] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-26T19:04:17.401732] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-26T19:04:17.402801] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-26T19:04:17.402931] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-26T19:04:17.404959] [DEBUG] [LOCAL ] GKOS: Trimmed 59879 records to 43585 (keeping 200 days of data) [2025-09-26T19:04:17.524716] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-26T19:04:17.557387] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-26T19:04:17.712797] [DEBUG] [LOCAL ] GKOS: Primary data saved (43585 records). [2025-09-26T19:04:17.712938] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-26T19:04:17.713027] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GKOS took 24.6s. Estimated remaining: 3h 10m 9s. Rate: 7.5 symbols/min [2025-09-26T19:04:17.896240] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:17.943618] [DEBUG] [LOCAL ] GLOB: Loaded 47734 existing records from primary storage. [2025-09-26T19:04:17.943846] [INFO ] [MAIN ] GLOB: Loaded 47734 existing records. [2025-09-26T19:04:18.142835] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:18.143086] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-26T19:04:18.143137] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-26T19:04:18.144381] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-26T19:04:18.144447] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-26T19:04:18.369227] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-26T19:04:18.544121] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:18.652783] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T19:04:19.156758] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-26T19:04:19.331942] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T19:04:19.343965] [INFO ] [REMOTE ] GIL: Full fetch complete (61403 records). [2025-09-26T19:04:19.344240] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-26T19:04:19.761261] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-26T19:04:19.761507] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-26T19:04:19.762679] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-26T19:04:19.762749] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-26T19:04:19.764467] [DEBUG] [LOCAL ] GIL: Trimmed 61403 records to 43906 (keeping 200 days of data) [2025-09-26T19:04:19.970757] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-26T19:04:20.109923] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T19:04:20.126671] [DEBUG] [LOCAL ] GIL: Primary data saved (43906 records). [2025-09-26T19:04:20.126952] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-26T19:04:20.127201] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GIL took 29.4s. Estimated remaining: 3h 9m 52s. Rate: 7.5 symbols/min [2025-09-26T19:04:20.313507] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:20.326228] [DEBUG] [LOCAL ] GLP: Loaded 9528 existing records from primary storage. [2025-09-26T19:04:20.326473] [INFO ] [MAIN ] GLP: Loaded 9528 existing records. [2025-09-26T19:04:20.532906] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:20.533399] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-26T19:04:20.533493] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-26T19:04:20.534219] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-26T19:04:20.534299] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-26T19:04:20.650809] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-26T19:04:20.772466] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-26T19:04:20.989092] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:21.556779] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-26T19:04:22.115122] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T19:04:22.363980] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-26T19:04:22.367201] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-26T19:04:22.505600] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:04:23.156734] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-26T19:04:23.956771] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-26T19:04:24.456124] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T19:04:24.527188] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-26T19:04:24.756768] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-26T19:04:25.382377] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T19:04:25.556733] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-26T19:04:26.356788] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-26T19:04:26.870175] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T19:04:27.156703] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-26T19:04:27.246518] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-26T19:04:27.257421] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-09-26T19:04:27.257685] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-26T19:04:27.679486] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-26T19:04:27.679745] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-26T19:04:27.681039] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-26T19:04:27.681149] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-26T19:04:27.683390] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 54455 (keeping 200 days of data) [2025-09-26T19:04:27.814816] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T19:04:27.957123] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-26T19:04:28.065491] [DEBUG] [LOCAL ] GIS: Primary data saved (54455 records). [2025-09-26T19:04:28.065719] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-26T19:04:28.065857] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GIS took 36.8s. Estimated remaining: 3h 9m 44s. Rate: 7.5 symbols/min [2025-09-26T19:04:28.241446] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:28.293736] [DEBUG] [LOCAL ] GLW: Loaded 54025 existing records from primary storage. [2025-09-26T19:04:28.293893] [INFO ] [MAIN ] GLW: Loaded 54025 existing records. [2025-09-26T19:04:28.480743] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:28.480970] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-26T19:04:28.481020] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-26T19:04:28.482545] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-26T19:04:28.482611] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-26T19:04:28.760719] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-26T19:04:28.903475] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:28.987903] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T19:04:29.051813] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T19:04:29.556715] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-26T19:04:30.356689] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-26T19:04:30.441622] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-26T19:04:30.660232] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T19:04:31.156736] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-26T19:04:31.956707] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-26T19:04:31.974673] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T19:04:32.230973] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T19:04:32.756753] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-26T19:04:33.556884] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-26T19:04:33.558271] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:04:34.356763] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-26T19:04:34.759223] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-26T19:04:35.140983] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T19:04:35.151355] [INFO ] [REMOTE ] GL: Full fetch complete (55449 records). [2025-09-26T19:04:35.151585] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-26T19:04:35.158399] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-26T19:04:35.188384] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-26T19:04:35.627934] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-26T19:04:35.628051] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-26T19:04:35.629295] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-26T19:04:35.629388] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-26T19:04:35.631146] [DEBUG] [LOCAL ] GL: Trimmed 55449 records to 38382 (keeping 200 days of data) [2025-09-26T19:04:35.914383] [DEBUG] [LOCAL ] GL: Primary data saved (38382 records). [2025-09-26T19:04:35.914700] [INFO ] [MAIN ] GL: Full history saved. [2025-09-26T19:04:35.916402] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GL took 39.9s. Estimated remaining: 3h 9m 36s. Rate: 7.5 symbols/min [2025-09-26T19:04:35.965899] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-26T19:04:36.176172] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:36.263906] [DEBUG] [LOCAL ] GM: Loaded 54118 existing records from primary storage. [2025-09-26T19:04:36.264188] [INFO ] [MAIN ] GM: Loaded 54118 existing records. [2025-09-26T19:04:36.549369] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:36.549742] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-26T19:04:36.549834] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-26T19:04:36.552012] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-26T19:04:36.552104] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-26T19:04:36.767951] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-26T19:04:36.949033] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T19:04:37.044985] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:37.088572] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T19:04:37.556739] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-26T19:04:38.356758] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-26T19:04:38.766378] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-26T19:04:38.852237] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T19:04:39.156765] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-26T19:04:39.373448] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T19:04:39.956745] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-26T19:04:40.669255] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T19:04:40.756747] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-26T19:04:41.046898] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-26T19:04:41.556725] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-26T19:04:41.583980] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T19:04:42.356738] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-26T19:04:43.156706] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-26T19:04:43.654073] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-26T19:04:43.961842] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-26T19:04:43.984486] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T19:04:44.756760] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-26T19:04:44.927022] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T19:04:44.930369] [INFO ] [REMOTE ] GLP: Full fetch complete (14318 records). [2025-09-26T19:04:44.930479] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-26T19:04:45.426365] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-26T19:04:45.426626] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-26T19:04:45.428625] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-26T19:04:45.427472] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-26T19:04:45.428780] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-26T19:04:45.440297] [DEBUG] [LOCAL ] GLP: Trimmed 14318 records to 9585 (keeping 200 days of data) [2025-09-26T19:04:45.499476] [DEBUG] [LOCAL ] GLP: Primary data saved (9585 records). [2025-09-26T19:04:45.499602] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-26T19:04:45.499716] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLP took 25.4s. Estimated remaining: 3h 9m 31s. Rate: 7.5 symbols/min [2025-09-26T19:04:45.569618] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-26T19:04:45.687140] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:45.741537] [DEBUG] [LOCAL ] GME: Loaded 54151 existing records from primary storage. [2025-09-26T19:04:45.741722] [INFO ] [MAIN ] GME: Loaded 54151 existing records. [2025-09-26T19:04:45.944437] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:45.944928] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-26T19:04:45.944997] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-26T19:04:45.946703] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-26T19:04:45.946770] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-26T19:04:46.329468] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:46.356713] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-26T19:04:46.600537] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T19:04:47.156753] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-26T19:04:47.613054] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-26T19:04:47.956691] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-26T19:04:48.521682] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T19:04:48.756762] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-26T19:04:49.556703] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-26T19:04:49.830332] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-26T19:04:50.057603] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T19:04:50.356697] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-26T19:04:50.632467] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T19:04:50.937036] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T19:04:51.156737] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-26T19:04:51.956775] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-26T19:04:52.756720] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-26T19:04:52.914889] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-26T19:04:53.164804] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T19:04:53.408332] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T19:04:53.418563] [INFO ] [REMOTE ] GLOB: Full fetch complete (63667 records). [2025-09-26T19:04:53.418742] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-26T19:04:53.568058] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-26T19:04:53.837744] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-26T19:04:53.837847] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-26T19:04:53.838721] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-26T19:04:53.838802] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-26T19:04:53.840165] [DEBUG] [LOCAL ] GLOB: Trimmed 63667 records to 48111 (keeping 200 days of data) [2025-09-26T19:04:54.126985] [DEBUG] [LOCAL ] GLOB: Primary data saved (48111 records). [2025-09-26T19:04:54.127217] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-26T19:04:54.127321] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GLOB took 36.4s. Estimated remaining: 3h 9m 24s. Rate: 7.5 symbols/min [2025-09-26T19:04:54.317041] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:04:54.361862] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-26T19:04:54.365005] [DEBUG] [LOCAL ] GMED: Loaded 48718 existing records from primary storage. [2025-09-26T19:04:54.365266] [INFO ] [MAIN ] GMED: Loaded 48718 existing records. [2025-09-26T19:04:54.611025] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:04:54.611603] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-26T19:04:54.611709] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-26T19:04:54.612984] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-26T19:04:54.613060] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-26T19:04:55.032152] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-26T19:04:55.049186] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:04:55.156698] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-26T19:04:55.654110] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-26T19:04:55.956748] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-26T19:04:56.761865] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-26T19:04:56.777735] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T19:04:56.882263] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-26T19:04:57.556710] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-26T19:04:58.168053] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-26T19:04:58.356724] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-26T19:04:59.156775] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-26T19:04:59.243622] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:04:59.289408] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-26T19:04:59.300343] [INFO ] [REMOTE ] GLW: Full fetch complete (77616 records). [2025-09-26T19:04:59.300486] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-26T19:04:59.709469] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-26T19:04:59.709558] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-26T19:04:59.710493] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-26T19:04:59.710562] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-26T19:04:59.712244] [DEBUG] [LOCAL ] GLW: Trimmed 77616 records to 54415 (keeping 200 days of data) [2025-09-26T19:04:59.956801] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-26T19:05:00.055235] [DEBUG] [LOCAL ] GLW: Primary data saved (54415 records). [2025-09-26T19:05:00.055397] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-26T19:05:00.055494] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GLW took 32.0s. Estimated remaining: 3h 9m 13s. Rate: 7.5 symbols/min [2025-09-26T19:05:00.238972] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:00.275487] [DEBUG] [LOCAL ] GMRE: Loaded 37959 existing records from primary storage. [2025-09-26T19:05:00.275634] [INFO ] [MAIN ] GMRE: Loaded 37959 existing records. [2025-09-26T19:05:00.461613] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:00.461894] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-26T19:05:00.461943] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-26T19:05:00.463027] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-26T19:05:00.463089] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-26T19:05:00.847523] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:00.847989] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-26T19:05:00.880707] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-26T19:05:01.556753] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-26T19:05:02.175336] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-26T19:05:02.223335] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-09-26T19:05:02.356763] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-26T19:05:02.560467] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:05:03.156745] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-26T19:05:03.956715] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-26T19:05:04.311107] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-26T19:05:04.343220] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T19:05:04.756718] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-26T19:05:04.820821] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T19:05:05.556767] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-26T19:05:06.356769] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-26T19:05:06.749737] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-26T19:05:06.897790] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T19:05:07.160847] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-26T19:05:07.176208] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T19:05:07.781187] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T19:05:07.956762] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-26T19:05:08.756724] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-26T19:05:09.201525] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T19:05:09.218047] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-26T19:05:09.218268] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-26T19:05:09.562756] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-26T19:05:09.646901] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:05:09.733515] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-26T19:05:09.733705] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-26T19:05:09.734800] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-26T19:05:09.734872] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-26T19:05:09.736613] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54508 (keeping 200 days of data) [2025-09-26T19:05:10.083629] [DEBUG] [LOCAL ] GM: Primary data saved (54508 records). [2025-09-26T19:05:10.083842] [INFO ] [MAIN ] GM: Full history saved. [2025-09-26T19:05:10.084375] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GM took 34.2s. Estimated remaining: 3h 9m 8s. Rate: 7.5 symbols/min [2025-09-26T19:05:10.275103] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:10.295302] [DEBUG] [LOCAL ] GNE: Loaded 17844 existing records from primary storage. [2025-09-26T19:05:10.295437] [INFO ] [MAIN ] GNE: Loaded 17844 existing records. [2025-09-26T19:05:10.363485] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-26T19:05:10.510503] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:10.511001] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-26T19:05:10.511075] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-26T19:05:10.511755] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-26T19:05:10.511847] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-26T19:05:10.908868] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:11.157191] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-26T19:05:11.157277] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-26T19:05:11.345286] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T19:05:11.957712] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-26T19:05:11.962984] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:05:12.012977] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T19:05:12.756730] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-26T19:05:13.278019] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T19:05:13.562470] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-26T19:05:13.582044] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T19:05:14.356723] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-26T19:05:15.028824] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:05:15.125540] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T19:05:15.156705] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-26T19:05:15.956745] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-26T19:05:16.716562] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-26T19:05:16.756722] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-26T19:05:17.556730] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-26T19:05:17.741829] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-26T19:05:18.356704] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-26T19:05:18.365453] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T19:05:18.900821] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T19:05:19.156732] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-26T19:05:19.956769] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-26T19:05:20.628672] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T19:05:20.756802] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-26T19:05:20.975774] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-26T19:05:21.556998] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-26T19:05:21.573583] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:05:21.709023] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T19:05:22.356770] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-26T19:05:23.156746] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-26T19:05:23.538710] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T19:05:23.956696] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-26T19:05:24.449534] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-26T19:05:24.756720] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-26T19:05:24.922120] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-26T19:05:24.931863] [INFO ] [REMOTE ] GMED: Full fetch complete (69396 records). [2025-09-26T19:05:24.932034] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-26T19:05:25.378464] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-26T19:05:25.378706] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-26T19:05:25.379846] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-26T19:05:25.380042] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-26T19:05:25.381737] [DEBUG] [LOCAL ] GMED: Trimmed 69396 records to 49096 (keeping 200 days of data) [2025-09-26T19:05:25.502434] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:05:25.601972] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-26T19:05:25.735777] [DEBUG] [LOCAL ] GMED: Primary data saved (49096 records). [2025-09-26T19:05:25.735937] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-26T19:05:25.736122] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMED took 31.6s. Estimated remaining: 3h 9m 12s. Rate: 7.5 symbols/min [2025-09-26T19:05:25.920862] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:25.961877] [DEBUG] [LOCAL ] GNK: Loaded 40802 existing records from primary storage. [2025-09-26T19:05:25.962021] [INFO ] [MAIN ] GNK: Loaded 40802 existing records. [2025-09-26T19:05:26.153076] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:26.153390] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-26T19:05:26.153441] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-26T19:05:26.155205] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-26T19:05:26.155273] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-26T19:05:26.389347] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-26T19:05:26.556072] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:26.745366] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T19:05:27.156733] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-26T19:05:27.370239] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-26T19:05:27.383049] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-09-26T19:05:27.383323] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-26T19:05:27.842508] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-26T19:05:27.842635] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-26T19:05:27.843747] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-26T19:05:27.843818] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-26T19:05:27.845474] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 54540 (keeping 200 days of data) [2025-09-26T19:05:27.958052] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-26T19:05:28.061382] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:05:28.236555] [DEBUG] [LOCAL ] GME: Primary data saved (54540 records). [2025-09-26T19:05:28.236750] [INFO ] [MAIN ] GME: Full history saved. [2025-09-26T19:05:28.236883] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GME took 42.7s. Estimated remaining: 3h 8m 55s. Rate: 7.5 symbols/min [2025-09-26T19:05:28.449290] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-26T19:05:28.458573] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:28.521581] [DEBUG] [LOCAL ] GNL: Loaded 47530 existing records from primary storage. [2025-09-26T19:05:28.521787] [INFO ] [MAIN ] GNL: Loaded 47530 existing records. [2025-09-26T19:05:28.762077] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-26T19:05:28.792439] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:28.792793] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-26T19:05:28.792869] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-26T19:05:28.794180] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-26T19:05:28.794263] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-26T19:05:29.306029] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:29.345189] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T19:05:29.556743] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-26T19:05:30.006155] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T19:05:30.011977] [INFO ] [REMOTE ] GNE: Full fetch complete (22344 records). [2025-09-26T19:05:30.012174] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-26T19:05:30.361829] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-26T19:05:30.438170] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-26T19:05:30.438260] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-26T19:05:30.438821] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-26T19:05:30.438888] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-26T19:05:30.439919] [DEBUG] [LOCAL ] GNE: Trimmed 22344 records to 17940 (keeping 200 days of data) [2025-09-26T19:05:30.568546] [DEBUG] [LOCAL ] GNE: Primary data saved (17940 records). [2025-09-26T19:05:30.568726] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-26T19:05:30.568831] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GNE took 20.5s. Estimated remaining: 3h 8m 39s. Rate: 7.5 symbols/min [2025-09-26T19:05:30.764799] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:30.823349] [DEBUG] [LOCAL ] GNRC: Loaded 45546 existing records from primary storage. [2025-09-26T19:05:30.823512] [INFO ] [MAIN ] GNRC: Loaded 45546 existing records. [2025-09-26T19:05:31.039866] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:05:31.045769] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:31.053738] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-26T19:05:31.053798] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-26T19:05:31.055144] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-26T19:05:31.055212] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-26T19:05:31.159952] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-26T19:05:31.457275] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:31.957554] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-26T19:05:31.962815] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-26T19:05:31.974543] [INFO ] [REMOTE ] GMRE: Full fetch complete (53587 records). [2025-09-26T19:05:31.974741] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-26T19:05:32.411291] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-26T19:05:32.411387] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-26T19:05:32.412215] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-26T19:05:32.412284] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-26T19:05:32.413906] [DEBUG] [LOCAL ] GMRE: Trimmed 53587 records to 38133 (keeping 200 days of data) [2025-09-26T19:05:32.674930] [DEBUG] [LOCAL ] GMRE: Primary data saved (38133 records). [2025-09-26T19:05:32.675108] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-26T19:05:32.675241] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GMRE took 32.6s. Estimated remaining: 3h 8m 22s. Rate: 7.6 symbols/min [2025-09-26T19:05:32.758387] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-26T19:05:32.864568] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:32.900160] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:05:32.914494] [DEBUG] [LOCAL ] GNT: Loaded 8105 existing records from primary storage. [2025-09-26T19:05:32.915252] [INFO ] [MAIN ] GNT: Loaded 8105 existing records. [2025-09-26T19:05:33.125858] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:33.126176] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-26T19:05:33.126230] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-26T19:05:33.126775] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-26T19:05:33.126840] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-26T19:05:33.552048] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:33.556673] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-26T19:05:33.752188] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-26T19:05:34.201481] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-26T19:05:34.356728] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-26T19:05:34.474752] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T19:05:34.767402] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-26T19:05:35.156755] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-26T19:05:35.741123] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-26T19:05:35.956765] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-26T19:05:36.732951] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:05:36.756730] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-26T19:05:37.532892] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T19:05:37.556690] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-26T19:05:38.222322] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-26T19:05:38.356776] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-26T19:05:39.156787] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-26T19:05:39.956718] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-26T19:05:40.013804] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T19:05:40.756753] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-26T19:05:41.051319] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T19:05:41.567992] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-26T19:05:41.596929] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T19:05:42.356699] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-26T19:05:42.389342] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:05:43.165419] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-26T19:05:43.167267] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T19:05:43.854797] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T19:05:43.865461] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-26T19:05:43.956765] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-26T19:05:44.756783] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-26T19:05:45.485749] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T19:05:45.556724] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-26T19:05:45.686437] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:05:46.172347] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T19:05:46.356778] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-26T19:05:47.156740] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-26T19:05:47.956748] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-26T19:05:48.177909] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T19:05:48.756806] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-26T19:05:48.878865] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T19:05:49.507284] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:05:49.556726] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-26T19:05:49.644457] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-26T19:05:49.647313] [INFO ] [REMOTE ] GNT: Full fetch complete (10695 records). [2025-09-26T19:05:49.647389] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-26T19:05:50.036234] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-26T19:05:50.036345] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-26T19:05:50.036622] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-26T19:05:50.036697] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-26T19:05:50.037309] [DEBUG] [LOCAL ] GNT: Trimmed 10695 records to 8177 (keeping 200 days of data) [2025-09-26T19:05:50.085433] [DEBUG] [LOCAL ] GNT: Primary data saved (8177 records). [2025-09-26T19:05:50.085574] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-26T19:05:50.085689] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNT took 17.4s. Estimated remaining: 3h 8m 29s. Rate: 7.5 symbols/min [2025-09-26T19:05:50.268493] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:05:50.278101] [DEBUG] [LOCAL ] GNTY: Loaded 7283 existing records from primary storage. [2025-09-26T19:05:50.278230] [INFO ] [MAIN ] GNTY: Loaded 7283 existing records. [2025-09-26T19:05:50.361866] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-26T19:05:50.497230] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:05:50.497627] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-26T19:05:50.497713] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-26T19:05:50.498123] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-26T19:05:50.498204] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-26T19:05:50.893151] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:05:51.157461] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-26T19:05:51.157380] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T19:05:51.923069] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:05:51.956694] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-26T19:05:52.756745] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-26T19:05:52.884226] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-26T19:05:53.327301] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-26T19:05:53.526072] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T19:05:53.556732] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-26T19:05:54.059850] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-26T19:05:54.356782] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-26T19:05:55.156756] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-26T19:05:55.766762] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T19:05:55.942614] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T19:05:55.956684] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-26T19:05:56.756737] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-26T19:05:57.556711] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-26T19:05:57.611076] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T19:05:58.324491] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T19:05:58.356704] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-26T19:05:59.136125] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:05:59.156689] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-26T19:05:59.183108] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:05:59.883150] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T19:05:59.956767] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-26T19:06:00.756725] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-26T19:06:01.556914] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-26T19:06:01.679712] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:06:01.681978] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T19:06:01.693809] [INFO ] [REMOTE ] GNK: Full fetch complete (56924 records). [2025-09-26T19:06:01.694149] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-26T19:06:02.142466] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-26T19:06:02.142585] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-26T19:06:02.143564] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-26T19:06:02.143634] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-26T19:06:02.146497] [DEBUG] [LOCAL ] GNK: Trimmed 56924 records to 41039 (keeping 200 days of data) [2025-09-26T19:06:02.368157] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-26T19:06:02.418928] [DEBUG] [LOCAL ] GNK: Primary data saved (41039 records). [2025-09-26T19:06:02.419126] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-26T19:06:02.419239] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNK took 36.7s. Estimated remaining: 3h 8m 27s. Rate: 7.5 symbols/min [2025-09-26T19:06:02.614372] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:02.675296] [DEBUG] [LOCAL ] GNW: Loaded 51708 existing records from primary storage. [2025-09-26T19:06:02.675538] [INFO ] [MAIN ] GNW: Loaded 51708 existing records. [2025-09-26T19:06:02.879018] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:02.879369] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-26T19:06:02.879425] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-26T19:06:02.880955] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-26T19:06:02.881043] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-26T19:06:03.159887] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-26T19:06:03.211552] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T19:06:03.295346] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:03.526891] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-26T19:06:03.956736] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-26T19:06:04.756711] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-26T19:06:04.866963] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:06:05.556790] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-26T19:06:05.752059] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-26T19:06:05.761217] [INFO ] [REMOTE ] GNRC: Full fetch complete (65314 records). [2025-09-26T19:06:05.761344] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-26T19:06:06.190315] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-26T19:06:06.190429] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-26T19:06:06.191392] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-26T19:06:06.191533] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-26T19:06:06.193368] [DEBUG] [LOCAL ] GNRC: Trimmed 65314 records to 45886 (keeping 200 days of data) [2025-09-26T19:06:06.382915] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-26T19:06:06.438466] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T19:06:06.487551] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:06:06.565792] [DEBUG] [LOCAL ] GNRC: Primary data saved (45886 records). [2025-09-26T19:06:06.565960] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-26T19:06:06.566763] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNRC took 36.0s. Estimated remaining: 3h 8m 14s. Rate: 7.5 symbols/min [2025-09-26T19:06:06.761778] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:06.813888] [DEBUG] [LOCAL ] GOF: Loaded 43105 existing records from primary storage. [2025-09-26T19:06:06.814112] [INFO ] [MAIN ] GOF: Loaded 43105 existing records. [2025-09-26T19:06:07.002329] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:07.002751] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-26T19:06:07.002810] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-26T19:06:07.004183] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-26T19:06:07.004246] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-26T19:06:07.161871] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-26T19:06:07.391611] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:07.890288] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-26T19:06:07.956729] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-26T19:06:08.186834] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-26T19:06:08.756789] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-26T19:06:09.556708] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-26T19:06:09.759848] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T19:06:10.356741] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-26T19:06:10.399783] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T19:06:10.403468] [INFO ] [REMOTE ] GNTY: Full fetch complete (10365 records). [2025-09-26T19:06:10.403694] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-26T19:06:10.809445] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-26T19:06:10.809550] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-26T19:06:10.809974] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-26T19:06:10.810050] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-26T19:06:10.810779] [DEBUG] [LOCAL ] GNTY: Trimmed 10365 records to 7353 (keeping 200 days of data) [2025-09-26T19:06:10.873677] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-26T19:06:10.895990] [DEBUG] [LOCAL ] GNTY: Primary data saved (7353 records). [2025-09-26T19:06:10.896129] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-26T19:06:10.896246] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GNTY took 20.8s. Estimated remaining: 3h 8m 0s. Rate: 7.5 symbols/min [2025-09-26T19:06:11.077236] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:11.114885] [DEBUG] [LOCAL ] GOLF: Loaded 31843 existing records from primary storage. [2025-09-26T19:06:11.115039] [INFO ] [MAIN ] GOLF: Loaded 31843 existing records. [2025-09-26T19:06:11.161919] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-26T19:06:11.314310] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:11.314688] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-26T19:06:11.314776] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-26T19:06:11.315757] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-26T19:06:11.315820] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-26T19:06:11.733229] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:11.956742] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-26T19:06:11.988157] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:06:12.756706] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-26T19:06:12.867835] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T19:06:13.079210] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T19:06:13.556719] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-26T19:06:14.297746] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:06:14.356771] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-26T19:06:15.156741] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-26T19:06:15.285232] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T19:06:15.349816] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T19:06:15.358893] [INFO ] [REMOTE ] GNL: Full fetch complete (68377 records). [2025-09-26T19:06:15.359021] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-26T19:06:15.806298] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-26T19:06:15.806406] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-26T19:06:15.807406] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-26T19:06:15.807486] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-26T19:06:15.809112] [DEBUG] [LOCAL ] GNL: Trimmed 68377 records to 47785 (keeping 200 days of data) [2025-09-26T19:06:15.989350] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-26T19:06:16.113533] [DEBUG] [LOCAL ] GNL: Primary data saved (47785 records). [2025-09-26T19:06:16.113715] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-26T19:06:16.113864] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNL took 47.9s. Estimated remaining: 3h 7m 48s. Rate: 7.6 symbols/min [2025-09-26T19:06:16.306786] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:16.354175] [DEBUG] [LOCAL ] GOOS: Loaded 45704 existing records from primary storage. [2025-09-26T19:06:16.354371] [INFO ] [MAIN ] GOOS: Loaded 45704 existing records. [2025-09-26T19:06:16.554156] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:16.554492] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-26T19:06:16.554552] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-26T19:06:16.555839] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-26T19:06:16.555913] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-26T19:06:16.763815] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-26T19:06:16.969796] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:17.000156] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:06:17.556740] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-26T19:06:17.808564] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:06:18.304430] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:06:18.356792] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-26T19:06:19.156740] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-26T19:06:19.455110] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T19:06:19.956749] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-26T19:06:20.302613] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T19:06:20.756787] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-26T19:06:20.868685] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T19:06:21.394856] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:06:21.556761] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-26T19:06:22.356720] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-26T19:06:22.484088] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:06:23.156788] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-26T19:06:23.360735] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T19:06:23.933261] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:06:23.956702] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-26T19:06:24.712919] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:06:24.756742] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-26T19:06:25.467316] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T19:06:25.556709] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-26T19:06:26.064972] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-26T19:06:26.356779] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-26T19:06:27.156768] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-26T19:06:27.380556] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T19:06:27.956774] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-26T19:06:28.224788] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T19:06:28.668518] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:06:28.756751] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-26T19:06:29.556682] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-26T19:06:29.670939] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:06:30.356737] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-26T19:06:30.582450] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:06:31.156765] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-26T19:06:31.461834] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-26T19:06:31.470982] [INFO ] [REMOTE ] GOF: Full fetch complete (62208 records). [2025-09-26T19:06:31.471171] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-26T19:06:31.907023] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-26T19:06:31.907160] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-26T19:06:31.908048] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-26T19:06:31.908120] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-26T19:06:31.909623] [DEBUG] [LOCAL ] GOF: Trimmed 62208 records to 43374 (keeping 200 days of data) [2025-09-26T19:06:31.969693] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-26T19:06:32.200023] [DEBUG] [LOCAL ] GOF: Primary data saved (43374 records). [2025-09-26T19:06:32.200341] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-26T19:06:32.202194] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOF took 25.6s. Estimated remaining: 3h 7m 52s. Rate: 7.5 symbols/min [2025-09-26T19:06:32.383521] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-26T19:06:32.444085] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:32.491074] [DEBUG] [LOCAL ] GOTU: Loaded 39241 existing records from primary storage. [2025-09-26T19:06:32.491248] [INFO ] [MAIN ] GOTU: Loaded 39241 existing records. [2025-09-26T19:06:32.698021] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:32.698624] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-26T19:06:32.698768] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-26T19:06:32.708701] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-26T19:06:32.722080] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-26T19:06:32.761808] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-26T19:06:32.804606] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:06:33.129387] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:33.485047] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-26T19:06:33.556714] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-26T19:06:34.356730] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-26T19:06:34.589568] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:06:35.156735] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-26T19:06:35.204485] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T19:06:35.720252] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T19:06:35.956737] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-26T19:06:36.756694] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-26T19:06:37.132007] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:06:37.145122] [INFO ] [REMOTE ] GNW: Full fetch complete (73507 records). [2025-09-26T19:06:37.145330] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-26T19:06:37.569274] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-26T19:06:37.594890] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-26T19:06:37.594998] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-26T19:06:37.596084] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-26T19:06:37.596154] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-26T19:06:37.598471] [DEBUG] [LOCAL ] GNW: Trimmed 73507 records to 52086 (keeping 200 days of data) [2025-09-26T19:06:37.625297] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T19:06:37.943858] [DEBUG] [LOCAL ] GNW: Primary data saved (52086 records). [2025-09-26T19:06:37.944003] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-26T19:06:37.944093] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GNW took 35.5s. Estimated remaining: 3h 7m 41s. Rate: 7.5 symbols/min [2025-09-26T19:06:38.159485] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:38.173993] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T19:06:38.225963] [DEBUG] [LOCAL ] GPC: Loaded 46980 existing records from primary storage. [2025-09-26T19:06:38.226160] [INFO ] [MAIN ] GPC: Loaded 46980 existing records. [2025-09-26T19:06:38.361905] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-26T19:06:38.431918] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:38.432180] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-26T19:06:38.432233] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-26T19:06:38.433855] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-26T19:06:38.433919] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-26T19:06:38.868164] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:38.907814] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T19:06:39.156739] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-26T19:06:39.956754] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-26T19:06:40.120363] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:06:40.756713] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-26T19:06:41.012754] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T19:06:41.556696] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-26T19:06:41.735818] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T19:06:42.318291] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:06:42.356685] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-26T19:06:43.156770] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-26T19:06:43.383484] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:06:43.956748] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-26T19:06:44.108749] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T19:06:44.174106] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:06:44.756735] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-26T19:06:45.556701] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-26T19:06:45.747695] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T19:06:45.756466] [INFO ] [REMOTE ] GOOS: Full fetch complete (65782 records). [2025-09-26T19:06:45.756619] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-26T19:06:46.163525] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-26T19:06:46.163752] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-26T19:06:46.164585] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-26T19:06:46.164699] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-26T19:06:46.179691] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T19:06:46.185084] [DEBUG] [LOCAL ] GOOS: Trimmed 65782 records to 46008 (keeping 200 days of data) [2025-09-26T19:06:46.186275] [INFO ] [REMOTE ] GOLF: Full fetch complete (44905 records). [2025-09-26T19:06:46.186627] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-26T19:06:46.362215] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-26T19:06:46.736109] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-26T19:06:46.736214] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-26T19:06:46.737323] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-26T19:06:46.737407] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-26T19:06:46.740967] [DEBUG] [LOCAL ] GOLF: Trimmed 44905 records to 32049 (keeping 200 days of data) [2025-09-26T19:06:47.029597] [DEBUG] [LOCAL ] GOOS: Primary data saved (46008 records). [2025-09-26T19:06:47.034484] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-26T19:06:47.035352] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 30.9s. Estimated remaining: 3h 7m 35s. Rate: 7.5 symbols/min [2025-09-26T19:06:47.298129] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:06:47.312770] [DEBUG] [LOCAL ] GOLF: Primary data saved (32049 records). [2025-09-26T19:06:47.313104] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-26T19:06:47.313237] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GOLF took 36.4s. Estimated remaining: 3h 7m 16s. Rate: 7.6 symbols/min [2025-09-26T19:06:47.326461] [DEBUG] [LOCAL ] GPI: Loaded 15035 existing records from primary storage. [2025-09-26T19:06:47.326630] [INFO ] [MAIN ] GPI: Loaded 15035 existing records. [2025-09-26T19:06:47.535087] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:06:47.549806] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-26T19:06:47.551105] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-26T19:06:47.561633] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-26T19:06:47.562710] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-26T19:06:47.563739] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-26T19:06:47.563809] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-26T19:06:47.971506] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:06:47.971954] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-26T19:06:47.998986] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:06:48.756732] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-26T19:06:48.851750] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-26T19:06:49.305942] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:06:49.556707] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-26T19:06:50.283792] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-26T19:06:50.356693] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-26T19:06:50.671913] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T19:06:51.156738] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-26T19:06:51.757709] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-26T19:06:51.956711] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-26T19:06:52.181278] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:06:52.756735] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-26T19:06:53.384698] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:06:53.556742] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-26T19:06:54.356754] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-26T19:06:54.809347] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T19:06:54.933223] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T19:06:55.156737] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-26T19:06:55.896409] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T19:06:55.956685] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-26T19:06:56.291488] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T19:06:56.756754] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-26T19:06:57.214504] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T19:06:57.222556] [INFO ] [REMOTE ] GOTU: Full fetch complete (59639 records). [2025-09-26T19:06:57.222751] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-26T19:06:57.561878] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-26T19:06:57.682816] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-26T19:06:57.690597] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-26T19:06:57.692198] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-26T19:06:57.692557] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T19:06:57.692744] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-26T19:06:57.697511] [DEBUG] [LOCAL ] GOTU: Trimmed 59639 records to 39533 (keeping 200 days of data) [2025-09-26T19:06:57.930222] [DEBUG] [LOCAL ] GOTU: Primary data saved (39533 records). [2025-09-26T19:06:57.930391] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-26T19:06:57.930815] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GOTU took 25.7s. Estimated remaining: 3h 7m 12s. Rate: 7.5 symbols/min [2025-09-26T19:06:58.356740] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-26T19:06:59.390921] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T19:06:59.390007] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:06:59.405861] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-26T19:06:59.956744] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-26T19:07:00.110543] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T19:07:00.756727] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-26T19:07:01.637962] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-26T19:07:01.649330] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-26T19:07:01.725239] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T19:07:02.356727] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-26T19:07:03.316393] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T19:07:03.326566] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-26T19:07:03.406596] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:07:03.410033] [INFO ] [REMOTE ] GPI: Full fetch complete (20931 records). [2025-09-26T19:07:03.410136] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-26T19:07:03.815271] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-26T19:07:03.815354] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-26T19:07:03.815904] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-26T19:07:03.815970] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-26T19:07:03.816689] [DEBUG] [LOCAL ] GPI: Trimmed 20931 records to 15126 (keeping 200 days of data) [2025-09-26T19:07:03.917562] [DEBUG] [LOCAL ] GPI: Primary data saved (15126 records). [2025-09-26T19:07:03.917755] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-26T19:07:03.917861] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPI took 16.9s. Estimated remaining: 3h 7m 1s. Rate: 7.6 symbols/min [2025-09-26T19:07:04.855352] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:07:04.866496] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-26T19:07:06.530293] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T19:07:06.545426] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-26T19:07:08.468321] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T19:07:08.480101] [INFO ] [REMOTE ] GPC: Full fetch complete (69077 records). [2025-09-26T19:07:08.480283] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-26T19:07:08.916556] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-26T19:07:08.916669] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-26T19:07:08.917596] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-26T19:07:08.917684] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-26T19:07:08.919143] [DEBUG] [LOCAL ] GPC: Trimmed 69077 records to 47289 (keeping 200 days of data) [2025-09-26T19:07:09.229883] [DEBUG] [LOCAL ] GPC: Primary data saved (47289 records). [2025-09-26T19:07:09.230171] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-26T19:07:09.230296] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPC took 31.3s. Estimated remaining: 3h 6m 49s. Rate: 7.6 symbols/min [2025-09-26T19:07:09.838868] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:09.972359] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:09.931661] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:10.003626] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:10.010797] [DEBUG] [LOCAL ] GPJA: Loaded 4119 existing records from primary storage. [2025-09-26T19:07:10.010993] [INFO ] [MAIN ] GPJA: Loaded 4119 existing records. [2025-09-26T19:07:10.228808] [DEBUG] [LOCAL ] GPMT: Loaded 26703 existing records from primary storage. [2025-09-26T19:07:10.229397] [INFO ] [MAIN ] GPMT: Loaded 26703 existing records. [2025-09-26T19:07:10.326296] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:10.326848] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-26T19:07:10.326919] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-26T19:07:10.327384] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-26T19:07:10.327458] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-26T19:07:10.505533] [DEBUG] [LOCAL ] GPN: Loaded 52461 existing records from primary storage. [2025-09-26T19:07:10.511546] [DEBUG] [LOCAL ] GPK: Loaded 53051 existing records from primary storage. [2025-09-26T19:07:10.532674] [INFO ] [MAIN ] GPK: Loaded 53051 existing records. [2025-09-26T19:07:10.532468] [INFO ] [MAIN ] GPN: Loaded 52461 existing records. [2025-09-26T19:07:11.033360] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:11.111743] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-26T19:07:11.129875] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-26T19:07:11.149039] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:11.201026] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-26T19:07:11.226572] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-26T19:07:11.249724] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-26T19:07:11.265402] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-26T19:07:11.249614] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:11.294755] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-26T19:07:11.320408] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-26T19:07:11.320302] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-26T19:07:11.336471] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-26T19:07:11.450392] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-26T19:07:11.517463] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-26T19:07:11.636394] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:11.722216] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-26T19:07:12.509009] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:12.540921] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-26T19:07:12.528117] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:12.554886] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-26T19:07:12.591190] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T19:07:12.608786] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-26T19:07:12.655145] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:12.656038] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-26T19:07:13.565026] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T19:07:13.568571] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-26T19:07:13.896248] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T19:07:13.902703] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-26T19:07:13.940278] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:07:13.950883] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-26T19:07:14.115889] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T19:07:14.117521] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-26T19:07:14.440515] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T19:07:14.451375] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-26T19:07:14.822612] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T19:07:14.824226] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-26T19:07:15.074319] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-26T19:07:15.080071] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-26T19:07:15.248457] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T19:07:15.259726] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-26T19:07:15.405144] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T19:07:15.849779] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T19:07:15.956693] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-26T19:07:16.198162] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T19:07:16.433726] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-26T19:07:16.756719] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-26T19:07:17.075715] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:07:17.556722] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-26T19:07:18.052808] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-26T19:07:18.356724] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-26T19:07:19.156711] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-26T19:07:19.303400] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T19:07:19.684875] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T19:07:19.684580] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-26T19:07:19.956749] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-26T19:07:20.604271] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-26T19:07:20.756764] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-26T19:07:21.556729] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-26T19:07:22.357778] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T19:07:22.357895] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-26T19:07:22.854889] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:07:23.156736] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-26T19:07:23.759249] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T19:07:23.956722] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-26T19:07:24.195615] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-26T19:07:24.435681] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-26T19:07:24.437305] [INFO ] [REMOTE ] GPJA: Full fetch complete (7271 records). [2025-09-26T19:07:24.437396] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-26T19:07:24.761906] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-26T19:07:24.850449] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-26T19:07:24.850533] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-26T19:07:24.850763] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-26T19:07:24.850850] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-26T19:07:24.851324] [DEBUG] [LOCAL ] GPJA: Trimmed 7271 records to 4140 (keeping 200 days of data) [2025-09-26T19:07:24.880973] [DEBUG] [LOCAL ] GPJA: Primary data saved (4140 records). [2025-09-26T19:07:24.881131] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-26T19:07:24.881321] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPJA took 15.6s. Estimated remaining: 3h 6m 52s. Rate: 7.5 symbols/min [2025-09-26T19:07:25.062409] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:25.097291] [DEBUG] [LOCAL ] GPOR: Loaded 23115 existing records from primary storage. [2025-09-26T19:07:25.097451] [INFO ] [MAIN ] GPOR: Loaded 23115 existing records. [2025-09-26T19:07:25.282479] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:25.282883] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-26T19:07:25.282942] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-26T19:07:25.284306] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-26T19:07:25.284390] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-26T19:07:25.562025] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-26T19:07:25.656142] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:26.356711] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-26T19:07:26.450505] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T19:07:27.156767] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-26T19:07:27.612880] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T19:07:27.956723] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-26T19:07:28.057396] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:07:28.237827] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T19:07:28.756734] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-26T19:07:29.556691] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-26T19:07:29.876230] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T19:07:30.209732] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-26T19:07:30.356724] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-26T19:07:30.444008] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T19:07:31.156745] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-26T19:07:31.452748] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T19:07:31.456475] [INFO ] [REMOTE ] GPMT: Full fetch complete (37543 records). [2025-09-26T19:07:31.456598] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-26T19:07:31.860483] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-26T19:07:31.860580] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-26T19:07:31.861273] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-26T19:07:31.861338] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-26T19:07:31.862480] [DEBUG] [LOCAL ] GPMT: Trimmed 37543 records to 26788 (keeping 200 days of data) [2025-09-26T19:07:31.958033] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-26T19:07:32.032826] [DEBUG] [LOCAL ] GPMT: Primary data saved (26788 records). [2025-09-26T19:07:32.032997] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-26T19:07:32.033138] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPMT took 22.8s. Estimated remaining: 3h 6m 43s. Rate: 7.5 symbols/min [2025-09-26T19:07:32.214234] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:32.254399] [DEBUG] [LOCAL ] GPRK: Loaded 39489 existing records from primary storage. [2025-09-26T19:07:32.254569] [INFO ] [MAIN ] GPRK: Loaded 39489 existing records. [2025-09-26T19:07:32.446385] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:32.446694] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-26T19:07:32.446763] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-26T19:07:32.447938] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-26T19:07:32.448002] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-26T19:07:32.771983] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-26T19:07:32.840262] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:32.877023] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:07:33.556709] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-26T19:07:33.928258] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T19:07:34.172087] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:07:34.356782] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-26T19:07:35.089099] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:07:35.156749] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-26T19:07:35.956731] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-26T19:07:36.224408] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T19:07:36.756724] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-26T19:07:36.946665] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T19:07:37.387359] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T19:07:37.556720] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-26T19:07:38.356724] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-26T19:07:38.917810] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T19:07:38.933264] [INFO ] [REMOTE ] GPK: Full fetch complete (75466 records). [2025-09-26T19:07:38.933448] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-26T19:07:39.134759] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:07:39.161474] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-26T19:07:39.413554] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-26T19:07:39.413713] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-26T19:07:39.414689] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-26T19:07:39.414840] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-26T19:07:39.416481] [DEBUG] [LOCAL ] GPK: Trimmed 75466 records to 53441 (keeping 200 days of data) [2025-09-26T19:07:39.638730] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T19:07:39.789937] [DEBUG] [LOCAL ] GPK: Primary data saved (53441 records). [2025-09-26T19:07:39.790086] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-26T19:07:39.790688] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPK took 30.6s. Estimated remaining: 3h 6m 35s. Rate: 7.5 symbols/min [2025-09-26T19:07:39.971659] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-26T19:07:39.975259] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:40.009940] [DEBUG] [LOCAL ] GRBK: Loaded 27195 existing records from primary storage. [2025-09-26T19:07:40.010121] [INFO ] [MAIN ] GRBK: Loaded 27195 existing records. [2025-09-26T19:07:40.202875] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:40.203168] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-26T19:07:40.203219] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-26T19:07:40.203983] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-26T19:07:40.204047] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-26T19:07:40.645066] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:40.756721] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-26T19:07:40.964616] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T19:07:41.277165] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T19:07:41.556734] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-26T19:07:42.290486] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:07:42.356722] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-26T19:07:43.156745] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-26T19:07:43.573837] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:07:43.588120] [INFO ] [REMOTE ] GPN: Full fetch complete (74807 records). [2025-09-26T19:07:43.588495] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-26T19:07:43.958840] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-26T19:07:44.016465] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T19:07:44.068639] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-26T19:07:44.068977] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-26T19:07:44.070058] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-26T19:07:44.070171] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-26T19:07:44.085614] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-26T19:07:44.090741] [DEBUG] [LOCAL ] GPN: Trimmed 74807 records to 52822 (keeping 200 days of data) [2025-09-26T19:07:44.432906] [DEBUG] [LOCAL ] GPN: Primary data saved (52822 records). [2025-09-26T19:07:44.433053] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-26T19:07:44.433165] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 35.2s. Estimated remaining: 3h 6m 22s. Rate: 7.5 symbols/min [2025-09-26T19:07:44.615799] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:07:44.626429] [DEBUG] [LOCAL ] GRC: Loaded 8993 existing records from primary storage. [2025-09-26T19:07:44.626564] [INFO ] [MAIN ] GRC: Loaded 8993 existing records. [2025-09-26T19:07:44.761878] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-26T19:07:44.825008] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:07:44.825297] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-26T19:07:44.825352] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-26T19:07:44.825798] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-26T19:07:44.825866] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-26T19:07:45.197841] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:07:45.480234] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T19:07:45.556695] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-26T19:07:45.950350] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T19:07:46.356749] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-26T19:07:46.876304] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T19:07:47.156740] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-26T19:07:47.892418] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:07:47.956788] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-26T19:07:48.491466] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T19:07:48.756739] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-26T19:07:49.145071] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T19:07:49.556748] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-26T19:07:49.587291] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T19:07:50.356799] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-26T19:07:51.112954] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:07:51.156682] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-26T19:07:51.219056] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T19:07:51.956782] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-26T19:07:52.650867] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:07:52.756774] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-26T19:07:53.161484] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T19:07:53.522570] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T19:07:53.556709] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-26T19:07:54.356734] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-26T19:07:54.901473] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:07:55.156712] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-26T19:07:55.452895] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T19:07:55.956790] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-26T19:07:56.470148] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T19:07:56.756805] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-26T19:07:57.465225] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:07:57.556751] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-26T19:07:58.019384] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:07:58.356775] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-26T19:07:59.101793] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:07:59.156688] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-26T19:07:59.664740] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T19:07:59.671377] [INFO ] [REMOTE ] GPOR: Full fetch complete (34850 records). [2025-09-26T19:07:59.671621] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-26T19:07:59.961883] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-26T19:08:00.071590] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-26T19:08:00.071726] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-26T19:08:00.072424] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-26T19:08:00.072491] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-26T19:08:00.073546] [DEBUG] [LOCAL ] GPOR: Trimmed 34850 records to 23328 (keeping 200 days of data) [2025-09-26T19:08:00.235217] [DEBUG] [LOCAL ] GPOR: Primary data saved (23328 records). [2025-09-26T19:08:00.235387] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-26T19:08:00.235487] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GPOR took 35.4s. Estimated remaining: 3h 6m 26s. Rate: 7.5 symbols/min [2025-09-26T19:08:00.421287] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:00.443907] [DEBUG] [LOCAL ] GRDN: Loaded 19994 existing records from primary storage. [2025-09-26T19:08:00.444056] [INFO ] [MAIN ] GRDN: Loaded 19994 existing records. [2025-09-26T19:08:00.640250] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:00.640937] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-26T19:08:00.641091] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-26T19:08:00.642108] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-26T19:08:00.642178] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-26T19:08:00.771196] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-26T19:08:00.835529] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T19:08:00.991472] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T19:08:01.103012] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:01.556729] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-26T19:08:02.046456] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T19:08:02.356764] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-26T19:08:02.684052] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T19:08:03.156803] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-26T19:08:03.956882] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-26T19:08:03.969354] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T19:08:04.517272] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T19:08:04.525835] [INFO ] [REMOTE ] GPRK: Full fetch complete (57237 records). [2025-09-26T19:08:04.525965] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-26T19:08:04.761826] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-26T19:08:04.956846] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-26T19:08:04.956949] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-26T19:08:04.957793] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-26T19:08:04.957862] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-26T19:08:04.960624] [DEBUG] [LOCAL ] GPRK: Trimmed 57237 records to 39841 (keeping 200 days of data) [2025-09-26T19:08:05.200135] [DEBUG] [LOCAL ] GPRK: Primary data saved (39841 records). [2025-09-26T19:08:05.200297] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-26T19:08:05.200413] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GPRK took 33.2s. Estimated remaining: 3h 6m 13s. Rate: 7.5 symbols/min [2025-09-26T19:08:05.347174] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T19:08:05.405584] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:05.450813] [DEBUG] [LOCAL ] GRMN: Loaded 41576 existing records from primary storage. [2025-09-26T19:08:05.450984] [INFO ] [MAIN ] GRMN: Loaded 41576 existing records. [2025-09-26T19:08:05.561827] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-26T19:08:05.642589] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:05.646866] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-26T19:08:05.651455] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-26T19:08:05.651798] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-26T19:08:05.654469] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-26T19:08:05.655526] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-26T19:08:06.070116] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:06.356731] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-26T19:08:06.451121] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T19:08:07.156749] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-26T19:08:07.535579] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T19:08:07.956758] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-26T19:08:08.515208] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T19:08:08.762732] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-26T19:08:08.769882] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T19:08:09.556753] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-26T19:08:10.066040] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T19:08:10.072084] [INFO ] [REMOTE ] GRBK: Full fetch complete (40612 records). [2025-09-26T19:08:10.072314] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-26T19:08:10.351985] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T19:08:10.370125] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-26T19:08:10.499190] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-26T19:08:10.499298] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-26T19:08:10.500233] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-26T19:08:10.500298] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-26T19:08:10.501436] [DEBUG] [LOCAL ] GRBK: Trimmed 40612 records to 27375 (keeping 200 days of data) [2025-09-26T19:08:10.683124] [DEBUG] [LOCAL ] GRBK: Primary data saved (27375 records). [2025-09-26T19:08:10.683346] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-26T19:08:10.683467] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRBK took 30.9s. Estimated remaining: 3h 6m 2s. Rate: 7.5 symbols/min [2025-09-26T19:08:10.864610] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:10.918271] [DEBUG] [LOCAL ] GRND: Loaded 50356 existing records from primary storage. [2025-09-26T19:08:10.918486] [INFO ] [MAIN ] GRND: Loaded 50356 existing records. [2025-09-26T19:08:11.107600] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:11.107951] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-26T19:08:11.108005] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-26T19:08:11.109413] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-26T19:08:11.109476] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-26T19:08:11.162760] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-26T19:08:11.195270] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T19:08:11.489403] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:11.956738] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-26T19:08:12.109454] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-26T19:08:12.729317] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T19:08:12.756732] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-26T19:08:13.525394] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:08:13.556758] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-26T19:08:14.356745] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-26T19:08:14.436894] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-26T19:08:14.440093] [INFO ] [REMOTE ] GRC: Full fetch complete (13080 records). [2025-09-26T19:08:14.440241] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-26T19:08:14.832975] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-26T19:08:14.833092] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-26T19:08:14.833537] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-26T19:08:14.833603] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-26T19:08:14.834426] [DEBUG] [LOCAL ] GRC: Trimmed 13080 records to 9061 (keeping 200 days of data) [2025-09-26T19:08:14.896191] [DEBUG] [LOCAL ] GRC: Primary data saved (9061 records). [2025-09-26T19:08:14.896346] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-26T19:08:14.896482] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRC took 30.5s. Estimated remaining: 3h 5m 48s. Rate: 7.6 symbols/min [2025-09-26T19:08:15.075932] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:15.108269] [DEBUG] [LOCAL ] GRNT: Loaded 34006 existing records from primary storage. [2025-09-26T19:08:15.108414] [INFO ] [MAIN ] GRNT: Loaded 34006 existing records. [2025-09-26T19:08:15.164970] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-26T19:08:15.299331] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:15.299635] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-26T19:08:15.299756] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-26T19:08:15.300922] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-26T19:08:15.300986] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-26T19:08:15.685980] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:15.914492] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T19:08:15.956766] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-26T19:08:16.423561] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:08:16.756759] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-26T19:08:17.449932] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:08:17.556758] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-26T19:08:18.274534] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T19:08:18.356699] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-26T19:08:18.662207] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:08:19.156768] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-26T19:08:19.957991] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-26T19:08:19.961407] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:08:20.570890] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T19:08:20.670262] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-26T19:08:20.756755] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-26T19:08:21.556738] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-26T19:08:22.356766] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-26T19:08:22.395206] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-26T19:08:22.704246] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T19:08:23.156776] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-26T19:08:23.698152] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T19:08:23.956781] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-26T19:08:24.756798] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-26T19:08:24.935466] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T19:08:25.064558] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T19:08:25.556738] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-26T19:08:26.356770] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-26T19:08:26.467739] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T19:08:27.156810] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-26T19:08:27.240010] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T19:08:27.250998] [INFO ] [REMOTE ] GRDN: Full fetch complete (26061 records). [2025-09-26T19:08:27.251205] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-26T19:08:27.694252] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:08:27.779850] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-26T19:08:27.779938] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-26T19:08:27.780521] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-26T19:08:27.780608] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-26T19:08:27.781504] [DEBUG] [LOCAL ] GRDN: Trimmed 26061 records to 20178 (keeping 200 days of data) [2025-09-26T19:08:27.906810] [DEBUG] [LOCAL ] GRDN: Primary data saved (20178 records). [2025-09-26T19:08:27.906948] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-26T19:08:27.907063] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRDN took 27.7s. Estimated remaining: 3h 5m 48s. Rate: 7.5 symbols/min [2025-09-26T19:08:27.965262] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-26T19:08:28.098976] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:28.111774] [DEBUG] [LOCAL ] GROV: Loaded 9156 existing records from primary storage. [2025-09-26T19:08:28.111919] [INFO ] [MAIN ] GROV: Loaded 9156 existing records. [2025-09-26T19:08:28.293320] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:28.293710] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-26T19:08:28.293780] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-26T19:08:28.294249] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-26T19:08:28.294309] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-26T19:08:28.671359] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:28.756774] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-26T19:08:29.036330] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T19:08:29.556793] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-26T19:08:29.686097] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:08:29.725242] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T19:08:30.356769] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-26T19:08:31.141117] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T19:08:31.156693] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-26T19:08:31.246408] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T19:08:31.956742] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-26T19:08:32.675093] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T19:08:32.756747] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-26T19:08:33.404855] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T19:08:33.556768] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-26T19:08:34.356717] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-26T19:08:34.379321] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:08:34.491453] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:08:35.156760] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-26T19:08:35.956767] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-26T19:08:36.000800] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T19:08:36.167061] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-26T19:08:36.756740] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-26T19:08:37.377101] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T19:08:37.556723] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-26T19:08:38.357004] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-26T19:08:38.362884] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T19:08:38.962724] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:08:39.121204] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T19:08:39.156721] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-26T19:08:39.934859] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T19:08:39.956674] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-26T19:08:40.673035] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-26T19:08:40.756813] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-26T19:08:41.556730] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-26T19:08:42.356775] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-26T19:08:42.469370] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T19:08:42.721699] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-26T19:08:43.156781] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-26T19:08:43.956787] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-26T19:08:44.015825] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T19:08:44.024323] [INFO ] [REMOTE ] GRMN: Full fetch complete (60008 records). [2025-09-26T19:08:44.024574] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-26T19:08:44.506826] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-26T19:08:44.506966] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-26T19:08:44.507964] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-26T19:08:44.508060] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-26T19:08:44.509823] [DEBUG] [LOCAL ] GRMN: Trimmed 60008 records to 41798 (keeping 200 days of data) [2025-09-26T19:08:44.664904] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T19:08:44.779112] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-26T19:08:44.833319] [DEBUG] [LOCAL ] GRMN: Primary data saved (41798 records). [2025-09-26T19:08:44.833506] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-26T19:08:44.833660] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GRMN took 39.6s. Estimated remaining: 3h 5m 53s. Rate: 7.5 symbols/min [2025-09-26T19:08:45.021870] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:45.028046] [DEBUG] [LOCAL ] GRX: Loaded 4508 existing records from primary storage. [2025-09-26T19:08:45.028157] [INFO ] [MAIN ] GRX: Loaded 4508 existing records. [2025-09-26T19:08:45.221425] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:45.221958] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-26T19:08:45.222025] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-26T19:08:45.222561] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-26T19:08:45.222714] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-26T19:08:45.434201] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-26T19:08:45.557249] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-26T19:08:45.642442] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:46.349039] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T19:08:46.360971] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-26T19:08:46.364481] [INFO ] [REMOTE ] GRNT: Full fetch complete (48462 records). [2025-09-26T19:08:46.365729] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-26T19:08:46.365579] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T19:08:46.769506] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-26T19:08:46.769679] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-26T19:08:46.770421] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-26T19:08:46.770504] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-26T19:08:46.771765] [DEBUG] [LOCAL ] GRNT: Trimmed 48462 records to 34235 (keeping 200 days of data) [2025-09-26T19:08:46.978610] [DEBUG] [LOCAL ] GRNT: Primary data saved (34235 records). [2025-09-26T19:08:46.978788] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-26T19:08:46.978884] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRNT took 32.1s. Estimated remaining: 3h 5m 36s. Rate: 7.5 symbols/min [2025-09-26T19:08:47.158703] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-26T19:08:47.160475] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:47.215423] [DEBUG] [LOCAL ] GS: Loaded 52395 existing records from primary storage. [2025-09-26T19:08:47.215580] [INFO ] [MAIN ] GS: Loaded 52395 existing records. [2025-09-26T19:08:47.458619] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:47.458924] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-26T19:08:47.458975] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-26T19:08:47.460940] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-26T19:08:47.461002] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-26T19:08:47.842237] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:47.956713] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-26T19:08:47.997445] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T19:08:47.999349] [INFO ] [REMOTE ] GROV: Full fetch complete (14574 records). [2025-09-26T19:08:47.999436] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-26T19:08:48.429805] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-26T19:08:48.433470] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-26T19:08:48.433959] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-26T19:08:48.434661] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-26T19:08:48.441849] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T19:08:48.455193] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-26T19:08:48.454744] [DEBUG] [LOCAL ] GROV: Trimmed 14574 records to 9240 (keeping 200 days of data) [2025-09-26T19:08:48.510619] [DEBUG] [LOCAL ] GROV: Primary data saved (9240 records). [2025-09-26T19:08:48.510796] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-26T19:08:48.510945] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GROV took 20.6s. Estimated remaining: 3h 5m 19s. Rate: 7.5 symbols/min [2025-09-26T19:08:48.685374] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:08:48.731757] [DEBUG] [LOCAL ] GSBD: Loaded 39474 existing records from primary storage. [2025-09-26T19:08:48.731928] [INFO ] [MAIN ] GSBD: Loaded 39474 existing records. [2025-09-26T19:08:48.761821] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-26T19:08:48.919269] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:08:48.919522] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-26T19:08:48.919570] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-26T19:08:48.921048] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-26T19:08:48.921112] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-26T19:08:49.296515] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:08:49.415113] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T19:08:49.556731] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-26T19:08:50.040384] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T19:08:50.356747] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-26T19:08:51.156719] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-26T19:08:51.956697] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-26T19:08:52.290321] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-26T19:08:52.756739] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-26T19:08:53.027464] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-26T19:08:53.149532] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:08:53.556732] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-26T19:08:54.207770] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T19:08:54.356704] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-26T19:08:54.834032] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-26T19:08:55.156724] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-26T19:08:55.733637] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T19:08:55.963416] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-26T19:08:55.982830] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:08:56.508589] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T19:08:56.756729] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-26T19:08:57.556732] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-26T19:08:58.284985] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:08:58.356768] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-26T19:08:59.156704] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-26T19:08:59.554544] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T19:08:59.640844] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T19:08:59.730009] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T19:08:59.956720] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-26T19:09:00.583269] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-26T19:09:00.756727] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-26T19:09:01.556733] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-26T19:09:02.356724] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-26T19:09:02.409498] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:09:02.448085] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:09:03.156724] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-26T19:09:03.956736] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-26T19:09:04.147390] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T19:09:04.149790] [INFO ] [REMOTE ] GRX: Full fetch complete (6463 records). [2025-09-26T19:09:04.149925] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-26T19:09:04.303271] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T19:09:04.370556] [INFO ] [REMOTE ] GRND: Full fetch complete (70442 records). [2025-09-26T19:09:04.428229] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-26T19:09:04.761076] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-26T19:09:04.761006] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-26T19:09:04.814580] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-26T19:09:04.833699] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-26T19:09:04.851086] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-26T19:09:04.885268] [DEBUG] [LOCAL ] GRX: Trimmed 6463 records to 4547 (keeping 200 days of data) [2025-09-26T19:09:05.050832] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-26T19:09:05.050910] [DEBUG] [LOCAL ] GRX: Primary data saved (4547 records). [2025-09-26T19:09:05.051037] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-26T19:09:05.051151] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GRX took 20.2s. Estimated remaining: 3h 5m 24s. Rate: 7.5 symbols/min [2025-09-26T19:09:05.051232] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-26T19:09:05.063866] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-26T19:09:05.064061] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-26T19:09:05.163005] [DEBUG] [LOCAL ] GRND: Trimmed 70442 records to 50744 (keeping 200 days of data) [2025-09-26T19:09:05.296338] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:05.562836] [DEBUG] [LOCAL ] GSK: Loaded 53882 existing records from primary storage. [2025-09-26T19:09:05.563111] [INFO ] [MAIN ] GSK: Loaded 53882 existing records. [2025-09-26T19:09:05.718603] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T19:09:05.756873] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-26T19:09:05.825003] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:05.830718] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-26T19:09:05.834441] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-26T19:09:05.834383] [DEBUG] [LOCAL ] GRND: Primary data saved (50744 records). [2025-09-26T19:09:05.834599] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-26T19:09:05.835842] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GRND took 55.2s. Estimated remaining: 3h 5m 5s. Rate: 7.5 symbols/min [2025-09-26T19:09:05.847573] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-26T19:09:05.859283] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-26T19:09:06.212612] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:06.449897] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:06.450920] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-26T19:09:06.463353] [DEBUG] [LOCAL ] GSL: Loaded 33647 existing records from primary storage. [2025-09-26T19:09:06.463484] [INFO ] [MAIN ] GSL: Loaded 33647 existing records. [2025-09-26T19:09:06.654558] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:06.654825] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-26T19:09:06.654876] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-26T19:09:06.656217] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-26T19:09:06.656282] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-26T19:09:07.052036] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:07.108684] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-26T19:09:07.156682] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-26T19:09:07.326736] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T19:09:07.956725] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-26T19:09:08.346765] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-26T19:09:08.756742] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-26T19:09:09.505805] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-26T19:09:09.556737] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-26T19:09:09.804834] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T19:09:10.165796] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T19:09:10.356739] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-26T19:09:11.156738] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-26T19:09:11.713272] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-26T19:09:11.956712] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-26T19:09:12.077187] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T19:09:12.240358] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:09:12.756741] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-26T19:09:13.556733] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-26T19:09:13.616406] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T19:09:14.108498] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T19:09:14.356770] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-26T19:09:15.105095] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T19:09:15.156788] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-26T19:09:15.850515] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:09:15.956749] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-26T19:09:16.756713] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-26T19:09:16.869939] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:09:16.881392] [INFO ] [REMOTE ] GSBD: Full fetch complete (58367 records). [2025-09-26T19:09:16.881571] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-26T19:09:17.294587] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-26T19:09:17.294738] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-26T19:09:17.296147] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-26T19:09:17.296257] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-26T19:09:17.297997] [DEBUG] [LOCAL ] GSBD: Trimmed 58367 records to 39756 (keeping 200 days of data) [2025-09-26T19:09:17.556865] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-26T19:09:17.577345] [DEBUG] [LOCAL ] GSBD: Primary data saved (39756 records). [2025-09-26T19:09:17.577579] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-26T19:09:17.577843] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GSBD took 29.1s. Estimated remaining: 3h 5m 3s. Rate: 7.5 symbols/min [2025-09-26T19:09:17.763003] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:17.799011] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T19:09:17.886748] [DEBUG] [LOCAL ] GTES: Loaded 51024 existing records from primary storage. [2025-09-26T19:09:17.888676] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T19:09:17.887799] [INFO ] [MAIN ] GTES: Loaded 51024 existing records. [2025-09-26T19:09:18.105142] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:18.105525] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-26T19:09:18.105579] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-26T19:09:18.107571] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-26T19:09:18.107700] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-26T19:09:18.362153] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-26T19:09:18.518900] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:19.156830] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-26T19:09:19.797403] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-26T19:09:19.956833] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-26T19:09:20.356545] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T19:09:20.537723] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T19:09:20.756747] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-26T19:09:21.290006] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T19:09:21.556749] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-26T19:09:21.783169] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-26T19:09:22.356770] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-26T19:09:23.156707] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-26T19:09:23.668435] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T19:09:23.954731] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:09:23.964534] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-26T19:09:24.756741] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-26T19:09:25.272110] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-26T19:09:25.463472] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:09:25.556735] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-26T19:09:26.024484] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-26T19:09:26.356734] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-26T19:09:27.156752] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-26T19:09:27.791822] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T19:09:27.819964] [INFO ] [REMOTE ] GS: Full fetch complete (75751 records). [2025-09-26T19:09:27.822418] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-26T19:09:27.824842] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T19:09:27.961846] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-26T19:09:28.258306] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-26T19:09:28.258403] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-26T19:09:28.259322] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-26T19:09:28.259391] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-26T19:09:28.260930] [DEBUG] [LOCAL ] GS: Trimmed 75751 records to 52736 (keeping 200 days of data) [2025-09-26T19:09:28.634418] [DEBUG] [LOCAL ] GS: Primary data saved (52736 records). [2025-09-26T19:09:28.634597] [INFO ] [MAIN ] GS: Full history saved. [2025-09-26T19:09:28.634770] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GS took 41.7s. Estimated remaining: 3h 4m 59s. Rate: 7.5 symbols/min [2025-09-26T19:09:28.759805] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-26T19:09:28.832682] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:28.881884] [DEBUG] [LOCAL ] GTLS: Loaded 43161 existing records from primary storage. [2025-09-26T19:09:28.882069] [INFO ] [MAIN ] GTLS: Loaded 43161 existing records. [2025-09-26T19:09:29.080194] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:29.080587] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-26T19:09:29.080757] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-26T19:09:29.091950] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-26T19:09:29.107723] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-26T19:09:29.183057] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-26T19:09:29.467736] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-26T19:09:29.516876] [INFO ] [REMOTE ] GSL: Full fetch complete (47871 records). [2025-09-26T19:09:29.541484] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:29.537792] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-26T19:09:29.563883] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-26T19:09:29.969005] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-26T19:09:29.969091] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-26T19:09:29.969798] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-26T19:09:29.969904] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-26T19:09:29.971081] [DEBUG] [LOCAL ] GSL: Trimmed 47871 records to 33824 (keeping 200 days of data) [2025-09-26T19:09:30.210885] [DEBUG] [LOCAL ] GSL: Primary data saved (33824 records). [2025-09-26T19:09:30.211074] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-26T19:09:30.211189] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GSL took 24.4s. Estimated remaining: 3h 4m 42s. Rate: 7.5 symbols/min [2025-09-26T19:09:30.361889] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-26T19:09:30.425126] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:30.467750] [DEBUG] [LOCAL ] GTN: Loaded 46009 existing records from primary storage. [2025-09-26T19:09:30.467893] [INFO ] [MAIN ] GTN: Loaded 46009 existing records. [2025-09-26T19:09:30.686601] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:30.699944] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-26T19:09:30.700066] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-26T19:09:30.702274] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-26T19:09:30.702206] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:09:30.713457] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-26T19:09:31.079791] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:31.156729] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-26T19:09:31.531039] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-26T19:09:31.956698] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-26T19:09:32.044968] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T19:09:32.426894] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T19:09:32.756725] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-26T19:09:33.556724] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-26T19:09:34.099478] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T19:09:34.356762] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-26T19:09:34.357768] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:09:34.737181] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T19:09:35.156772] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-26T19:09:35.956782] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-26T19:09:36.296027] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T19:09:36.535033] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T19:09:36.756750] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-26T19:09:37.538390] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:09:37.556690] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-26T19:09:38.356732] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-26T19:09:38.780502] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:09:38.793711] [INFO ] [REMOTE ] GSK: Full fetch complete (77471 records). [2025-09-26T19:09:38.793894] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-26T19:09:39.159289] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-26T19:09:39.224577] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-26T19:09:39.224847] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-26T19:09:39.226039] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-26T19:09:39.226203] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-26T19:09:39.229433] [DEBUG] [LOCAL ] GSK: Trimmed 77471 records to 54272 (keeping 200 days of data) [2025-09-26T19:09:39.358447] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T19:09:39.633384] [DEBUG] [LOCAL ] GSK: Primary data saved (54272 records). [2025-09-26T19:09:39.633579] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-26T19:09:39.633735] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GSK took 34.6s. Estimated remaining: 3h 4m 36s. Rate: 7.5 symbols/min [2025-09-26T19:09:39.828589] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:39.861286] [DEBUG] [LOCAL ] GTY: Loaded 30597 existing records from primary storage. [2025-09-26T19:09:39.861449] [INFO ] [MAIN ] GTY: Loaded 30597 existing records. [2025-09-26T19:09:39.959464] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-26T19:09:40.059723] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:40.060067] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-26T19:09:40.060118] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-26T19:09:40.061210] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-26T19:09:40.061292] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-26T19:09:40.366413] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-26T19:09:40.485119] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:40.756752] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-26T19:09:40.824999] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-26T19:09:41.244366] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-26T19:09:41.556742] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-26T19:09:41.588255] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T19:09:42.356752] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-26T19:09:43.155912] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:09:43.165339] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-26T19:09:43.382333] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T19:09:43.956780] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-26T19:09:44.747616] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-26T19:09:44.756751] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-26T19:09:45.464817] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:09:45.556737] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-26T19:09:45.984579] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T19:09:46.356742] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-26T19:09:47.156735] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-26T19:09:47.199743] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T19:09:47.699768] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:09:47.956740] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-26T19:09:48.756695] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-26T19:09:48.883539] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T19:09:49.425601] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:09:49.556721] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-26T19:09:50.310525] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:09:50.356740] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-26T19:09:50.828211] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-26T19:09:51.156755] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-26T19:09:51.956699] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-26T19:09:52.032093] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-26T19:09:52.660164] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T19:09:52.756729] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-26T19:09:53.228560] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T19:09:53.556754] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-26T19:09:54.047704] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T19:09:54.356746] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-26T19:09:55.156700] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-26T19:09:55.340825] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T19:09:55.350924] [INFO ] [REMOTE ] GTES: Full fetch complete (73958 records). [2025-09-26T19:09:55.351095] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-26T19:09:55.792192] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:09:55.801845] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-26T19:09:55.802383] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-26T19:09:55.803574] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-26T19:09:55.804039] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-26T19:09:55.806903] [DEBUG] [LOCAL ] GTES: Trimmed 73958 records to 51399 (keeping 200 days of data) [2025-09-26T19:09:55.990834] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-26T19:09:56.139212] [DEBUG] [LOCAL ] GTES: Primary data saved (51399 records). [2025-09-26T19:09:56.139466] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-26T19:09:56.139673] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTES took 38.6s. Estimated remaining: 3h 4m 41s. Rate: 7.5 symbols/min [2025-09-26T19:09:56.326057] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:09:56.341281] [DEBUG] [LOCAL ] GUG: Loaded 12087 existing records from primary storage. [2025-09-26T19:09:56.341426] [INFO ] [MAIN ] GUG: Loaded 12087 existing records. [2025-09-26T19:09:56.589254] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:09:56.589747] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-26T19:09:56.589810] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-26T19:09:56.590489] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-26T19:09:56.590594] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-26T19:09:56.758077] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-26T19:09:57.035484] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T19:09:57.040094] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:09:57.556698] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-26T19:09:57.615819] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T19:09:58.197054] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T19:09:58.356738] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-26T19:09:59.156708] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-26T19:09:59.332051] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T19:09:59.341276] [INFO ] [REMOTE ] GTN: Full fetch complete (66409 records). [2025-09-26T19:09:59.341460] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-26T19:09:59.753810] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-26T19:09:59.753907] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-26T19:09:59.754780] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-26T19:09:59.754847] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-26T19:09:59.756289] [DEBUG] [LOCAL ] GTN: Trimmed 66409 records to 46301 (keeping 200 days of data) [2025-09-26T19:09:59.964381] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-26T19:10:00.080456] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T19:10:00.096228] [DEBUG] [LOCAL ] GTN: Primary data saved (46301 records). [2025-09-26T19:10:00.096364] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-26T19:10:00.097112] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTN took 29.9s. Estimated remaining: 3h 4m 27s. Rate: 7.5 symbols/min [2025-09-26T19:10:00.310619] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-26T19:10:00.314494] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:00.319130] [DEBUG] [LOCAL ] GUT: No existing data file found in primary storage. [2025-09-26T19:10:00.319202] [WARN ] [MAIN ] GUT: No existing data found, performing full refresh instead. [2025-09-26T19:10:00.319421] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-26T19:10:00.319493] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-26T19:10:00.319568] [DEBUG] [LOCAL ] GUT: No primary data file found to delete. [2025-09-26T19:10:00.319614] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-26T19:10:00.729578] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:00.756742] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-26T19:10:01.186884] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T19:10:01.556731] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-26T19:10:01.982722] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T19:10:02.356727] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-26T19:10:03.139489] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T19:10:03.146337] [INFO ] [REMOTE ] GTY: Full fetch complete (43355 records). [2025-09-26T19:10:03.146486] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-26T19:10:03.162460] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-26T19:10:03.267342] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T19:10:03.585688] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-26T19:10:03.585795] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-26T19:10:03.586467] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-26T19:10:03.586514] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-26T19:10:03.587974] [DEBUG] [LOCAL ] GTY: Trimmed 43355 records to 30796 (keeping 200 days of data) [2025-09-26T19:10:03.792086] [DEBUG] [LOCAL ] GTY: Primary data saved (30796 records). [2025-09-26T19:10:03.792249] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-26T19:10:03.792347] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GTY took 24.2s. Estimated remaining: 3h 4m 13s. Rate: 7.5 symbols/min [2025-09-26T19:10:03.959155] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-26T19:10:03.993639] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:04.031288] [DEBUG] [LOCAL ] GVA: Loaded 33882 existing records from primary storage. [2025-09-26T19:10:04.031464] [INFO ] [MAIN ] GVA: Loaded 33882 existing records. [2025-09-26T19:10:04.233201] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:04.233550] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-26T19:10:04.233609] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-26T19:10:04.235363] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-26T19:10:04.235427] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-26T19:10:04.564866] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:10:04.685216] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:04.756797] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-26T19:10:05.350450] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T19:10:05.360174] [INFO ] [REMOTE ] GTLS: Full fetch complete (61372 records). [2025-09-26T19:10:05.360335] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-26T19:10:05.568811] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-26T19:10:05.784924] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-26T19:10:05.793497] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-26T19:10:05.794425] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-26T19:10:05.794517] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-26T19:10:05.796400] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T19:10:05.802305] [DEBUG] [LOCAL ] GTLS: Trimmed 61372 records to 43461 (keeping 200 days of data) [2025-09-26T19:10:06.083735] [DEBUG] [LOCAL ] GTLS: Primary data saved (43461 records). [2025-09-26T19:10:06.083875] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-26T19:10:06.083965] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GTLS took 37.4s. Estimated remaining: 3h 3m 57s. Rate: 7.6 symbols/min [2025-09-26T19:10:06.264254] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:06.281383] [DEBUG] [LOCAL ] GWH: Loaded 15688 existing records from primary storage. [2025-09-26T19:10:06.281532] [INFO ] [MAIN ] GWH: Loaded 15688 existing records. [2025-09-26T19:10:06.361912] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-26T19:10:06.470249] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:06.470544] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-26T19:10:06.470716] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-26T19:10:06.471719] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-26T19:10:06.471780] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-26T19:10:06.846395] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:07.081138] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-26T19:10:07.124164] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:10:07.156782] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-26T19:10:07.956716] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-26T19:10:08.029497] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T19:10:08.756767] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-26T19:10:09.098041] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T19:10:09.556748] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-26T19:10:09.594037] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T19:10:10.356752] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-26T19:10:10.998087] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T19:10:11.156757] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-26T19:10:11.259452] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-26T19:10:11.956783] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-26T19:10:12.702110] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T19:10:12.756784] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-26T19:10:12.899624] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-26T19:10:13.417958] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-26T19:10:13.556743] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-26T19:10:14.338265] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T19:10:14.356704] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-26T19:10:15.156695] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-26T19:10:15.310964] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T19:10:15.956752] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-26T19:10:16.219741] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T19:10:16.756768] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-26T19:10:17.506215] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T19:10:17.556732] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-26T19:10:17.687549] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T19:10:18.356742] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-26T19:10:18.794078] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T19:10:19.156728] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-26T19:10:19.169528] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T19:10:19.956767] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-26T19:10:20.000086] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T19:10:20.756752] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-26T19:10:20.765333] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T19:10:21.556724] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-26T19:10:21.676721] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T19:10:21.679692] [INFO ] [REMOTE ] GUG: Full fetch complete (19921 records). [2025-09-26T19:10:21.679797] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-26T19:10:22.066698] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-26T19:10:22.066804] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-26T19:10:22.067371] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-26T19:10:22.067478] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-26T19:10:22.068484] [DEBUG] [LOCAL ] GUG: Trimmed 19921 records to 12138 (keeping 200 days of data) [2025-09-26T19:10:22.159853] [DEBUG] [LOCAL ] GUG: Primary data saved (12138 records). [2025-09-26T19:10:22.161315] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-26T19:10:22.161536] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GUG took 26.0s. Estimated remaining: 3h 4m 1s. Rate: 7.5 symbols/min [2025-09-26T19:10:22.161192] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:10:22.356841] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-26T19:10:22.376827] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:22.430088] [DEBUG] [LOCAL ] GWRE: Loaded 41257 existing records from primary storage. [2025-09-26T19:10:22.430311] [INFO ] [MAIN ] GWRE: Loaded 41257 existing records. [2025-09-26T19:10:22.665511] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:22.665921] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-26T19:10:22.666003] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-26T19:10:22.667769] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-26T19:10:22.667839] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-26T19:10:23.049049] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:23.156743] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-26T19:10:23.316845] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T19:10:23.956794] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-26T19:10:24.756703] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-26T19:10:24.864367] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:10:25.287410] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:10:25.556714] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-26T19:10:25.743764] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:10:26.356752] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-26T19:10:27.156712] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-26T19:10:27.228616] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T19:10:27.378556] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-26T19:10:27.956769] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-26T19:10:28.517093] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-26T19:10:28.756743] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-26T19:10:29.519677] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:10:29.556716] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-26T19:10:29.722116] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T19:10:30.356753] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-26T19:10:31.156717] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-26T19:10:31.227675] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T19:10:31.374783] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T19:10:31.956733] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-26T19:10:32.297762] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T19:10:32.756743] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-26T19:10:33.455085] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-26T19:10:33.556714] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-26T19:10:33.784755] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T19:10:34.356755] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-26T19:10:35.099505] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T19:10:35.156784] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-26T19:10:35.439996] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T19:10:35.443408] [INFO ] [REMOTE ] GUT: Full fetch complete (22910 records). [2025-09-26T19:10:35.443529] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-26T19:10:35.847184] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-26T19:10:35.847321] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-26T19:10:35.847908] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-26T19:10:35.847971] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-26T19:10:35.848688] [DEBUG] [LOCAL ] GUT: Trimmed 22910 records to 15560 (keeping 200 days of data) [2025-09-26T19:10:35.946529] [DEBUG] [LOCAL ] GUT: Primary data saved (15560 records). [2025-09-26T19:10:35.946716] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-26T19:10:35.946827] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GUT took 35.8s. Estimated remaining: 3h 4m 1s. Rate: 7.5 symbols/min [2025-09-26T19:10:35.963415] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-26T19:10:36.152183] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:36.175205] [DEBUG] [LOCAL ] GWW: Loaded 20010 existing records from primary storage. [2025-09-26T19:10:36.175355] [INFO ] [MAIN ] GWW: Loaded 20010 existing records. [2025-09-26T19:10:36.368984] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:36.369265] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-26T19:10:36.369316] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-26T19:10:36.370328] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-26T19:10:36.370394] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-26T19:10:36.785314] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:36.757706] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-26T19:10:36.814794] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T19:10:37.556728] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-26T19:10:37.679857] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:10:37.686141] [INFO ] [REMOTE ] GVA: Full fetch complete (48701 records). [2025-09-26T19:10:37.686312] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-26T19:10:38.120767] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-26T19:10:38.121006] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-26T19:10:38.122031] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-26T19:10:38.122132] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-26T19:10:38.140338] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:10:38.146854] [DEBUG] [LOCAL ] GVA: Trimmed 48701 records to 34030 (keeping 200 days of data) [2025-09-26T19:10:38.356977] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-26T19:10:38.363072] [DEBUG] [LOCAL ] GVA: Primary data saved (34030 records). [2025-09-26T19:10:38.364604] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-26T19:10:38.364772] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GVA took 34.6s. Estimated remaining: 3h 3m 45s. Rate: 7.5 symbols/min [2025-09-26T19:10:38.557038] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:38.603254] [DEBUG] [LOCAL ] GXO: Loaded 47927 existing records from primary storage. [2025-09-26T19:10:38.603401] [INFO ] [MAIN ] GXO: Loaded 47927 existing records. [2025-09-26T19:10:38.806271] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:38.806523] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-26T19:10:38.806620] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-26T19:10:38.808431] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-26T19:10:38.808506] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-26T19:10:39.166147] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-26T19:10:39.243967] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:39.269069] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T19:10:39.494327] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T19:10:39.956732] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-26T19:10:40.306305] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-26T19:10:40.756731] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-26T19:10:41.562983] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-26T19:10:41.566073] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T19:10:41.939247] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T19:10:42.356684] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-26T19:10:42.752615] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:10:42.757219] [INFO ] [REMOTE ] GWH: Full fetch complete (20932 records). [2025-09-26T19:10:42.757343] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-26T19:10:43.156424] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-26T19:10:43.156507] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-26T19:10:43.156986] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-26T19:10:43.157170] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-26T19:10:43.157043] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-26T19:10:43.158724] [DEBUG] [LOCAL ] GWH: Trimmed 20932 records to 15825 (keeping 200 days of data) [2025-09-26T19:10:43.248680] [DEBUG] [LOCAL ] GWH: Primary data saved (15825 records). [2025-09-26T19:10:43.248837] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-26T19:10:43.248995] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWH took 37.2s. Estimated remaining: 3h 3m 33s. Rate: 7.5 symbols/min [2025-09-26T19:10:43.428375] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:43.431868] [DEBUG] [LOCAL ] GYLD: Loaded 1558 existing records from primary storage. [2025-09-26T19:10:43.431954] [INFO ] [MAIN ] GYLD: Loaded 1558 existing records. [2025-09-26T19:10:43.623660] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:43.623978] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-26T19:10:43.624033] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-26T19:10:43.624355] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-26T19:10:43.624416] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-26T19:10:43.972619] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-26T19:10:44.015737] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:44.044374] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:10:44.383027] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T19:10:44.756772] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-26T19:10:45.108137] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T19:10:45.552410] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T19:10:45.560807] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-26T19:10:46.356748] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-26T19:10:46.711927] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-26T19:10:47.156781] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-26T19:10:47.246548] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:10:47.956766] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-26T19:10:48.385359] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-26T19:10:48.756737] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-26T19:10:49.556698] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-26T19:10:49.757235] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:10:50.018098] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T19:10:50.356741] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-26T19:10:51.156768] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-26T19:10:51.278926] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:10:51.288286] [INFO ] [REMOTE ] GWRE: Full fetch complete (61325 records). [2025-09-26T19:10:51.288474] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-26T19:10:51.699339] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-26T19:10:51.699422] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-26T19:10:51.700228] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-26T19:10:51.700311] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-26T19:10:51.701634] [DEBUG] [LOCAL ] GWRE: Trimmed 61325 records to 41564 (keeping 200 days of data) [2025-09-26T19:10:51.956737] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-26T19:10:51.973948] [DEBUG] [LOCAL ] GWRE: Primary data saved (41564 records). [2025-09-26T19:10:51.974133] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-26T19:10:51.974253] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GWRE took 29.8s. Estimated remaining: 3h 3m 26s. Rate: 7.5 symbols/min [2025-09-26T19:10:52.196388] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:10:52.209835] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T19:10:52.283437] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T19:10:52.300239] [DEBUG] [LOCAL ] H: Loaded 45216 existing records from primary storage. [2025-09-26T19:10:52.302879] [INFO ] [MAIN ] H: Loaded 45216 existing records. [2025-09-26T19:10:52.302708] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T19:10:52.508724] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:10:52.509075] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-26T19:10:52.509136] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-26T19:10:52.511550] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-26T19:10:52.511620] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-26T19:10:52.761889] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-26T19:10:52.898471] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:10:53.255866] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-26T19:10:53.556730] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-26T19:10:54.356718] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-26T19:10:54.706506] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-26T19:10:55.156762] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-26T19:10:55.782503] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:10:55.956741] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-26T19:10:56.561447] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:10:56.713144] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:10:56.756749] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-26T19:10:57.556717] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-26T19:10:57.978050] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-26T19:10:57.981771] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T19:10:58.356729] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-26T19:10:58.800370] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-26T19:10:59.156729] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-26T19:10:59.610460] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-26T19:10:59.956725] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-26T19:11:00.481083] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-26T19:11:00.756720] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-26T19:11:01.378960] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-26T19:11:01.380141] [INFO ] [REMOTE ] GYLD: Full fetch complete (2056 records). [2025-09-26T19:11:01.380216] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-26T19:11:01.556824] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-26T19:11:01.793446] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-26T19:11:01.793533] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-26T19:11:01.793671] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-26T19:11:01.793735] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-26T19:11:01.794094] [DEBUG] [LOCAL ] GYLD: Trimmed 2056 records to 1569 (keeping 200 days of data) [2025-09-26T19:11:01.804759] [DEBUG] [LOCAL ] GYLD: Primary data saved (1569 records). [2025-09-26T19:11:01.805024] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-26T19:11:01.805132] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GYLD took 18.6s. Estimated remaining: 3h 3m 21s. Rate: 7.5 symbols/min [2025-09-26T19:11:01.999800] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:02.038590] [DEBUG] [LOCAL ] HAE: Loaded 39857 existing records from primary storage. [2025-09-26T19:11:02.038782] [INFO ] [MAIN ] HAE: Loaded 39857 existing records. [2025-09-26T19:11:02.237307] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:02.237604] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-26T19:11:02.237692] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-26T19:11:02.239030] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-26T19:11:02.239101] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-26T19:11:02.361901] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-26T19:11:02.627594] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:02.869848] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T19:11:03.156767] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-26T19:11:03.513971] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-26T19:11:03.956772] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-26T19:11:04.467783] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-26T19:11:04.472307] [INFO ] [REMOTE ] GWW: Full fetch complete (29304 records). [2025-09-26T19:11:04.472413] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-26T19:11:04.765345] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-26T19:11:04.911108] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-26T19:11:04.911242] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-26T19:11:04.912101] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-26T19:11:04.912178] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-26T19:11:04.913632] [DEBUG] [LOCAL ] GWW: Trimmed 29304 records to 20108 (keeping 200 days of data) [2025-09-26T19:11:05.053933] [DEBUG] [LOCAL ] GWW: Primary data saved (20108 records). [2025-09-26T19:11:05.054133] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-26T19:11:05.054267] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. GWW took 29.1s. Estimated remaining: 3h 3m 6s. Rate: 7.5 symbols/min [2025-09-26T19:11:05.290072] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:05.337510] [DEBUG] [LOCAL ] HAFN: Loaded 43874 existing records from primary storage. [2025-09-26T19:11:05.337752] [INFO ] [MAIN ] HAFN: Loaded 43874 existing records. [2025-09-26T19:11:05.526820] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:05.527520] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-26T19:11:05.527732] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-26T19:11:05.528999] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-26T19:11:05.529069] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-26T19:11:05.560969] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-26T19:11:05.730505] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:11:05.957529] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:06.356768] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-26T19:11:06.451282] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T19:11:07.156723] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-26T19:11:07.197732] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:11:07.956736] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-26T19:11:08.217452] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:11:08.645091] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:11:08.756748] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-26T19:11:09.556743] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-26T19:11:09.602461] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T19:11:10.356724] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-26T19:11:10.418908] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T19:11:11.156874] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-26T19:11:11.489855] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-26T19:11:11.956741] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-26T19:11:11.995927] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:11:12.755412] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:11:12.764548] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-26T19:11:13.414390] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T19:11:13.556740] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-26T19:11:14.082098] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T19:11:14.356762] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-26T19:11:15.156770] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-26T19:11:15.294732] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T19:11:15.956751] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-26T19:11:16.014247] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-26T19:11:16.028802] [INFO ] [REMOTE ] GXO: Full fetch complete (70006 records). [2025-09-26T19:11:16.029044] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-26T19:11:16.471761] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-26T19:11:16.471865] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-26T19:11:16.472782] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-26T19:11:16.472897] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-26T19:11:16.477540] [DEBUG] [LOCAL ] GXO: Trimmed 70006 records to 48260 (keeping 200 days of data) [2025-09-26T19:11:16.761864] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-26T19:11:16.799919] [DEBUG] [LOCAL ] GXO: Primary data saved (48260 records). [2025-09-26T19:11:16.800093] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-26T19:11:16.800393] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. GXO took 38.4s. Estimated remaining: 3h 3m 3s. Rate: 7.5 symbols/min [2025-09-26T19:11:16.996242] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:17.061479] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-09-26T19:11:17.061762] [INFO ] [MAIN ] HAL: Loaded 54108 existing records. [2025-09-26T19:11:17.287026] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:17.303266] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-26T19:11:17.303489] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-26T19:11:17.306727] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-26T19:11:17.307354] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-26T19:11:17.378969] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-26T19:11:17.564087] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-26T19:11:17.719726] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:11:17.803415] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:17.838569] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-26T19:11:18.356777] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-26T19:11:19.037150] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:11:19.156741] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-26T19:11:19.956709] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-26T19:11:20.396326] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T19:11:20.756743] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-26T19:11:20.829818] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T19:11:21.404432] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T19:11:21.556736] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-26T19:11:22.198811] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-26T19:11:22.356757] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-26T19:11:23.156713] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-26T19:11:23.573014] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-26T19:11:23.716351] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T19:11:23.956742] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-26T19:11:24.756786] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-26T19:11:24.886483] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T19:11:25.394027] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T19:11:25.556734] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-26T19:11:26.168783] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T19:11:26.356797] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-26T19:11:27.003852] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-26T19:11:27.156750] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-26T19:11:27.956768] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-26T19:11:28.207885] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T19:11:28.707527] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T19:11:28.756726] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-26T19:11:29.556698] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-26T19:11:29.606498] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T19:11:30.356734] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-26T19:11:30.694668] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:11:31.156763] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-26T19:11:31.283260] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T19:11:31.294018] [INFO ] [REMOTE ] H: Full fetch complete (61875 records). [2025-09-26T19:11:31.294194] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-26T19:11:31.752333] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-26T19:11:31.752478] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-26T19:11:31.753463] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-26T19:11:31.753560] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-26T19:11:31.755317] [DEBUG] [LOCAL ] H: Trimmed 61875 records to 45492 (keeping 200 days of data) [2025-09-26T19:11:31.974126] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-26T19:11:32.025691] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:11:32.105078] [DEBUG] [LOCAL ] H: Primary data saved (45492 records). [2025-09-26T19:11:32.105221] [INFO ] [MAIN ] H: Full history saved. [2025-09-26T19:11:32.105311] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. H took 40.1s. Estimated remaining: 3h 3m 6s. Rate: 7.5 symbols/min [2025-09-26T19:11:32.288091] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:32.350795] [DEBUG] [LOCAL ] HASI: Loaded 47537 existing records from primary storage. [2025-09-26T19:11:32.350989] [INFO ] [MAIN ] HASI: Loaded 47537 existing records. [2025-09-26T19:11:32.535787] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:32.536067] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-26T19:11:32.536134] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-26T19:11:32.537825] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-26T19:11:32.537918] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-26T19:11:32.769880] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-26T19:11:32.913861] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:33.268076] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T19:11:33.556726] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-26T19:11:33.674725] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:11:33.684892] [INFO ] [REMOTE ] HAE: Full fetch complete (58009 records). [2025-09-26T19:11:33.685061] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-26T19:11:34.109827] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-26T19:11:34.109937] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-26T19:11:34.110760] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-26T19:11:34.110825] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-26T19:11:34.113289] [DEBUG] [LOCAL ] HAE: Trimmed 58009 records to 40176 (keeping 200 days of data) [2025-09-26T19:11:34.358603] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-26T19:11:34.371714] [DEBUG] [LOCAL ] HAE: Primary data saved (40176 records). [2025-09-26T19:11:34.371848] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-26T19:11:34.371958] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAE took 32.6s. Estimated remaining: 3h 2m 50s. Rate: 7.5 symbols/min [2025-09-26T19:11:34.577990] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:34.604034] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-26T19:11:34.615064] [INFO ] [REMOTE ] HAFN: Full fetch complete (65816 records). [2025-09-26T19:11:34.615230] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-26T19:11:34.902556] [DEBUG] [LOCAL ] HAYW: Loaded 49080 existing records from primary storage. [2025-09-26T19:11:34.935160] [INFO ] [MAIN ] HAYW: Loaded 49080 existing records. [2025-09-26T19:11:35.273940] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-26T19:11:35.290784] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-26T19:11:35.295672] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-26T19:11:35.295824] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:35.295955] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-26T19:11:35.296510] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-26T19:11:35.296580] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-26T19:11:35.298011] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-26T19:11:35.298313] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-26T19:11:35.298172] [DEBUG] [LOCAL ] HAFN: Trimmed 65816 records to 44189 (keeping 200 days of data) [2025-09-26T19:11:35.823184] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:35.825826] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-26T19:11:35.863612] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-26T19:11:35.974092] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-26T19:11:36.017129] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T19:11:36.075539] [DEBUG] [LOCAL ] HAFN: Primary data saved (44189 records). [2025-09-26T19:11:36.075709] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-26T19:11:36.076748] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HAFN took 31.0s. Estimated remaining: 3h 2m 33s. Rate: 7.5 symbols/min [2025-09-26T19:11:36.258059] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:36.268832] [DEBUG] [LOCAL ] HBB: Loaded 6893 existing records from primary storage. [2025-09-26T19:11:36.268968] [INFO ] [MAIN ] HBB: Loaded 6893 existing records. [2025-09-26T19:11:36.459813] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:36.460121] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-26T19:11:36.460174] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-26T19:11:36.460481] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-26T19:11:36.460545] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-26T19:11:36.758830] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-26T19:11:36.847210] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:37.021011] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:11:37.556717] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-26T19:11:37.932512] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T19:11:38.321453] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T19:11:38.356677] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-26T19:11:38.427446] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T19:11:39.156738] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-26T19:11:39.840975] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T19:11:39.956717] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-26T19:11:40.756732] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-26T19:11:40.965165] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T19:11:41.556753] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-26T19:11:42.042401] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-26T19:11:42.182186] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T19:11:42.338311] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:11:42.356677] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-26T19:11:43.156739] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-26T19:11:43.861351] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T19:11:43.956731] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-26T19:11:44.027153] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:11:44.756765] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-26T19:11:45.550839] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:11:45.561715] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-26T19:11:46.356767] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-26T19:11:46.482517] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T19:11:46.797411] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T19:11:47.156737] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-26T19:11:47.961860] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-26T19:11:47.975695] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T19:11:48.756756] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-26T19:11:49.192635] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T19:11:49.203839] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-26T19:11:49.204016] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-26T19:11:49.419207] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-26T19:11:49.559169] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-26T19:11:49.710582] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-26T19:11:49.710746] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-26T19:11:49.712022] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-26T19:11:49.712188] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-26T19:11:49.714429] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54498 (keeping 200 days of data) [2025-09-26T19:11:49.850792] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-26T19:11:50.103936] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-09-26T19:11:50.104090] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-26T19:11:50.104223] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HAL took 33.3s. Estimated remaining: 3h 2m 34s. Rate: 7.5 symbols/min [2025-09-26T19:11:50.295355] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:11:50.347847] [DEBUG] [LOCAL ] HBI: Loaded 53387 existing records from primary storage. [2025-09-26T19:11:50.348002] [INFO ] [MAIN ] HBI: Loaded 53387 existing records. [2025-09-26T19:11:50.361839] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-26T19:11:50.467802] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T19:11:50.559715] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:11:50.560066] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-26T19:11:50.560124] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-26T19:11:50.561531] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-26T19:11:50.561620] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-26T19:11:50.940194] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:11:51.156730] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-26T19:11:51.746392] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-26T19:11:51.956722] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-26T19:11:52.185638] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T19:11:52.756743] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-26T19:11:53.565342] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-26T19:11:53.571519] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T19:11:54.336455] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T19:11:54.356678] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-26T19:11:54.387104] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:11:55.156745] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-26T19:11:55.956703] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-26T19:11:56.122948] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T19:11:56.760259] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-26T19:11:56.766968] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T19:11:57.042266] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T19:11:57.556738] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-26T19:11:58.278539] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T19:11:58.356748] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-26T19:11:58.468038] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T19:11:59.156723] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-26T19:11:59.956726] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-26T19:12:00.166564] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T19:12:00.756732] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-26T19:12:01.057933] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T19:12:01.502260] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T19:12:01.503684] [INFO ] [REMOTE ] HBB: Full fetch complete (9796 records). [2025-09-26T19:12:01.503872] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-26T19:12:01.577756] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-26T19:12:01.846074] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T19:12:01.986195] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-26T19:12:01.986289] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-26T19:12:01.986553] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-26T19:12:01.986596] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-26T19:12:01.987234] [DEBUG] [LOCAL ] HBB: Trimmed 9796 records to 6912 (keeping 200 days of data) [2025-09-26T19:12:02.035950] [DEBUG] [LOCAL ] HBB: Primary data saved (6912 records). [2025-09-26T19:12:02.036105] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-26T19:12:02.036211] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HBB took 26.0s. Estimated remaining: 3h 2m 31s. Rate: 7.5 symbols/min [2025-09-26T19:12:02.215870] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:02.277227] [DEBUG] [LOCAL ] HBM: Loaded 53293 existing records from primary storage. [2025-09-26T19:12:02.277407] [INFO ] [MAIN ] HBM: Loaded 53293 existing records. [2025-09-26T19:12:02.361815] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-26T19:12:02.471247] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:02.471575] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-26T19:12:02.471634] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-26T19:12:02.473116] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-26T19:12:02.473183] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-26T19:12:02.856588] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:03.156700] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-26T19:12:03.284757] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:12:03.294729] [INFO ] [REMOTE ] HASI: Full fetch complete (68016 records). [2025-09-26T19:12:03.294882] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-26T19:12:03.752118] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-26T19:12:03.752309] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-26T19:12:03.753254] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-26T19:12:03.753335] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-26T19:12:03.754961] [DEBUG] [LOCAL ] HASI: Trimmed 68016 records to 47868 (keeping 200 days of data) [2025-09-26T19:12:03.974421] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-26T19:12:04.030541] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:12:04.105943] [DEBUG] [LOCAL ] HASI: Primary data saved (47868 records). [2025-09-26T19:12:04.106093] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-26T19:12:04.106198] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HASI took 32.0s. Estimated remaining: 3h 2m 15s. Rate: 7.5 symbols/min [2025-09-26T19:12:04.284974] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:04.336824] [DEBUG] [LOCAL ] HCA: Loaded 47438 existing records from primary storage. [2025-09-26T19:12:04.337031] [INFO ] [MAIN ] HCA: Loaded 47438 existing records. [2025-09-26T19:12:04.559377] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:04.559807] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-26T19:12:04.559940] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-26T19:12:04.561244] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-26T19:12:04.561309] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-26T19:12:04.761921] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-26T19:12:04.970898] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:05.002520] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T19:12:05.556702] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-26T19:12:05.756057] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-26T19:12:06.356705] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-26T19:12:06.571766] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:12:06.582452] [INFO ] [REMOTE ] HAYW: Full fetch complete (70956 records). [2025-09-26T19:12:06.582638] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-26T19:12:06.999459] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-26T19:12:06.999565] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-26T19:12:07.000551] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-26T19:12:07.000625] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-26T19:12:07.002468] [DEBUG] [LOCAL ] HAYW: Trimmed 70956 records to 49444 (keeping 200 days of data) [2025-09-26T19:12:07.173279] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-26T19:12:07.323706] [DEBUG] [LOCAL ] HAYW: Primary data saved (49444 records). [2025-09-26T19:12:07.334233] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-26T19:12:07.336188] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-26T19:12:07.335071] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HAYW took 33.0s. Estimated remaining: 3h 2m 1s. Rate: 7.5 symbols/min [2025-09-26T19:12:07.732347] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T19:12:07.956791] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-26T19:12:08.530197] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T19:12:08.756766] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-26T19:12:09.556717] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-26T19:12:09.729262] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T19:12:10.356702] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-26T19:12:10.638489] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:12:11.156699] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-26T19:12:11.298332] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:12:11.956732] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-26T19:12:12.193304] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-26T19:12:12.756694] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-26T19:12:12.939106] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T19:12:13.556847] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-26T19:12:13.794615] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:12:14.356755] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-26T19:12:14.640765] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T19:12:15.156694] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-26T19:12:15.381622] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-26T19:12:15.956714] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-26T19:12:16.131783] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:12:16.756731] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-26T19:12:17.137606] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T19:12:17.564861] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-26T19:12:17.571194] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:12:18.356739] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-26T19:12:18.538734] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T19:12:19.156786] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-26T19:12:19.371046] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:12:19.382072] [INFO ] [REMOTE ] HBI: Full fetch complete (76890 records). [2025-09-26T19:12:19.382248] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-26T19:12:19.820161] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-26T19:12:19.820317] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-26T19:12:19.821384] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-26T19:12:19.821540] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-26T19:12:19.823355] [DEBUG] [LOCAL ] HBI: Trimmed 76890 records to 53769 (keeping 200 days of data) [2025-09-26T19:12:20.185425] [DEBUG] [LOCAL ] HBI: Primary data saved (53769 records). [2025-09-26T19:12:20.185713] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-26T19:12:20.186202] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HBI took 30.1s. Estimated remaining: 3h 1m 60s. Rate: 7.5 symbols/min [2025-09-26T19:12:20.187954] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T19:12:20.199080] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-26T19:12:20.931869] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-26T19:12:20.943885] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-26T19:12:21.856302] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T19:12:21.866813] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-26T19:12:22.843251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-26T19:12:22.856139] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-26T19:12:23.250716] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:12:23.262078] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-26T19:12:24.554898] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:12:24.567236] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-26T19:12:25.036168] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:12:25.051163] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-26T19:12:26.981193] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-26T19:12:26.992513] [INFO ] [REMOTE ] HBM: Full fetch complete (76165 records). [2025-09-26T19:12:26.992703] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-26T19:12:27.294970] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-26T19:12:27.355571] [INFO ] [REMOTE ] HCA: Full fetch complete (68996 records). [2025-09-26T19:12:27.366545] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-26T19:12:27.578181] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-26T19:12:27.578579] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-26T19:12:27.579625] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-26T19:12:27.585141] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-26T19:12:27.641878] [DEBUG] [LOCAL ] HBM: Trimmed 76165 records to 53683 (keeping 200 days of data) [2025-09-26T19:12:27.998365] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-26T19:12:27.998791] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-26T19:12:28.000496] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-26T19:12:28.000583] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-26T19:12:28.020326] [DEBUG] [LOCAL ] HCA: Trimmed 68996 records to 47781 (keeping 200 days of data) [2025-09-26T19:12:28.562839] [DEBUG] [LOCAL ] HCA: Primary data saved (47781 records). [2025-09-26T19:12:28.563529] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-26T19:12:28.563954] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HCA took 24.5s. Estimated remaining: 3h 1m 52s. Rate: 7.5 symbols/min [2025-09-26T19:12:28.571466] [DEBUG] [LOCAL ] HBM: Primary data saved (53683 records). [2025-09-26T19:12:28.571551] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-26T19:12:28.572054] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HBM took 26.5s. Estimated remaining: 3h 1m 33s. Rate: 7.6 symbols/min [2025-09-26T19:12:29.228775] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:29.259823] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:29.264185] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:29.276314] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-26T19:12:29.282181] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-26T19:12:29.287911] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-26T19:12:29.312791] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-26T19:12:29.347615] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:29.347932] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-26T19:12:29.348106] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-26T19:12:29.486908] [DEBUG] [LOCAL ] HCI: Loaded 13999 existing records from primary storage. [2025-09-26T19:12:29.487401] [INFO ] [MAIN ] HCI: Loaded 13999 existing records. [2025-09-26T19:12:29.716754] [DEBUG] [LOCAL ] HCC: Loaded 45714 existing records from primary storage. [2025-09-26T19:12:29.779964] [INFO ] [MAIN ] HCC: Loaded 45714 existing records. [2025-09-26T19:12:30.038587] [DEBUG] [LOCAL ] HD: Loaded 53902 existing records from primary storage. [2025-09-26T19:12:30.084571] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:30.080605] [INFO ] [MAIN ] HD: Loaded 53902 existing records. [2025-09-26T19:12:30.174888] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-26T19:12:30.224148] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-26T19:12:30.196317] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:30.285293] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-26T19:12:30.309049] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-26T19:12:30.245817] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-26T19:12:30.405423] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:30.496162] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-26T19:12:30.518297] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-26T19:12:30.518440] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:30.539315] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-26T19:12:30.550673] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-26T19:12:30.550610] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-26T19:12:30.561336] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-26T19:12:30.608206] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-26T19:12:30.626745] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-26T19:12:31.038461] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T19:12:31.128574] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-26T19:12:31.537542] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:31.552246] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-26T19:12:31.572427] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-26T19:12:31.584744] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-26T19:12:31.671297] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:31.709246] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-26T19:12:31.713290] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:31.714805] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-26T19:12:32.013134] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T19:12:32.014085] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-26T19:12:32.634712] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-26T19:12:32.635875] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-26T19:12:32.646711] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T19:12:32.650908] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-26T19:12:32.900595] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-09-26T19:12:32.901515] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-26T19:12:33.151219] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-26T19:12:33.243503] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:12:33.498628] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:12:33.556716] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-26T19:12:33.752549] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-26T19:12:34.356757] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-26T19:12:35.092812] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T19:12:35.156735] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-26T19:12:35.214291] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T19:12:35.956736] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-26T19:12:36.281166] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-26T19:12:36.756787] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-26T19:12:36.986256] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-26T19:12:37.055325] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-26T19:12:37.556728] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-26T19:12:38.356765] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-26T19:12:38.646598] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-26T19:12:39.156773] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-26T19:12:39.541042] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-26T19:12:39.541864] [INFO ] [REMOTE ] HCXY: Full fetch complete (592 records). [2025-09-26T19:12:39.542109] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-26T19:12:39.542614] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:12:39.542720] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:12:39.542841] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:12:39.542914] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-26T19:12:39.542980] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-26T19:12:39.543016] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-26T19:12:39.543072] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-26T19:12:39.543184] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 11.0s. Estimated remaining: 3h 1m 29s. Rate: 7.5 symbols/min [2025-09-26T19:12:39.730897] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:39.762607] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-26T19:12:39.820335] [DEBUG] [LOCAL ] HDB: Loaded 52305 existing records from primary storage. [2025-09-26T19:12:39.820518] [INFO ] [MAIN ] HDB: Loaded 52305 existing records. [2025-09-26T19:12:39.964925] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-26T19:12:40.010039] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:40.010304] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-26T19:12:40.010353] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-26T19:12:40.012270] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-26T19:12:40.012334] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-26T19:12:40.399091] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:40.756740] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-26T19:12:41.556721] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-26T19:12:41.651552] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T19:12:41.913898] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T19:12:42.356751] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-26T19:12:43.156768] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-26T19:12:43.594567] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-26T19:12:43.956750] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-26T19:12:44.118146] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:12:44.756724] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-26T19:12:44.865200] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:12:45.019946] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T19:12:45.556729] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-26T19:12:46.356741] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-26T19:12:47.156755] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-26T19:12:47.239266] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T19:12:47.298863] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-26T19:12:47.320761] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-26T19:12:47.956739] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-26T19:12:48.649167] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:12:48.756749] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-26T19:12:48.959694] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T19:12:49.556736] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-26T19:12:50.356765] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-26T19:12:50.987200] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-26T19:12:51.156741] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-26T19:12:51.240267] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-26T19:12:51.289421] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T19:12:51.956763] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-26T19:12:52.756718] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-26T19:12:52.965021] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-26T19:12:53.327138] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-26T19:12:53.556737] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-26T19:12:54.083445] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:12:54.356731] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-26T19:12:55.156935] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-26T19:12:55.349892] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T19:12:55.638145] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-26T19:12:55.956743] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-26T19:12:56.209915] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:12:56.213727] [INFO ] [REMOTE ] HCI: Full fetch complete (19377 records). [2025-09-26T19:12:56.213938] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-26T19:12:56.613938] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-26T19:12:56.614052] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-26T19:12:56.614738] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-26T19:12:56.614830] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-26T19:12:56.615569] [DEBUG] [LOCAL ] HCI: Trimmed 19377 records to 14126 (keeping 200 days of data) [2025-09-26T19:12:56.711579] [DEBUG] [LOCAL ] HCI: Primary data saved (14126 records). [2025-09-26T19:12:56.711823] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-26T19:12:56.711951] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HCI took 28.1s. Estimated remaining: 3h 1m 34s. Rate: 7.5 symbols/min [2025-09-26T19:12:56.768952] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-26T19:12:56.900594] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:12:56.950282] [DEBUG] [LOCAL ] HE: Loaded 49539 existing records from primary storage. [2025-09-26T19:12:56.950444] [INFO ] [MAIN ] HE: Loaded 49539 existing records. [2025-09-26T19:12:57.139365] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:12:57.139705] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-26T19:12:57.139761] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-26T19:12:57.141318] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-26T19:12:57.141379] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-26T19:12:57.521715] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:12:57.557639] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-26T19:12:57.561327] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T19:12:58.356713] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-26T19:12:58.821970] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T19:12:59.156705] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-26T19:12:59.693509] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-26T19:12:59.733905] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:12:59.956774] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-26T19:13:00.756727] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-26T19:13:00.878179] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:13:01.556783] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-26T19:13:02.131779] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-26T19:13:02.278002] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T19:13:02.287146] [INFO ] [REMOTE ] HCC: Full fetch complete (64386 records). [2025-09-26T19:13:02.287285] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-26T19:13:02.361793] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-26T19:13:02.712399] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-26T19:13:02.712520] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-26T19:13:02.713463] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-26T19:13:02.713547] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-26T19:13:02.715188] [DEBUG] [LOCAL ] HCC: Trimmed 64386 records to 46057 (keeping 200 days of data) [2025-09-26T19:13:02.971544] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:13:03.045350] [DEBUG] [LOCAL ] HCC: Primary data saved (46057 records). [2025-09-26T19:13:03.045505] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-26T19:13:03.045600] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HCC took 34.5s. Estimated remaining: 3h 1m 24s. Rate: 7.5 symbols/min [2025-09-26T19:13:03.161896] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-26T19:13:03.225273] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:03.259681] [DEBUG] [LOCAL ] HEI: Loaded 32653 existing records from primary storage. [2025-09-26T19:13:03.259825] [INFO ] [MAIN ] HEI: Loaded 32653 existing records. [2025-09-26T19:13:03.449217] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:03.449520] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-26T19:13:03.449576] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-26T19:13:03.450509] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-26T19:13:03.450586] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-26T19:13:03.830043] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:03.956729] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-26T19:13:04.108125] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:13:04.756733] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-26T19:13:05.446934] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-26T19:13:05.457820] [INFO ] [REMOTE ] HD: Full fetch complete (77445 records). [2025-09-26T19:13:05.457995] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-26T19:13:05.559605] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-26T19:13:05.818596] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-26T19:13:05.963128] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-26T19:13:05.963218] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-26T19:13:05.964205] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-26T19:13:05.964275] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-26T19:13:05.966020] [DEBUG] [LOCAL ] HD: Trimmed 77445 records to 54283 (keeping 200 days of data) [2025-09-26T19:13:06.323341] [DEBUG] [LOCAL ] HD: Primary data saved (54283 records). [2025-09-26T19:13:06.323500] [INFO ] [MAIN ] HD: Full history saved. [2025-09-26T19:13:06.324333] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HD took 37.8s. Estimated remaining: 3h 1m 10s. Rate: 7.5 symbols/min [2025-09-26T19:13:06.356856] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-26T19:13:06.525716] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:06.565866] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T19:13:06.581613] [DEBUG] [LOCAL ] HEQ: Loaded 6173 existing records from primary storage. [2025-09-26T19:13:06.581904] [INFO ] [MAIN ] HEQ: Loaded 6173 existing records. [2025-09-26T19:13:06.765636] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:06.766060] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-26T19:13:06.766111] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-26T19:13:06.766539] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-26T19:13:06.766614] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-26T19:13:07.169744] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-26T19:13:07.174554] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:07.385022] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:13:07.956701] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-26T19:13:08.112392] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:13:08.756721] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-26T19:13:09.325199] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-26T19:13:09.423859] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T19:13:09.556757] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-26T19:13:10.356737] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-26T19:13:10.641118] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:13:10.652192] [INFO ] [REMOTE ] HDB: Full fetch complete (75250 records). [2025-09-26T19:13:10.652400] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-26T19:13:11.141330] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-26T19:13:11.141502] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-26T19:13:11.142574] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-26T19:13:11.142682] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-26T19:13:11.144458] [DEBUG] [LOCAL ] HDB: Trimmed 75250 records to 52695 (keeping 200 days of data) [2025-09-26T19:13:11.207415] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-26T19:13:11.361772] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:13:11.650085] [DEBUG] [LOCAL ] HDB: Primary data saved (52695 records). [2025-09-26T19:13:11.650386] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-26T19:13:11.650829] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HDB took 32.1s. Estimated remaining: 3h 0m 58s. Rate: 7.5 symbols/min [2025-09-26T19:13:11.948105] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:11.956805] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-26T19:13:11.970632] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-26T19:13:12.044483] [DEBUG] [LOCAL ] HESM: Loaded 48522 existing records from primary storage. [2025-09-26T19:13:12.044885] [INFO ] [MAIN ] HESM: Loaded 48522 existing records. [2025-09-26T19:13:12.296943] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:12.297565] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-26T19:13:12.297777] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-26T19:13:12.299485] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-26T19:13:12.299580] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-26T19:13:12.449723] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-26T19:13:12.750763] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:12.756688] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-26T19:13:13.480433] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T19:13:13.556745] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-26T19:13:14.356771] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-26T19:13:14.630978] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-26T19:13:15.053148] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:13:15.146096] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T19:13:15.156680] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-26T19:13:15.956706] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-26T19:13:16.021406] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T19:13:16.756747] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-26T19:13:17.508686] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T19:13:17.556711] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-26T19:13:18.356756] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-26T19:13:18.749939] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T19:13:19.101660] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-26T19:13:19.127555] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:13:19.156676] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-26T19:13:19.956764] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-26T19:13:20.740501] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T19:13:20.756679] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-26T19:13:21.560351] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-26T19:13:21.567539] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:13:22.318213] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:13:22.356712] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-26T19:13:22.419829] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-26T19:13:23.156782] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-26T19:13:23.736631] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:13:23.956764] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-26T19:13:24.561358] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T19:13:24.756731] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-26T19:13:24.785446] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:13:25.556734] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-26T19:13:26.011514] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T19:13:26.356749] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-26T19:13:26.886523] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T19:13:27.156728] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-26T19:13:27.678921] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T19:13:27.956721] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-26T19:13:28.756717] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-26T19:13:29.140544] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T19:13:29.556701] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-26T19:13:29.712810] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T19:13:30.136984] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:13:30.143565] [INFO ] [REMOTE ] HEI: Full fetch complete (48936 records). [2025-09-26T19:13:30.143703] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-26T19:13:30.260048] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-26T19:13:30.361980] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-26T19:13:30.561665] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-26T19:13:30.561758] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-26T19:13:30.562478] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-26T19:13:30.562541] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-26T19:13:30.564539] [DEBUG] [LOCAL ] HEI: Trimmed 48936 records to 32846 (keeping 200 days of data) [2025-09-26T19:13:30.787988] [DEBUG] [LOCAL ] HEI: Primary data saved (32846 records). [2025-09-26T19:13:30.788168] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-26T19:13:30.788315] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HEI took 27.7s. Estimated remaining: 3h 1m 5s. Rate: 7.5 symbols/min [2025-09-26T19:13:30.966376] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:30.966561] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-26T19:13:30.966620] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-26T19:13:30.966818] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-26T19:13:30.966864] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-26T19:13:30.966907] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-26T19:13:30.966942] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-26T19:13:31.157556] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-26T19:13:31.353269] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:31.956752] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-26T19:13:32.419750] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-26T19:13:32.432802] [INFO ] [REMOTE ] HE: Full fetch complete (72435 records). [2025-09-26T19:13:32.432960] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-26T19:13:32.670167] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-26T19:13:32.758246] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-26T19:13:32.926702] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-26T19:13:32.927227] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-26T19:13:32.928272] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-26T19:13:32.928377] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-26T19:13:32.930408] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T19:13:32.943878] [DEBUG] [LOCAL ] HE: Trimmed 72435 records to 49870 (keeping 200 days of data) [2025-09-26T19:13:33.269482] [DEBUG] [LOCAL ] HE: Primary data saved (49870 records). [2025-09-26T19:13:33.269717] [INFO ] [MAIN ] HE: Full history saved. [2025-09-26T19:13:33.269871] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HE took 36.6s. Estimated remaining: 3h 0m 50s. Rate: 7.5 symbols/min [2025-09-26T19:13:33.466104] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:33.466326] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-26T19:13:33.466384] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-26T19:13:33.466530] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-26T19:13:33.466588] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-26T19:13:33.466682] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-26T19:13:33.466737] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-26T19:13:33.561806] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-26T19:13:33.754605] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T19:13:33.776015] [INFO ] [REMOTE ] HEQ: Full fetch complete (9140 records). [2025-09-26T19:13:33.788874] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-26T19:13:33.985044] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:34.010518] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T19:13:34.266209] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-26T19:13:34.266340] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-26T19:13:34.266836] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-26T19:13:34.266902] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-26T19:13:34.267509] [DEBUG] [LOCAL ] HEQ: Trimmed 9140 records to 6236 (keeping 200 days of data) [2025-09-26T19:13:34.317397] [DEBUG] [LOCAL ] HEQ: Primary data saved (6236 records). [2025-09-26T19:13:34.317621] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-26T19:13:34.317815] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HEQ took 28.0s. Estimated remaining: 3h 0m 33s. Rate: 7.5 symbols/min [2025-09-26T19:13:34.361940] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-26T19:13:34.510789] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:34.537928] [DEBUG] [LOCAL ] HFRO: Loaded 17616 existing records from primary storage. [2025-09-26T19:13:34.538125] [INFO ] [MAIN ] HFRO: Loaded 17616 existing records. [2025-09-26T19:13:34.727886] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:34.728264] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-26T19:13:34.728317] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-26T19:13:34.729041] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-26T19:13:34.729107] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-26T19:13:35.013086] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-26T19:13:35.136710] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:35.156684] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-26T19:13:35.956745] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-26T19:13:36.280773] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T19:13:36.313558] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-26T19:13:36.756735] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-26T19:13:37.195111] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-26T19:13:37.556741] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-26T19:13:38.356729] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-26T19:13:38.684046] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-26T19:13:39.107549] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T19:13:39.156721] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-26T19:13:39.956731] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-26T19:13:40.756751] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-26T19:13:41.055049] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T19:13:41.109418] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-26T19:13:41.115249] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-26T19:13:41.556751] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-26T19:13:41.795381] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-26T19:13:42.356764] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-26T19:13:42.711397] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T19:13:43.156733] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-26T19:13:43.956742] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-26T19:13:44.756703] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-26T19:13:44.878188] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T19:13:44.987171] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-26T19:13:45.056475] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-26T19:13:45.556724] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-26T19:13:46.356722] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-26T19:13:46.539277] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T19:13:46.721137] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T19:13:47.156727] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-26T19:13:47.956736] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-26T19:13:48.133845] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T19:13:48.209323] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-26T19:13:48.756740] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-26T19:13:49.556724] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-26T19:13:50.358223] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-26T19:13:50.360353] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T19:13:50.518760] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:13:50.618447] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-26T19:13:51.156741] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-26T19:13:51.956715] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-26T19:13:52.224077] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-26T19:13:52.756693] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-26T19:13:53.118838] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-26T19:13:53.129297] [INFO ] [REMOTE ] HESM: Full fetch complete (69010 records). [2025-09-26T19:13:53.129503] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-26T19:13:53.556692] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-26T19:13:53.556816] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-26T19:13:53.556952] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-26T19:13:53.558924] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-26T19:13:53.559104] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-26T19:13:53.560767] [DEBUG] [LOCAL ] HESM: Trimmed 69010 records to 48879 (keeping 200 days of data) [2025-09-26T19:13:53.819028] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T19:13:53.869239] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-26T19:13:53.952192] [DEBUG] [LOCAL ] HESM: Primary data saved (48879 records). [2025-09-26T19:13:53.952393] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-26T19:13:53.952537] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HESM took 42.3s. Estimated remaining: 3h 0m 40s. Rate: 7.5 symbols/min [2025-09-26T19:13:54.158257] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:54.173270] [DEBUG] [LOCAL ] HGER: Loaded 13284 existing records from primary storage. [2025-09-26T19:13:54.173424] [INFO ] [MAIN ] HGER: Loaded 13284 existing records. [2025-09-26T19:13:54.362604] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-26T19:13:54.392615] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:13:54.394345] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-26T19:13:54.394406] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-26T19:13:54.395011] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-26T19:13:54.395185] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-26T19:13:54.844000] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:13:55.156688] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-26T19:13:55.359025] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-26T19:13:55.382201] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-26T19:13:55.956727] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-26T19:13:56.658420] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-26T19:13:56.756724] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-26T19:13:57.099336] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T19:13:57.556715] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-26T19:13:57.982196] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-26T19:13:58.356723] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-26T19:13:59.061717] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T19:13:59.156729] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-26T19:13:59.660004] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-26T19:13:59.660784] [INFO ] [REMOTE ] HF: Full fetch complete (505 records). [2025-09-26T19:13:59.660858] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-26T19:13:59.661240] [FATAL] [VALIDATOR ] HF: Data is stale - most recent date (2025-09-25) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:13:59.661345] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:13:59.661433] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:13:59.661529] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-26T19:13:59.661611] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-26T19:13:59.661681] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-26T19:13:59.661772] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-26T19:13:59.661866] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HF took 28.9s. Estimated remaining: 3h 0m 30s. Rate: 7.5 symbols/min [2025-09-26T19:13:59.843529] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:13:59.843829] [DEBUG] [LOCAL ] HGLB: No existing data file found in primary storage. [2025-09-26T19:13:59.843888] [WARN ] [MAIN ] HGLB: No existing data found, performing full refresh instead. [2025-09-26T19:13:59.844141] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-26T19:13:59.844197] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-26T19:13:59.844243] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-09-26T19:13:59.844276] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-26T19:13:59.961810] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-26T19:14:00.221317] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:00.756725] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-26T19:14:01.228061] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T19:14:01.470988] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-26T19:14:01.556709] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-26T19:14:02.356734] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-26T19:14:02.406301] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T19:14:02.786633] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T19:14:03.156791] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-26T19:14:03.956778] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-26T19:14:04.366095] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T19:14:04.372986] [INFO ] [REMOTE ] HFRO: Full fetch complete (28947 records). [2025-09-26T19:14:04.373220] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-26T19:14:04.761940] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-26T19:14:04.837314] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-26T19:14:04.967533] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-26T19:14:04.967686] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-26T19:14:04.968387] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-26T19:14:04.968462] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-26T19:14:04.969692] [DEBUG] [LOCAL ] HFRO: Trimmed 28947 records to 17798 (keeping 200 days of data) [2025-09-26T19:14:05.099104] [DEBUG] [LOCAL ] HFRO: Primary data saved (17798 records). [2025-09-26T19:14:05.099295] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-26T19:14:05.099400] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFRO took 30.8s. Estimated remaining: 3h 0m 18s. Rate: 7.5 symbols/min [2025-09-26T19:14:05.331875] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:05.347785] [DEBUG] [LOCAL ] HGTY: Loaded 13226 existing records from primary storage. [2025-09-26T19:14:05.347935] [INFO ] [MAIN ] HGTY: Loaded 13226 existing records. [2025-09-26T19:14:05.573743] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:05.566402] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-26T19:14:05.574510] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-26T19:14:05.575942] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-26T19:14:05.576807] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-26T19:14:05.576895] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-26T19:14:05.706119] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T19:14:05.993922] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:06.356708] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-26T19:14:06.504429] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T19:14:06.927250] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T19:14:06.928296] [INFO ] [REMOTE ] HFND: Full fetch complete (1798 records). [2025-09-26T19:14:06.928386] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-26T19:14:07.126866] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-26T19:14:07.130492] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:14:07.130698] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:14:07.130802] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-26T19:14:07.130883] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-26T19:14:07.130943] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-26T19:14:07.131006] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-26T19:14:07.131147] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HFND took 33.9s. Estimated remaining: 3h 0m 2s. Rate: 7.5 symbols/min [2025-09-26T19:14:07.162155] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-26T19:14:07.317011] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:07.373295] [DEBUG] [LOCAL ] HGV: Loaded 47168 existing records from primary storage. [2025-09-26T19:14:07.373469] [INFO ] [MAIN ] HGV: Loaded 47168 existing records. [2025-09-26T19:14:07.580123] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:07.580408] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-26T19:14:07.580458] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-26T19:14:07.581713] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-26T19:14:07.581777] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-26T19:14:07.964486] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-26T19:14:07.999805] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:08.052191] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T19:14:08.440990] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-26T19:14:08.756768] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-26T19:14:09.556739] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-26T19:14:10.189811] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:14:10.356700] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-26T19:14:10.520585] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-26T19:14:11.148945] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-26T19:14:11.156679] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-26T19:14:11.956710] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-26T19:14:12.058059] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T19:14:12.756760] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-26T19:14:13.306092] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:14:13.461540] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-26T19:14:13.556717] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-26T19:14:14.356743] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-26T19:14:15.020011] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T19:14:15.160924] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-26T19:14:15.162910] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-26T19:14:15.956809] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-26T19:14:16.734514] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T19:14:16.737372] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:14:16.756676] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-26T19:14:17.538722] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-26T19:14:17.556687] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-26T19:14:18.306275] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T19:14:18.356762] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-26T19:14:19.156759] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-26T19:14:19.927725] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T19:14:19.962206] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-26T19:14:19.976612] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-26T19:14:20.756762] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-26T19:14:21.009057] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T19:14:21.556748] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-26T19:14:22.356747] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-26T19:14:22.396899] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T19:14:22.534073] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-26T19:14:23.156808] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-26T19:14:23.956809] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-26T19:14:24.042626] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:14:24.577612] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-26T19:14:24.756780] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-26T19:14:25.556785] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-26T19:14:26.180367] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T19:14:26.333112] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T19:14:26.356742] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-26T19:14:27.156777] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-26T19:14:27.956775] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-26T19:14:28.223228] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-26T19:14:28.228234] [INFO ] [REMOTE ] HGER: Full fetch complete (16452 records). [2025-09-26T19:14:28.228385] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-26T19:14:28.590443] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T19:14:28.744052] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-26T19:14:28.744989] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-26T19:14:28.745780] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-26T19:14:28.746333] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-26T19:14:28.746210] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T19:14:28.750382] [DEBUG] [LOCAL ] HGER: Trimmed 16452 records to 13428 (keeping 200 days of data) [2025-09-26T19:14:28.787330] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-26T19:14:28.843067] [DEBUG] [LOCAL ] HGER: Primary data saved (13428 records). [2025-09-26T19:14:28.843259] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-26T19:14:28.843410] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HGER took 34.9s. Estimated remaining: 3h 0m 13s. Rate: 7.5 symbols/min [2025-09-26T19:14:29.036895] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:29.075759] [DEBUG] [LOCAL ] HHH: Loaded 32833 existing records from primary storage. [2025-09-26T19:14:29.075921] [INFO ] [MAIN ] HHH: Loaded 32833 existing records. [2025-09-26T19:14:29.284177] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:29.284451] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-26T19:14:29.284509] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-26T19:14:29.285729] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-26T19:14:29.285808] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-26T19:14:29.561796] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-26T19:14:29.622584] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T19:14:29.733333] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:30.356738] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-26T19:14:31.161951] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-26T19:14:31.181677] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:14:31.434584] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T19:14:31.943810] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-26T19:14:31.956679] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-26T19:14:32.737112] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-26T19:14:32.756672] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-26T19:14:33.462292] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (9.51 seconds). [2025-09-26T19:14:33.467312] [INFO ] [REMOTE ] HGTY: Full fetch complete (17254 records). [2025-09-26T19:14:33.467404] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-26T19:14:33.561824] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-26T19:14:33.857688] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-26T19:14:33.857804] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-26T19:14:33.858460] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-26T19:14:33.858538] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-26T19:14:33.859300] [DEBUG] [LOCAL ] HGTY: Trimmed 17254 records to 13290 (keeping 200 days of data) [2025-09-26T19:14:33.948682] [DEBUG] [LOCAL ] HGTY: Primary data saved (13290 records). [2025-09-26T19:14:33.949000] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-26T19:14:33.949174] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HGTY took 28.8s. Estimated remaining: 3h 0m 1s. Rate: 7.5 symbols/min [2025-09-26T19:14:34.135701] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:34.185302] [DEBUG] [LOCAL ] HI: Loaded 35414 existing records from primary storage. [2025-09-26T19:14:34.185510] [INFO ] [MAIN ] HI: Loaded 35414 existing records. [2025-09-26T19:14:34.362541] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-26T19:14:34.369130] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:34.370468] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-26T19:14:34.370540] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-26T19:14:34.372134] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-26T19:14:34.372204] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-26T19:14:34.753530] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:35.156774] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-26T19:14:35.503611] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:14:35.513511] [INFO ] [REMOTE ] HGV: Full fetch complete (65684 records). [2025-09-26T19:14:35.513710] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-26T19:14:35.883996] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:14:35.968143] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-26T19:14:35.971922] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-26T19:14:35.973299] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-26T19:14:35.974729] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-26T19:14:35.974942] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-26T19:14:35.977260] [DEBUG] [LOCAL ] HGV: Trimmed 65684 records to 47426 (keeping 200 days of data) [2025-09-26T19:14:36.293026] [DEBUG] [LOCAL ] HGV: Primary data saved (47426 records). [2025-09-26T19:14:36.293230] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-26T19:14:36.293366] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGV took 29.2s. Estimated remaining: 2h 59m 46s. Rate: 7.5 symbols/min [2025-09-26T19:14:36.472484] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:36.501560] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T19:14:36.562784] [DEBUG] [LOCAL ] HIG: Loaded 51610 existing records from primary storage. [2025-09-26T19:14:36.562967] [INFO ] [MAIN ] HIG: Loaded 51610 existing records. [2025-09-26T19:14:36.757619] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:36.757386] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-26T19:14:36.758109] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-26T19:14:36.758214] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-26T19:14:36.761399] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-26T19:14:36.761466] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-26T19:14:37.194902] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:37.402950] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:14:37.556689] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-26T19:14:37.874685] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T19:14:38.356739] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-26T19:14:38.572238] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (5.82 seconds). [2025-09-26T19:14:38.576162] [INFO ] [REMOTE ] HGLB: Full fetch complete (14366 records). [2025-09-26T19:14:38.576299] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-26T19:14:39.031847] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-26T19:14:39.031929] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-26T19:14:39.032282] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-26T19:14:39.032324] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-26T19:14:39.032895] [DEBUG] [LOCAL ] HGLB: Trimmed 14366 records to 9836 (keeping 200 days of data) [2025-09-26T19:14:39.102293] [DEBUG] [LOCAL ] HGLB: Primary data saved (9836 records). [2025-09-26T19:14:39.102454] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-26T19:14:39.102543] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HGLB took 39.4s. Estimated remaining: 2h 59m 31s. Rate: 7.5 symbols/min [2025-09-26T19:14:39.167859] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-26T19:14:39.287673] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:14:39.330349] [DEBUG] [LOCAL ] HII: Loaded 35496 existing records from primary storage. [2025-09-26T19:14:39.330570] [INFO ] [MAIN ] HII: Loaded 35496 existing records. [2025-09-26T19:14:39.511819] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:14:39.512133] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-26T19:14:39.512238] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-26T19:14:39.513770] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-26T19:14:39.513832] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-26T19:14:39.901208] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:14:39.956724] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-26T19:14:50.772341] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (13.22 seconds). [2025-09-26T19:14:50.778848] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-26T19:14:51.672839] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (11.72 seconds). [2025-09-26T19:14:51.681380] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-26T19:14:52.293536] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (13.94 seconds). [2025-09-26T19:14:52.300630] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-26T19:14:52.994753] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T19:14:53.003006] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-26T19:14:53.319897] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (14.15 seconds). [2025-09-26T19:14:53.330156] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-26T19:14:53.353351] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-26T19:14:53.359555] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-26T19:14:53.708267] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T19:14:53.716452] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-26T19:14:54.304045] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T19:14:54.312958] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-26T19:14:54.968614] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T19:14:54.979627] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-26T19:14:55.045986] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T19:14:55.055320] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-26T19:14:55.286775] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:14:55.295713] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-26T19:14:56.086930] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:14:56.096821] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-26T19:14:56.160979] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:14:56.168908] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-26T19:14:56.264027] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T19:14:56.274539] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-26T19:14:56.777680] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T19:14:56.786173] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-26T19:14:57.291582] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T19:14:57.305150] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-26T19:14:57.561485] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-26T19:14:57.572304] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-26T19:14:57.806533] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T19:14:57.816132] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-26T19:14:58.618786] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-26T19:14:58.630035] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-26T19:14:58.900425] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T19:14:58.908587] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-26T19:14:59.491749] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-26T19:14:59.499334] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-26T19:15:00.184397] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-26T19:15:00.192732] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-26T19:15:00.608891] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T19:15:00.621352] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-26T19:15:00.720225] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T19:15:00.729522] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-26T19:15:00.787487] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T19:15:00.797317] [INFO ] [REMOTE ] HHH: Full fetch complete (45250 records). [2025-09-26T19:15:00.797566] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-26T19:15:01.239785] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-26T19:15:01.239878] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-26T19:15:01.240633] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-26T19:15:01.240759] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-26T19:15:01.242108] [DEBUG] [LOCAL ] HHH: Trimmed 45250 records to 33042 (keeping 200 days of data) [2025-09-26T19:15:01.455732] [DEBUG] [LOCAL ] HHH: Primary data saved (33042 records). [2025-09-26T19:15:01.455918] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-26T19:15:01.456030] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HHH took 32.6s. Estimated remaining: 2h 59m 42s. Rate: 7.5 symbols/min [2025-09-26T19:15:01.651667] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:01.704620] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:15:01.712599] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-26T19:15:01.732702] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-09-26T19:15:01.732898] [INFO ] [MAIN ] HIMS: Loaded 54207 existing records. [2025-09-26T19:15:01.925999] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:01.926309] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-26T19:15:01.926359] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-26T19:15:01.928774] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-26T19:15:01.928837] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-26T19:15:02.318362] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:02.318986] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-26T19:15:02.532362] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:15:02.552493] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-26T19:15:02.718757] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T19:15:02.726060] [INFO ] [REMOTE ] HI: Full fetch complete (49813 records). [2025-09-26T19:15:02.726223] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-26T19:15:03.175889] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-26T19:15:03.176074] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-26T19:15:03.185204] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-26T19:15:03.195736] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-26T19:15:03.201154] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T19:15:03.209307] [DEBUG] [LOCAL ] HI: Trimmed 49813 records to 35713 (keeping 200 days of data) [2025-09-26T19:15:03.210793] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-26T19:15:03.453806] [DEBUG] [LOCAL ] HI: Primary data saved (35713 records). [2025-09-26T19:15:03.454001] [INFO ] [MAIN ] HI: Full history saved. [2025-09-26T19:15:03.455072] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HI took 29.5s. Estimated remaining: 2h 59m 26s. Rate: 7.5 symbols/min [2025-09-26T19:15:03.655366] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:03.679705] [DEBUG] [LOCAL ] HIO: Loaded 23776 existing records from primary storage. [2025-09-26T19:15:03.679848] [INFO ] [MAIN ] HIO: Loaded 23776 existing records. [2025-09-26T19:15:03.870738] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:03.871010] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-26T19:15:03.871065] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-26T19:15:03.872071] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-26T19:15:03.872134] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-26T19:15:04.251805] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:04.252198] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-26T19:15:04.433987] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T19:15:04.444709] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-26T19:15:04.736275] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-26T19:15:04.756676] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-26T19:15:04.946164] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:15:05.531241] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T19:15:05.556678] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-26T19:15:06.356726] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-26T19:15:06.732483] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-26T19:15:06.845522] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:15:07.156747] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-26T19:15:07.188382] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-26T19:15:07.685202] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T19:15:07.693355] [INFO ] [REMOTE ] HII: Full fetch complete (53376 records). [2025-09-26T19:15:07.693608] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-26T19:15:07.962529] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-26T19:15:08.149854] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-26T19:15:08.149936] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-26T19:15:08.150685] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-26T19:15:08.150748] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-26T19:15:08.151866] [DEBUG] [LOCAL ] HII: Trimmed 53376 records to 35728 (keeping 200 days of data) [2025-09-26T19:15:08.403617] [DEBUG] [LOCAL ] HII: Primary data saved (35728 records). [2025-09-26T19:15:08.403802] [INFO ] [MAIN ] HII: Full history saved. [2025-09-26T19:15:08.403931] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HII took 29.3s. Estimated remaining: 2h 59m 14s. Rate: 7.5 symbols/min [2025-09-26T19:15:08.584882] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:08.609084] [DEBUG] [LOCAL ] HIPO: Loaded 22682 existing records from primary storage. [2025-09-26T19:15:08.609229] [INFO ] [MAIN ] HIPO: Loaded 22682 existing records. [2025-09-26T19:15:08.775150] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-26T19:15:08.843472] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:08.846426] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-26T19:15:08.846563] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-26T19:15:08.846309] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:15:08.857498] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-26T19:15:08.857854] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-26T19:15:09.257594] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:09.368374] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:15:09.556738] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-26T19:15:10.356758] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-26T19:15:11.156697] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-26T19:15:11.290953] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-26T19:15:11.432635] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:15:11.443231] [INFO ] [REMOTE ] HIG: Full fetch complete (73297 records). [2025-09-26T19:15:11.443446] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-26T19:15:11.713902] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T19:15:11.957457] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-26T19:15:11.957774] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-26T19:15:11.959417] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-26T19:15:11.960568] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-26T19:15:11.960694] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-26T19:15:11.968407] [DEBUG] [LOCAL ] HIG: Trimmed 73297 records to 51962 (keeping 200 days of data) [2025-09-26T19:15:12.335511] [DEBUG] [LOCAL ] HIG: Primary data saved (51962 records). [2025-09-26T19:15:12.335690] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-26T19:15:12.335917] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIG took 36.0s. Estimated remaining: 2h 59m 1s. Rate: 7.5 symbols/min [2025-09-26T19:15:12.512194] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T19:15:12.566919] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:12.614554] [DEBUG] [LOCAL ] HIW: Loaded 45015 existing records from primary storage. [2025-09-26T19:15:12.614728] [INFO ] [MAIN ] HIW: Loaded 45015 existing records. [2025-09-26T19:15:12.766474] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-26T19:15:12.814500] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:12.814901] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-26T19:15:12.814964] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-26T19:15:12.816300] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-26T19:15:12.816376] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-26T19:15:13.185834] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T19:15:13.235489] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:13.556769] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-26T19:15:14.001517] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-26T19:15:14.356737] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-26T19:15:15.156748] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-26T19:15:15.815769] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:15:15.956793] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-26T19:15:16.212362] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T19:15:16.277090] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-26T19:15:16.756981] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-26T19:15:17.556713] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-26T19:15:17.665709] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-26T19:15:17.817939] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T19:15:18.356761] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-26T19:15:18.530603] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T19:15:19.156752] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-26T19:15:19.956763] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-26T19:15:20.370611] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T19:15:20.756769] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-26T19:15:21.354912] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-09-26T19:15:21.422302] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T19:15:21.556717] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-26T19:15:21.894836] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T19:15:22.356720] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-26T19:15:22.637966] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T19:15:23.156762] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-26T19:15:23.579562] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T19:15:23.956734] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-26T19:15:24.756750] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-26T19:15:25.556728] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-26T19:15:25.744900] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T19:15:25.892388] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T19:15:25.940463] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-26T19:15:26.294601] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T19:15:26.356765] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-26T19:15:27.156714] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-26T19:15:27.531965] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T19:15:27.956752] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-26T19:15:28.756776] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-26T19:15:29.556811] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-26T19:15:29.701091] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T19:15:29.846168] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-26T19:15:29.874459] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T19:15:29.880957] [INFO ] [REMOTE ] HIO: Full fetch complete (36840 records). [2025-09-26T19:15:29.881110] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-26T19:15:30.286185] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-26T19:15:30.286304] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-26T19:15:30.287009] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-26T19:15:30.287094] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-26T19:15:30.289796] [DEBUG] [LOCAL ] HIO: Trimmed 36840 records to 24107 (keeping 200 days of data) [2025-09-26T19:15:30.381539] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-26T19:15:30.444826] [DEBUG] [LOCAL ] HIO: Primary data saved (24107 records). [2025-09-26T19:15:30.444965] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-26T19:15:30.445093] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIO took 27.0s. Estimated remaining: 2h 59m 6s. Rate: 7.5 symbols/min [2025-09-26T19:15:30.651823] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:30.665774] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T19:15:30.689245] [DEBUG] [LOCAL ] HIX: Loaded 20487 existing records from primary storage. [2025-09-26T19:15:30.689423] [INFO ] [MAIN ] HIX: Loaded 20487 existing records. [2025-09-26T19:15:30.884236] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:30.884520] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-26T19:15:30.884571] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-26T19:15:30.885352] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-26T19:15:30.885420] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-26T19:15:31.163030] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-26T19:15:31.278329] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:31.956733] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-26T19:15:32.033953] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T19:15:32.756683] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-26T19:15:33.147602] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:15:33.556700] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-26T19:15:33.730950] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-26T19:15:34.358125] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-26T19:15:34.360820] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:15:34.748963] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T19:15:35.156731] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-26T19:15:35.956761] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-26T19:15:36.173178] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:15:36.742095] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-26T19:15:36.756683] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-26T19:15:37.147121] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:15:37.151965] [INFO ] [REMOTE ] HIPO: Full fetch complete (31633 records). [2025-09-26T19:15:37.152078] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-26T19:15:37.565219] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-26T19:15:37.604893] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-26T19:15:37.604998] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-26T19:15:37.605619] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-26T19:15:37.605709] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-26T19:15:37.606788] [DEBUG] [LOCAL ] HIPO: Trimmed 31633 records to 22774 (keeping 200 days of data) [2025-09-26T19:15:37.762264] [DEBUG] [LOCAL ] HIPO: Primary data saved (22774 records). [2025-09-26T19:15:37.762405] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-26T19:15:37.762508] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIPO took 29.4s. Estimated remaining: 2h 58m 57s. Rate: 7.5 symbols/min [2025-09-26T19:15:37.948096] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:37.968873] [DEBUG] [LOCAL ] HKD: Loaded 18493 existing records from primary storage. [2025-09-26T19:15:37.969048] [INFO ] [MAIN ] HKD: Loaded 18493 existing records. [2025-09-26T19:15:38.164683] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:38.164957] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-26T19:15:38.165021] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-26T19:15:38.165622] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-26T19:15:38.165720] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-26T19:15:38.377010] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-26T19:15:38.556871] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:38.615473] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T19:15:39.156745] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-26T19:15:39.850080] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-09-26T19:15:39.861382] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-26T19:15:39.861555] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-26T19:15:39.961331] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-26T19:15:40.294347] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:15:40.335767] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-26T19:15:40.349723] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-26T19:15:40.351420] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-26T19:15:40.351950] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-26T19:15:40.372701] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T19:15:40.379206] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54597 (keeping 200 days of data) [2025-09-26T19:15:40.735068] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-09-26T19:15:40.735228] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-26T19:15:40.735348] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIMS took 39.3s. Estimated remaining: 2h 58m 43s. Rate: 7.5 symbols/min [2025-09-26T19:15:40.768800] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-26T19:15:40.979137] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:41.042788] [DEBUG] [LOCAL ] HL: Loaded 54061 existing records from primary storage. [2025-09-26T19:15:41.042977] [INFO ] [MAIN ] HL: Loaded 54061 existing records. [2025-09-26T19:15:41.233622] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:41.250198] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-26T19:15:41.251091] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-26T19:15:41.252190] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-26T19:15:41.257909] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-26T19:15:41.258201] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-26T19:15:41.562921] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-26T19:15:41.653778] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:42.356691] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-26T19:15:42.466199] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:15:42.591857] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T19:15:43.156729] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-26T19:15:43.539894] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T19:15:43.956746] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-26T19:15:44.221429] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T19:15:44.756808] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-26T19:15:45.556719] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-26T19:15:45.771846] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T19:15:46.006793] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T19:15:46.284060] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-26T19:15:46.356718] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-26T19:15:47.156731] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-26T19:15:47.411129] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T19:15:47.924366] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T19:15:47.956742] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-26T19:15:48.756745] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-26T19:15:49.556689] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-26T19:15:49.951632] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:15:49.956198] [INFO ] [REMOTE ] HIX: Full fetch complete (30573 records). [2025-09-26T19:15:49.956346] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-26T19:15:50.088486] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-26T19:15:50.375840] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-26T19:15:50.391254] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-26T19:15:50.391371] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-26T19:15:50.391966] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-26T19:15:50.392030] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-26T19:15:50.392992] [DEBUG] [LOCAL ] HIX: Trimmed 30573 records to 20714 (keeping 200 days of data) [2025-09-26T19:15:50.523184] [DEBUG] [LOCAL ] HIX: Primary data saved (20714 records). [2025-09-26T19:15:50.523337] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-26T19:15:50.523433] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HIX took 20.1s. Estimated remaining: 2h 58m 37s. Rate: 7.5 symbols/min [2025-09-26T19:15:50.717405] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:50.767674] [DEBUG] [LOCAL ] HLF: Loaded 49031 existing records from primary storage. [2025-09-26T19:15:50.767854] [INFO ] [MAIN ] HLF: Loaded 49031 existing records. [2025-09-26T19:15:50.957237] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:50.957500] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-26T19:15:50.957548] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-26T19:15:50.958692] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-26T19:15:50.958753] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-26T19:15:51.165088] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-26T19:15:51.361023] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:51.436787] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:15:51.956726] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-26T19:15:52.767238] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-26T19:15:52.786761] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-26T19:15:52.798068] [INFO ] [REMOTE ] HIW: Full fetch complete (64677 records). [2025-09-26T19:15:52.798252] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-26T19:15:53.220418] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-26T19:15:53.220509] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-26T19:15:53.221369] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-26T19:15:53.221440] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-26T19:15:53.224904] [DEBUG] [LOCAL ] HIW: Trimmed 64677 records to 45329 (keeping 200 days of data) [2025-09-26T19:15:53.329588] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-26T19:15:53.538609] [DEBUG] [LOCAL ] HIW: Primary data saved (45329 records). [2025-09-26T19:15:53.538858] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-26T19:15:53.539014] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HIW took 41.2s. Estimated remaining: 2h 58m 23s. Rate: 7.5 symbols/min [2025-09-26T19:15:53.564549] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-26T19:15:53.783446] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:15:53.819611] [DEBUG] [LOCAL ] HLI: Loaded 31388 existing records from primary storage. [2025-09-26T19:15:53.819782] [INFO ] [MAIN ] HLI: Loaded 31388 existing records. [2025-09-26T19:15:54.008944] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:15:54.009235] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-26T19:15:54.009294] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-26T19:15:54.010370] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-26T19:15:54.010434] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-26T19:15:54.396178] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:15:54.396754] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-26T19:15:54.548372] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T19:15:55.080063] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T19:15:55.156733] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-26T19:15:55.956782] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-26T19:15:56.249327] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T19:15:56.756773] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-26T19:15:57.568942] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:15:57.579785] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-26T19:15:57.796758] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T19:15:58.356749] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-26T19:15:59.096309] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:15:59.156770] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-26T19:15:59.281281] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-26T19:15:59.286429] [INFO ] [REMOTE ] HKD: Full fetch complete (28690 records). [2025-09-26T19:15:59.286573] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-26T19:15:59.708631] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-26T19:15:59.708748] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-26T19:15:59.709370] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-26T19:15:59.709437] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-26T19:15:59.710457] [DEBUG] [LOCAL ] HKD: Trimmed 28690 records to 18654 (keeping 200 days of data) [2025-09-26T19:15:59.838432] [DEBUG] [LOCAL ] HKD: Primary data saved (18654 records). [2025-09-26T19:15:59.838609] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-26T19:15:59.838757] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HKD took 22.1s. Estimated remaining: 2h 58m 13s. Rate: 7.5 symbols/min [2025-09-26T19:16:00.036266] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:16:00.074223] [DEBUG] [LOCAL ] HLIO: Loaded 28351 existing records from primary storage. [2025-09-26T19:16:00.074390] [INFO ] [MAIN ] HLIO: Loaded 28351 existing records. [2025-09-26T19:16:00.287819] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:16:00.288120] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-26T19:16:00.288175] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-26T19:16:00.289009] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-26T19:16:00.289103] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-26T19:16:00.714061] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:16:00.714592] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-26T19:16:00.749529] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T19:16:00.763041] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-26T19:16:02.333948] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-26T19:16:02.349694] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-26T19:16:03.980071] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:16:03.991847] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-26T19:16:05.595482] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:16:05.606156] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-26T19:16:08.965184] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (8.25 seconds). [2025-09-26T19:16:08.969364] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-26T19:16:10.004274] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-26T19:16:10.009323] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-26T19:16:11.060585] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T19:16:11.064953] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-26T19:16:12.235927] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-26T19:16:12.244142] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-26T19:16:17.768274] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (25.81 seconds). [2025-09-26T19:16:17.779409] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-26T19:16:38.772969] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (44.38 seconds). [2025-09-26T19:16:38.780156] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-26T19:16:39.960197] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (34.35 seconds). [2025-09-26T19:16:39.972026] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-26T19:16:40.130096] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:16:40.137781] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-26T19:16:41.344042] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T19:16:41.351449] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-26T19:16:41.674858] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:16:41.686247] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-26T19:16:42.765464] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T19:16:42.773396] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-26T19:16:43.399373] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:16:43.410446] [INFO ] [REMOTE ] HLF: Full fetch complete (71343 records). [2025-09-26T19:16:43.410630] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-26T19:16:43.852635] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-26T19:16:43.852892] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-26T19:16:43.853906] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-26T19:16:43.853976] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-26T19:16:43.855484] [DEBUG] [LOCAL ] HLF: Trimmed 71343 records to 49357 (keeping 200 days of data) [2025-09-26T19:16:44.184054] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T19:16:44.194230] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-26T19:16:44.205866] [DEBUG] [LOCAL ] HLF: Primary data saved (49357 records). [2025-09-26T19:16:44.206055] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-26T19:16:44.206828] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 53.7s. Estimated remaining: 2h 58m 53s. Rate: 7.5 symbols/min [2025-09-26T19:16:44.389719] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:16:44.426371] [DEBUG] [LOCAL ] HLLY: Loaded 33705 existing records from primary storage. [2025-09-26T19:16:44.426536] [INFO ] [MAIN ] HLLY: Loaded 33705 existing records. [2025-09-26T19:16:44.615162] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:16:44.615444] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-26T19:16:44.615496] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-26T19:16:44.616434] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-26T19:16:44.616497] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-26T19:16:45.009628] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:16:45.010039] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-26T19:16:45.387614] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-26T19:16:45.395214] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-26T19:16:46.656189] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T19:16:46.662779] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-26T19:16:48.054774] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T19:16:48.062886] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-26T19:16:51.075826] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (38.83 seconds). [2025-09-26T19:16:51.084420] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-26T19:16:57.292359] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (39.51 seconds). [2025-09-26T19:16:57.304098] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-26T19:16:58.197848] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (10.13 seconds). [2025-09-26T19:16:58.205790] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-26T19:16:59.383688] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-26T19:16:59.395545] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-26T19:17:08.514474] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (17.43 seconds). [2025-09-26T19:17:08.522534] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-26T19:17:08.936788] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (23.93 seconds). [2025-09-26T19:17:08.944874] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-26T19:17:10.242605] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T19:17:10.249436] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-26T19:17:11.243250] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T19:17:11.248749] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-26T19:17:12.500833] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-26T19:17:12.508407] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-26T19:17:13.878467] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T19:17:13.886618] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-26T19:17:15.065524] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (16.86 seconds). [2025-09-26T19:17:15.071923] [INFO ] [REMOTE ] HLI: Full fetch complete (45389 records). [2025-09-26T19:17:15.072071] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-26T19:17:15.484402] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-26T19:17:15.484506] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-26T19:17:15.485307] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-26T19:17:15.485386] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-26T19:17:15.486493] [DEBUG] [LOCAL ] HLI: Trimmed 45389 records to 31573 (keeping 200 days of data) [2025-09-26T19:17:15.696604] [DEBUG] [LOCAL ] HLI: Primary data saved (31573 records). [2025-09-26T19:17:15.696783] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-26T19:17:15.696908] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HLI took 1m 22s. Estimated remaining: 2h 59m 15s. Rate: 7.5 symbols/min [2025-09-26T19:17:15.894116] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:17:15.952159] [DEBUG] [LOCAL ] HLN: Loaded 53477 existing records from primary storage. [2025-09-26T19:17:15.952325] [INFO ] [MAIN ] HLN: Loaded 53477 existing records. [2025-09-26T19:17:16.143543] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:17:16.143855] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-26T19:17:16.143927] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-26T19:17:16.145363] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-26T19:17:16.145426] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-26T19:17:16.521888] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:17:16.522230] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-26T19:17:43.860237] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (27.34 seconds). [2025-09-26T19:17:43.875162] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-26T19:17:45.425441] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T19:17:45.436614] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-26T19:17:47.001240] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (47.61 seconds). [2025-09-26T19:17:47.014450] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-26T19:17:47.048023] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T19:17:47.060080] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-26T19:17:49.018023] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T19:17:49.030782] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-26T19:17:49.063185] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-26T19:17:49.075110] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-26T19:17:51.060028] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T19:17:51.072417] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-26T19:17:53.179920] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-26T19:17:53.191832] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-26T19:17:55.350894] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-26T19:17:55.364480] [INFO ] [REMOTE ] HL: Full fetch complete (77654 records). [2025-09-26T19:17:55.364865] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-26T19:17:55.890150] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-26T19:17:55.890281] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-26T19:17:55.891899] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-26T19:17:55.891997] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-26T19:17:55.893918] [DEBUG] [LOCAL ] HL: Trimmed 77654 records to 54451 (keeping 200 days of data) [2025-09-26T19:17:56.341149] [DEBUG] [LOCAL ] HL: Primary data saved (54451 records). [2025-09-26T19:17:56.341349] [INFO ] [MAIN ] HL: Full history saved. [2025-09-26T19:17:56.341485] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HL took 2m 16s. Estimated remaining: 2h 59m 50s. Rate: 7.5 symbols/min [2025-09-26T19:17:56.532261] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:17:56.587916] [DEBUG] [LOCAL ] HLT: Loaded 51092 existing records from primary storage. [2025-09-26T19:17:56.588097] [INFO ] [MAIN ] HLT: Loaded 51092 existing records. [2025-09-26T19:17:56.780784] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:17:56.781068] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-26T19:17:56.781120] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-26T19:17:56.782999] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-26T19:17:56.783065] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-26T19:17:57.254945] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:17:57.255357] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-26T19:17:59.086744] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:17:59.097549] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-26T19:18:01.043219] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-26T19:18:01.053748] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-26T19:18:02.640966] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:18:02.651287] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-26T19:18:04.631398] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T19:18:04.642802] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-26T19:18:06.288927] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (57.77 seconds). [2025-09-26T19:18:06.296690] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-26T19:18:23.646546] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (69.76 seconds). [2025-09-26T19:18:23.654078] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-26T19:18:24.779125] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T19:18:24.785200] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-26T19:18:26.134814] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-26T19:18:26.142440] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-26T19:18:26.253475] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (37.22 seconds). [2025-09-26T19:18:26.265235] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-26T19:18:48.614852] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (43.97 seconds). [2025-09-26T19:18:48.627915] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-26T19:18:50.469092] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T19:18:50.480319] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-26T19:18:51.091237] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (24.95 seconds). [2025-09-26T19:18:51.099808] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-26T19:18:52.119080] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (45.82 seconds). [2025-09-26T19:18:52.126451] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-26T19:18:52.652551] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-26T19:18:52.660237] [INFO ] [REMOTE ] HLLY: Full fetch complete (46178 records). [2025-09-26T19:18:52.660402] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-26T19:18:53.084287] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-26T19:18:53.084458] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-26T19:18:53.085345] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-26T19:18:53.085431] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-26T19:18:53.086703] [DEBUG] [LOCAL ] HLLY: Trimmed 46178 records to 33911 (keeping 200 days of data) [2025-09-26T19:18:53.291486] [DEBUG] [LOCAL ] HLLY: Primary data saved (33911 records). [2025-09-26T19:18:53.291679] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-26T19:18:53.293180] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLLY took 2m 9s. Estimated remaining: 3h 0m 45s. Rate: 7.4 symbols/min [2025-09-26T19:18:53.483155] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:18:53.503340] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:18:53.511558] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-26T19:18:53.556962] [DEBUG] [LOCAL ] HLX: Loaded 48349 existing records from primary storage. [2025-09-26T19:18:53.557182] [INFO ] [MAIN ] HLX: Loaded 48349 existing records. [2025-09-26T19:18:53.758920] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:18:53.759262] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-26T19:18:53.759326] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-26T19:18:53.760564] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-26T19:18:53.760637] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-26T19:18:54.201932] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:18:54.202382] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-26T19:18:54.619350] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (4.14 seconds). [2025-09-26T19:18:54.631823] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-26T19:18:54.690506] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (28.43 seconds). [2025-09-26T19:18:54.704514] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-26T19:18:54.728587] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T19:18:54.733192] [INFO ] [REMOTE ] HLIO: Full fetch complete (36199 records). [2025-09-26T19:18:54.733302] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-26T19:18:55.131253] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-26T19:18:55.131375] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-26T19:18:55.132098] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-26T19:18:55.132166] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-26T19:18:55.133167] [DEBUG] [LOCAL ] HLIO: Trimmed 36199 records to 28490 (keeping 200 days of data) [2025-09-26T19:18:55.308723] [DEBUG] [LOCAL ] HLIO: Primary data saved (28490 records). [2025-09-26T19:18:55.308884] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-26T19:18:55.308992] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLIO took 2m 55s. Estimated remaining: 3h 0m 29s. Rate: 7.4 symbols/min [2025-09-26T19:18:55.490694] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:18:55.534364] [DEBUG] [LOCAL ] HMC: Loaded 47152 existing records from primary storage. [2025-09-26T19:18:55.534518] [INFO ] [MAIN ] HMC: Loaded 47152 existing records. [2025-09-26T19:18:55.725744] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:18:55.726518] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-26T19:18:55.726677] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-26T19:18:55.728030] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-26T19:18:55.728097] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-26T19:18:55.955921] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:18:56.013350] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-26T19:18:56.182028] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:18:56.182449] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-26T19:18:56.447165] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-26T19:18:56.458932] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-26T19:18:56.518056] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T19:18:56.529625] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-26T19:18:57.708128] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:18:57.718287] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-26T19:18:58.098858] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:18:58.109963] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-26T19:18:58.239014] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T19:18:58.249956] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-26T19:18:59.338991] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-26T19:18:59.363404] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-26T19:19:00.047928] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:19:00.057898] [INFO ] [REMOTE ] HLT: Full fetch complete (73434 records). [2025-09-26T19:19:00.058061] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-26T19:19:00.552502] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-26T19:19:00.578811] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-26T19:19:00.580942] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-26T19:19:00.582123] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-09-26T19:19:00.582321] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-26T19:19:00.592621] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-26T19:19:00.594435] [DEBUG] [LOCAL ] HLT: Trimmed 73434 records to 51450 (keeping 200 days of data) [2025-09-26T19:19:00.933006] [DEBUG] [LOCAL ] HLT: Primary data saved (51450 records). [2025-09-26T19:19:00.933327] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-26T19:19:00.933446] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLT took 1m 5s. Estimated remaining: 3h 0m 18s. Rate: 7.4 symbols/min [2025-09-26T19:19:01.115610] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:01.139022] [DEBUG] [LOCAL ] HMN: Loaded 23517 existing records from primary storage. [2025-09-26T19:19:01.139168] [INFO ] [MAIN ] HMN: Loaded 23517 existing records. [2025-09-26T19:19:01.350188] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:01.361824] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-26T19:19:01.364911] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-26T19:19:01.365788] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-26T19:19:01.365868] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-26T19:19:01.367169] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T19:19:01.438937] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-26T19:19:01.746447] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (3.50 seconds). [2025-09-26T19:19:01.801458] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-26T19:19:01.828635] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:01.830380] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-26T19:19:02.364000] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:19:02.374763] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-26T19:19:03.000956] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T19:19:03.005358] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-26T19:19:03.434182] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-26T19:19:03.447400] [INFO ] [REMOTE ] HLN: Full fetch complete (76780 records). [2025-09-26T19:19:03.447615] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-26T19:19:03.832579] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T19:19:03.931081] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-26T19:19:03.989316] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-26T19:19:03.990416] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-26T19:19:03.991812] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-26T19:19:03.992087] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-26T19:19:04.011978] [DEBUG] [LOCAL ] HLN: Trimmed 76780 records to 53861 (keeping 200 days of data) [2025-09-26T19:19:04.028095] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:19:04.137975] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-26T19:19:04.149096] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-26T19:19:04.161924] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-26T19:19:04.411020] [DEBUG] [LOCAL ] HLN: Primary data saved (53861 records). [2025-09-26T19:19:04.411271] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-26T19:19:04.411528] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HLN took 1m 49s. Estimated remaining: 3h 0m 4s. Rate: 7.4 symbols/min [2025-09-26T19:19:04.589565] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:04.651578] [DEBUG] [LOCAL ] HMY: Loaded 53525 existing records from primary storage. [2025-09-26T19:19:04.651815] [INFO ] [MAIN ] HMY: Loaded 53525 existing records. [2025-09-26T19:19:04.840968] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:04.841332] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-26T19:19:04.841392] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-26T19:19:04.842848] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-26T19:19:04.842937] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-26T19:19:05.168085] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T19:19:05.216142] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-26T19:19:05.259349] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:05.259859] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-26T19:19:05.495484] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T19:19:05.506581] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-26T19:19:05.579955] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T19:19:05.590992] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-26T19:19:06.293422] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T19:19:06.298203] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-26T19:19:07.094387] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-26T19:19:07.107235] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-26T19:19:07.208422] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T19:19:07.221384] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-26T19:19:07.263769] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:19:07.275369] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-26T19:19:07.636958] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T19:19:07.643281] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-26T19:19:09.021572] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T19:19:09.028975] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-26T19:19:09.143062] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T19:19:09.154927] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-26T19:19:09.376591] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-26T19:19:09.386606] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-26T19:19:09.433196] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-26T19:19:09.445990] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-26T19:19:10.222553] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-26T19:19:10.228182] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-26T19:19:10.735006] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T19:19:10.746195] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-26T19:19:10.822461] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:19:10.835080] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-26T19:19:11.106588] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-26T19:19:11.117680] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-26T19:19:11.508014] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T19:19:11.514306] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-26T19:19:12.395014] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-26T19:19:12.407118] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-26T19:19:12.541547] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:19:12.550913] [INFO ] [REMOTE ] HLX: Full fetch complete (69217 records). [2025-09-26T19:19:12.551106] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-26T19:19:12.735943] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-26T19:19:12.771102] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-26T19:19:13.008247] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-26T19:19:13.008445] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-26T19:19:13.009489] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-26T19:19:13.009675] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-26T19:19:13.013360] [DEBUG] [LOCAL ] HLX: Trimmed 69217 records to 48650 (keeping 200 days of data) [2025-09-26T19:19:13.153375] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T19:19:13.169183] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-26T19:19:13.369607] [DEBUG] [LOCAL ] HLX: Primary data saved (48650 records). [2025-09-26T19:19:13.369805] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-26T19:19:13.370529] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HLX took 20.1s. Estimated remaining: 2h 59m 57s. Rate: 7.4 symbols/min [2025-09-26T19:19:13.556611] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:13.556840] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-26T19:19:13.556898] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-26T19:19:13.557093] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-26T19:19:13.557157] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-26T19:19:13.557229] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-26T19:19:13.557267] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-26T19:19:13.990026] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:13.990711] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-26T19:19:14.033558] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T19:19:14.042846] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:19:14.053421] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-26T19:19:14.054506] [INFO ] [REMOTE ] HMN: Full fetch complete (31690 records). [2025-09-26T19:19:14.054606] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-26T19:19:14.234559] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:14.268628] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-26T19:19:14.332955] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-26T19:19:14.463558] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-26T19:19:14.463668] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-26T19:19:14.464273] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-26T19:19:14.464318] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-26T19:19:14.465174] [DEBUG] [LOCAL ] HMN: Trimmed 31690 records to 23671 (keeping 200 days of data) [2025-09-26T19:19:14.580827] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:14.597986] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-26T19:19:14.606698] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-26T19:19:14.633108] [DEBUG] [LOCAL ] HMN: Primary data saved (23671 records). [2025-09-26T19:19:14.633287] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-26T19:19:14.633390] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMN took 13.7s. Estimated remaining: 2h 59m 40s. Rate: 7.4 symbols/min [2025-09-26T19:19:14.816049] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:14.848793] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:14.849147] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-26T19:19:14.849717] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-26T19:19:14.861223] [DEBUG] [LOCAL ] HNI: Loaded 29093 existing records from primary storage. [2025-09-26T19:19:14.861474] [INFO ] [MAIN ] HNI: Loaded 29093 existing records. [2025-09-26T19:19:15.057111] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:15.057408] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-26T19:19:15.057483] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-26T19:19:15.058543] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-26T19:19:15.058764] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-26T19:19:15.121250] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:15.171147] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-26T19:19:15.175965] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-26T19:19:15.278101] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-26T19:19:15.400884] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-26T19:19:15.414269] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:19:15.436869] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-26T19:19:15.437952] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-26T19:19:15.535146] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:15.535811] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-26T19:19:15.574289] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T19:19:15.583998] [INFO ] [REMOTE ] HMC: Full fetch complete (69517 records). [2025-09-26T19:19:15.584180] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-26T19:19:16.010750] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-26T19:19:16.010880] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-26T19:19:16.011894] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-26T19:19:16.011965] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-26T19:19:16.013520] [DEBUG] [LOCAL ] HMC: Trimmed 69517 records to 47500 (keeping 200 days of data) [2025-09-26T19:19:16.090842] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T19:19:16.121977] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-26T19:19:16.320625] [DEBUG] [LOCAL ] HMC: Primary data saved (47500 records). [2025-09-26T19:19:16.320824] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-26T19:19:16.320957] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMC took 21.0s. Estimated remaining: 2h 59m 24s. Rate: 7.4 symbols/min [2025-09-26T19:19:16.498202] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:16.561271] [DEBUG] [LOCAL ] HOG: Loaded 51604 existing records from primary storage. [2025-09-26T19:19:16.561461] [INFO ] [MAIN ] HOG: Loaded 51604 existing records. [2025-09-26T19:19:16.754328] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:16.754889] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-26T19:19:16.754952] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-26T19:19:16.756315] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-26T19:19:16.756383] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-26T19:19:17.048624] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T19:19:17.072877] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-26T19:19:17.168730] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:17.169071] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-26T19:19:17.626040] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-26T19:19:17.637992] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-26T19:19:17.850682] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T19:19:17.859815] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-26T19:19:18.249314] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-26T19:19:18.254854] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-26T19:19:18.518941] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T19:19:18.529826] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-26T19:19:19.375025] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T19:19:19.384609] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-26T19:19:19.675708] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-26T19:19:19.687684] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-26T19:19:19.747095] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:19:19.756287] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-26T19:19:20.374499] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-26T19:19:20.385329] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-26T19:19:20.735596] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T19:19:20.744331] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-26T19:19:21.074740] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T19:19:21.081421] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-26T19:19:21.412443] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T19:19:21.424614] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-26T19:19:21.697144] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T19:19:21.707884] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-26T19:19:22.279058] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T19:19:22.285035] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-26T19:19:22.730174] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T19:19:22.739381] [INFO ] [REMOTE ] HNGE: Full fetch complete (27204 records). [2025-09-26T19:19:22.739508] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-26T19:19:22.949668] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 88 unique days, need 200 days [2025-09-26T19:19:22.950207] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:19:22.950475] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:19:22.950591] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-26T19:19:22.950816] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-26T19:19:22.950954] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-26T19:19:22.951199] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-26T19:19:22.951387] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HNGE took 9.6s. Estimated remaining: 2h 59m 14s. Rate: 7.4 symbols/min [2025-09-26T19:19:23.093442] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:19:23.105759] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-26T19:19:23.333800] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T19:19:23.345259] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-26T19:19:23.422413] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-26T19:19:23.428327] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-26T19:19:24.563170] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T19:19:24.569289] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-26T19:19:25.381988] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-26T19:19:25.410321] [INFO ] [REMOTE ] HMY: Full fetch complete (76669 records). [2025-09-26T19:19:25.424107] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-26T19:19:25.432504] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T19:19:25.527465] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-26T19:19:25.884479] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-26T19:19:25.907677] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-26T19:19:25.913196] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-26T19:19:25.914427] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-26T19:19:25.914882] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-26T19:19:25.915012] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-26T19:19:25.917970] [DEBUG] [LOCAL ] HMY: Trimmed 76669 records to 53914 (keeping 200 days of data) [2025-09-26T19:19:26.274166] [DEBUG] [LOCAL ] HMY: Primary data saved (53914 records). [2025-09-26T19:19:26.274415] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-26T19:19:26.274595] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HMY took 21.9s. Estimated remaining: 2h 59m 0s. Rate: 7.4 symbols/min [2025-09-26T19:19:27.405915] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T19:19:27.418772] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-26T19:19:27.608498] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:19:27.617727] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-26T19:19:29.117868] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:19:29.128515] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-26T19:19:29.263689] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:19:29.271392] [INFO ] [REMOTE ] HNI: Full fetch complete (41369 records). [2025-09-26T19:19:29.271549] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-26T19:19:29.665809] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-26T19:19:29.665903] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-26T19:19:29.666546] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-26T19:19:29.666587] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-26T19:19:29.668006] [DEBUG] [LOCAL ] HNI: Trimmed 41369 records to 29386 (keeping 200 days of data) [2025-09-26T19:19:29.852406] [DEBUG] [LOCAL ] HNI: Primary data saved (29386 records). [2025-09-26T19:19:29.852581] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-26T19:19:29.852725] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HNI took 15.2s. Estimated remaining: 2h 58m 46s. Rate: 7.5 symbols/min [2025-09-26T19:19:31.010391] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T19:19:31.022415] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-26T19:19:32.697038] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:19:32.709862] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-26T19:19:34.653804] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:19:34.665291] [INFO ] [REMOTE ] HOG: Full fetch complete (74238 records). [2025-09-26T19:19:34.665507] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-26T19:19:35.087307] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-26T19:19:35.087427] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-26T19:19:35.088625] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-26T19:19:35.088715] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-26T19:19:35.090958] [DEBUG] [LOCAL ] HOG: Trimmed 74238 records to 51958 (keeping 200 days of data) [2025-09-26T19:19:35.433271] [DEBUG] [LOCAL ] HOG: Primary data saved (51958 records). [2025-09-26T19:19:35.433451] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-26T19:19:35.433563] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOG took 19.1s. Estimated remaining: 2h 58m 35s. Rate: 7.5 symbols/min [2025-09-26T19:19:36.120413] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:36.174446] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:36.241359] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:36.261492] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:36.277863] [DEBUG] [LOCAL ] HOV: Loaded 13886 existing records from primary storage. [2025-09-26T19:19:36.278419] [INFO ] [MAIN ] HOV: Loaded 13886 existing records. [2025-09-26T19:19:36.533422] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:36.548693] [DEBUG] [LOCAL ] HP: Loaded 51932 existing records from primary storage. [2025-09-26T19:19:36.566559] [INFO ] [MAIN ] HP: Loaded 51932 existing records. [2025-09-26T19:19:36.566390] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-26T19:19:36.581023] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-26T19:19:36.581837] [DEBUG] [LOCAL ] HOMB: Loaded 43979 existing records from primary storage. [2025-09-26T19:19:36.583168] [DEBUG] [LOCAL ] HOUS: Loaded 44514 existing records from primary storage. [2025-09-26T19:19:36.599376] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-26T19:19:36.599540] [INFO ] [MAIN ] HOUS: Loaded 44514 existing records. [2025-09-26T19:19:36.599630] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-26T19:19:36.611288] [INFO ] [MAIN ] HOMB: Loaded 43979 existing records. [2025-09-26T19:19:37.298878] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:37.473390] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:37.559939] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-26T19:19:37.609340] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-26T19:19:37.602917] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-26T19:19:37.609788] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-26T19:19:37.609573] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:37.620864] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-26T19:19:37.626257] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-26T19:19:37.644292] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-26T19:19:37.649175] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-26T19:19:37.649378] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-26T19:19:37.649491] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-26T19:19:37.813702] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-26T19:19:37.904883] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:37.936099] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-26T19:19:37.964707] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-26T19:19:38.811015] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:38.882775] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-26T19:19:38.892781] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:38.904327] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-26T19:19:38.982842] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:38.983445] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-26T19:19:39.208841] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T19:19:39.212882] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-26T19:19:40.175261] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T19:19:40.178753] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-26T19:19:40.407698] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:19:40.416580] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-26T19:19:40.451931] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-26T19:19:40.462593] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-26T19:19:40.582046] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T19:19:40.593316] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-26T19:19:40.781930] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T19:19:40.784932] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-26T19:19:41.629458] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-26T19:19:41.632801] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-26T19:19:41.842236] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T19:19:41.851146] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-26T19:19:42.079126] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-26T19:19:42.089752] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-26T19:19:42.193240] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:19:42.203632] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-26T19:19:42.253564] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T19:19:42.257251] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-26T19:19:42.898389] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T19:19:42.901434] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-26T19:19:42.972170] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T19:19:42.980214] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-26T19:19:43.618811] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T19:19:43.630069] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-26T19:19:43.684283] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T19:19:43.686763] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-26T19:19:43.703230] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-26T19:19:43.703733] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-26T19:19:44.320295] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:19:44.329806] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-26T19:19:44.474012] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-26T19:19:44.478569] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-26T19:19:45.054684] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T19:19:45.064454] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-26T19:19:45.279060] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T19:19:45.283506] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-26T19:19:45.318109] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:19:45.328993] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-26T19:19:45.823370] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T19:19:45.832961] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-26T19:19:45.990965] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-26T19:19:45.994231] [INFO ] [REMOTE ] HOV: Full fetch complete (19403 records). [2025-09-26T19:19:45.994354] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-26T19:19:46.374729] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-26T19:19:46.374972] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-26T19:19:46.375447] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-26T19:19:46.375563] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-26T19:19:46.376189] [DEBUG] [LOCAL ] HOV: Trimmed 19403 records to 13975 (keeping 200 days of data) [2025-09-26T19:19:46.495530] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T19:19:46.508227] [DEBUG] [LOCAL ] HOV: Primary data saved (13975 records). [2025-09-26T19:19:46.508849] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-26T19:19:46.508995] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HOV took 11.1s. Estimated remaining: 2h 58m 31s. Rate: 7.5 symbols/min [2025-09-26T19:19:46.509469] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-26T19:19:46.689917] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:46.744230] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-09-26T19:19:46.744418] [INFO ] [MAIN ] HPE: Loaded 54087 existing records. [2025-09-26T19:19:46.935073] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:46.935438] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-26T19:19:46.935521] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-26T19:19:46.937378] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-26T19:19:46.937442] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-26T19:19:47.292365] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T19:19:47.363090] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-26T19:19:47.395400] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:19:47.471583] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:47.472329] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-26T19:19:47.472936] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-26T19:19:48.113698] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:19:48.122322] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-26T19:19:49.051218] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T19:19:49.062731] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-26T19:19:49.175807] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:19:49.185213] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-26T19:19:49.386804] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T19:19:49.396095] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-26T19:19:49.586028] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-26T19:19:49.597831] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-26T19:19:50.767276] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:19:50.777570] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-26T19:19:50.894961] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T19:19:50.907678] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-26T19:19:51.103279] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-26T19:19:51.114230] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-26T19:19:51.415223] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T19:19:51.426049] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-26T19:19:52.381130] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T19:19:52.391141] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-26T19:19:52.474217] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T19:19:52.483817] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-26T19:19:52.823275] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:19:52.835393] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-26T19:19:53.309773] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T19:19:53.320300] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-26T19:19:54.166694] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T19:19:54.176874] [INFO ] [REMOTE ] HOUS: Full fetch complete (63057 records). [2025-09-26T19:19:54.177115] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-26T19:19:54.449638] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T19:19:54.520136] [INFO ] [REMOTE ] HOMB: Full fetch complete (63885 records). [2025-09-26T19:19:54.548194] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-26T19:19:54.795454] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-26T19:19:54.795672] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-26T19:19:54.802136] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-26T19:19:54.812703] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-26T19:19:54.947876] [DEBUG] [LOCAL ] HOUS: Trimmed 63057 records to 44903 (keeping 200 days of data) [2025-09-26T19:19:54.974112] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T19:19:55.127929] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-26T19:19:55.275411] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-26T19:19:55.275989] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-26T19:19:55.277314] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-26T19:19:55.278538] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-26T19:19:55.284188] [DEBUG] [LOCAL ] HOMB: Trimmed 63885 records to 44272 (keeping 200 days of data) [2025-09-26T19:19:55.417204] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-26T19:19:55.433838] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-26T19:19:55.602876] [DEBUG] [LOCAL ] HOUS: Primary data saved (44903 records). [2025-09-26T19:19:55.603569] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-26T19:19:55.603767] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOUS took 20.2s. Estimated remaining: 2h 58m 24s. Rate: 7.4 symbols/min [2025-09-26T19:19:55.794582] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:55.806699] [DEBUG] [LOCAL ] HPF: Loaded 7349 existing records from primary storage. [2025-09-26T19:19:55.807423] [INFO ] [MAIN ] HPF: Loaded 7349 existing records. [2025-09-26T19:19:56.019533] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:56.021972] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-26T19:19:56.022093] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-26T19:19:56.022554] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-26T19:19:56.022618] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-26T19:19:56.618979] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:56.619121] [DEBUG] [LOCAL ] HOMB: Primary data saved (44272 records). [2025-09-26T19:19:56.619794] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-26T19:19:56.619565] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-26T19:19:56.620024] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HOMB took 21.2s. Estimated remaining: 2h 58m 7s. Rate: 7.5 symbols/min [2025-09-26T19:19:56.811720] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:56.823741] [DEBUG] [LOCAL ] HPI: Loaded 10226 existing records from primary storage. [2025-09-26T19:19:56.824062] [INFO ] [MAIN ] HPI: Loaded 10226 existing records. [2025-09-26T19:19:57.018401] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:57.018924] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-26T19:19:57.019001] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-26T19:19:57.019626] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-26T19:19:57.019732] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-26T19:19:57.239471] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-26T19:19:57.363513] [INFO ] [REMOTE ] HP: Full fetch complete (73896 records). [2025-09-26T19:19:57.370024] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-26T19:19:57.492929] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:57.513185] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-26T19:19:57.599878] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T19:19:57.653998] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-26T19:19:57.932988] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-26T19:19:57.964713] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-26T19:19:57.965029] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-26T19:19:57.965411] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-26T19:19:57.968276] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-26T19:19:57.968517] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-26T19:19:57.971005] [DEBUG] [LOCAL ] HP: Trimmed 73896 records to 52313 (keeping 200 days of data) [2025-09-26T19:19:58.333760] [DEBUG] [LOCAL ] HP: Primary data saved (52313 records). [2025-09-26T19:19:58.333979] [INFO ] [MAIN ] HP: Full history saved. [2025-09-26T19:19:58.334115] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 22.9s. Estimated remaining: 2h 57m 51s. Rate: 7.5 symbols/min [2025-09-26T19:19:58.453363] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-26T19:19:58.456945] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-26T19:19:58.533636] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:19:58.542724] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T19:19:58.545863] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-26T19:19:58.596206] [DEBUG] [LOCAL ] HPP: Loaded 51214 existing records from primary storage. [2025-09-26T19:19:58.596489] [INFO ] [MAIN ] HPP: Loaded 51214 existing records. [2025-09-26T19:19:58.778850] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:19:58.779247] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-26T19:19:58.779300] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-26T19:19:58.780736] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-26T19:19:58.780800] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-26T19:19:59.171459] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:19:59.171935] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-26T19:19:59.184076] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T19:19:59.186605] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-26T19:19:59.270627] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T19:19:59.273378] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-26T19:19:59.819675] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T19:19:59.831273] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-26T19:19:59.898812] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-26T19:19:59.900953] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-26T19:19:59.922471] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-26T19:19:59.924855] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-26T19:20:00.450370] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-26T19:20:00.454268] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-26T19:20:00.669354] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T19:20:00.673025] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-26T19:20:00.883356] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:20:00.901972] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-26T19:20:01.037094] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T19:20:01.040289] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-26T19:20:01.406851] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T19:20:01.409140] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-26T19:20:01.552822] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-26T19:20:01.555289] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-26T19:20:01.998557] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-26T19:20:02.018012] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-26T19:20:02.228630] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-26T19:20:02.231148] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-26T19:20:02.445505] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-26T19:20:02.448972] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-26T19:20:02.699258] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T19:20:02.710075] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-26T19:20:02.772921] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-26T19:20:02.775820] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-26T19:20:03.204226] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-26T19:20:03.206733] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-26T19:20:03.327036] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-26T19:20:03.331445] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-26T19:20:03.890956] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-26T19:20:03.893528] [INFO ] [REMOTE ] HPF: Full fetch complete (10791 records). [2025-09-26T19:20:03.893713] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-26T19:20:04.307835] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T19:20:04.349846] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-26T19:20:04.349606] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-26T19:20:04.350107] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-26T19:20:04.351672] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-26T19:20:04.352126] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-26T19:20:04.353510] [DEBUG] [LOCAL ] HPF: Trimmed 10791 records to 7388 (keeping 200 days of data) [2025-09-26T19:20:04.438079] [DEBUG] [LOCAL ] HPF: Primary data saved (7388 records). [2025-09-26T19:20:04.439147] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-26T19:20:04.441702] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-26T19:20:04.452593] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPF took 8.8s. Estimated remaining: 2h 57m 41s. Rate: 7.5 symbols/min [2025-09-26T19:20:04.502856] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-26T19:20:04.533513] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:20:04.609850] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-26T19:20:04.685548] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:04.745974] [DEBUG] [LOCAL ] HPQ: Loaded 54058 existing records from primary storage. [2025-09-26T19:20:04.746215] [INFO ] [MAIN ] HPQ: Loaded 54058 existing records. [2025-09-26T19:20:04.943134] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:04.943673] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-26T19:20:04.943745] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-26T19:20:04.945315] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-26T19:20:04.945379] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-26T19:20:05.319198] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:05.319640] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-26T19:20:05.482433] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:20:05.486334] [INFO ] [REMOTE ] HPI: Full fetch complete (13555 records). [2025-09-26T19:20:05.486442] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-26T19:20:05.875886] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-26T19:20:05.876017] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-26T19:20:05.876526] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-26T19:20:05.876592] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-26T19:20:05.877363] [DEBUG] [LOCAL ] HPI: Trimmed 13555 records to 10339 (keeping 200 days of data) [2025-09-26T19:20:05.948803] [DEBUG] [LOCAL ] HPI: Primary data saved (10339 records). [2025-09-26T19:20:05.949026] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-26T19:20:05.949156] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPI took 9.3s. Estimated remaining: 2h 57m 24s. Rate: 7.5 symbols/min [2025-09-26T19:20:06.143061] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:06.156516] [DEBUG] [LOCAL ] HPS: Loaded 10230 existing records from primary storage. [2025-09-26T19:20:06.156728] [INFO ] [MAIN ] HPS: Loaded 10230 existing records. [2025-09-26T19:20:06.352855] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:06.353296] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-26T19:20:06.353463] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-26T19:20:06.354062] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-26T19:20:06.354124] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-26T19:20:06.601809] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-26T19:20:06.684144] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-26T19:20:06.800622] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:06.801324] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-26T19:20:06.878912] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-26T19:20:06.891347] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-26T19:20:07.478107] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-26T19:20:07.489080] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-26T19:20:07.714984] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T19:20:07.719490] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-26T19:20:08.374442] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T19:20:08.386711] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-26T19:20:08.505342] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T19:20:08.508181] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-26T19:20:08.743019] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:20:08.754621] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-26T19:20:08.754873] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-26T19:20:09.187325] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-26T19:20:09.187423] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-26T19:20:09.188398] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-26T19:20:09.188468] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-26T19:20:09.190138] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54477 (keeping 200 days of data) [2025-09-26T19:20:09.291870] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-26T19:20:09.297314] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-26T19:20:09.574542] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-26T19:20:09.588960] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-26T19:20:09.609606] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-09-26T19:20:09.609826] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-26T19:20:09.609929] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HPE took 23.1s. Estimated remaining: 2h 57m 11s. Rate: 7.5 symbols/min [2025-09-26T19:20:09.807908] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:09.839544] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T19:20:09.850727] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-26T19:20:09.873218] [DEBUG] [LOCAL ] HQH: Loaded 25135 existing records from primary storage. [2025-09-26T19:20:09.873390] [INFO ] [MAIN ] HQH: Loaded 25135 existing records. [2025-09-26T19:20:10.071290] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:10.071555] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-26T19:20:10.071603] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-26T19:20:10.072660] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-26T19:20:10.072730] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-26T19:20:10.194544] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T19:20:10.208870] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-26T19:20:10.465445] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:10.465824] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-26T19:20:11.122099] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-26T19:20:11.124625] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-26T19:20:11.260154] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T19:20:11.272108] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-26T19:20:11.384095] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:20:11.395778] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-26T19:20:11.898189] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T19:20:11.900823] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-26T19:20:11.929678] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:20:11.936538] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-26T19:20:12.467826] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T19:20:12.471142] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-26T19:20:12.892633] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T19:20:12.899121] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-26T19:20:13.000874] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T19:20:13.016037] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-26T19:20:13.078251] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T19:20:13.082340] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-26T19:20:13.139981] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T19:20:13.151910] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-26T19:20:13.661441] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-26T19:20:13.664329] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-26T19:20:14.036223] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T19:20:14.311732] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-26T19:20:14.413517] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T19:20:14.416065] [INFO ] [REMOTE ] HPS: Full fetch complete (15140 records). [2025-09-26T19:20:14.416146] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-26T19:20:14.830776] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-26T19:20:14.830906] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-26T19:20:14.831541] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-26T19:20:14.831758] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-26T19:20:14.832676] [DEBUG] [LOCAL ] HPS: Trimmed 15140 records to 10277 (keeping 200 days of data) [2025-09-26T19:20:14.920450] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T19:20:14.969414] [DEBUG] [LOCAL ] HPS: Primary data saved (10277 records). [2025-09-26T19:20:14.973019] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-26T19:20:14.973369] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HPS took 9.0s. Estimated remaining: 2h 56m 59s. Rate: 7.5 symbols/min [2025-09-26T19:20:14.975258] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T19:20:15.116833] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-26T19:20:15.177416] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:15.203237] [DEBUG] [LOCAL ] HQL: Loaded 15972 existing records from primary storage. [2025-09-26T19:20:15.203436] [INFO ] [MAIN ] HQL: Loaded 15972 existing records. [2025-09-26T19:20:15.334770] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-26T19:20:15.421233] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:15.421561] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-26T19:20:15.421613] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-26T19:20:15.422304] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-26T19:20:15.422367] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-26T19:20:15.814121] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:15.911766] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-26T19:20:16.711754] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-26T19:20:17.069825] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-26T19:20:17.459838] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T19:20:17.511767] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-26T19:20:18.311742] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-26T19:20:18.814576] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T19:20:18.825049] [INFO ] [REMOTE ] HPP: Full fetch complete (73375 records). [2025-09-26T19:20:18.825205] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-26T19:20:19.116612] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-26T19:20:19.270330] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-26T19:20:19.270482] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-26T19:20:19.272069] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-26T19:20:19.272160] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-26T19:20:19.274727] [DEBUG] [LOCAL ] HPP: Trimmed 73375 records to 51595 (keeping 200 days of data) [2025-09-26T19:20:19.402185] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-26T19:20:19.640458] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:20:19.659328] [DEBUG] [LOCAL ] HPP: Primary data saved (51595 records). [2025-09-26T19:20:19.659539] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-26T19:20:19.659677] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPP took 21.3s. Estimated remaining: 2h 56m 47s. Rate: 7.5 symbols/min [2025-09-26T19:20:19.838708] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:19.851703] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T19:20:19.910620] [DEBUG] [LOCAL ] HR: Loaded 52347 existing records from primary storage. [2025-09-26T19:20:19.910887] [INFO ] [MAIN ] HR: Loaded 52347 existing records. [2025-09-26T19:20:19.917044] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-26T19:20:20.126383] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:20.139075] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-26T19:20:20.139335] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-26T19:20:20.141092] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-26T19:20:20.141213] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-26T19:20:20.547039] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:20.711786] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-26T19:20:21.511896] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-26T19:20:22.101139] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-26T19:20:22.311693] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-26T19:20:22.434701] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-26T19:20:22.438665] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:20:23.111704] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-26T19:20:23.317077] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T19:20:23.911748] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-26T19:20:24.711740] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-26T19:20:24.950152] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:20:24.990513] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T19:20:25.511696] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-26T19:20:25.991873] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T19:20:26.311751] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-26T19:20:26.851498] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T19:20:27.111751] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-26T19:20:27.911736] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-26T19:20:28.365171] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-26T19:20:28.438210] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-26T19:20:28.449942] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-26T19:20:28.450155] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-26T19:20:28.716897] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-26T19:20:28.926133] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-26T19:20:28.926253] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-26T19:20:28.927300] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-26T19:20:28.927374] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-26T19:20:28.929637] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 54448 (keeping 200 days of data) [2025-09-26T19:20:29.060258] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-26T19:20:29.328747] [DEBUG] [LOCAL ] HPQ: Primary data saved (54448 records). [2025-09-26T19:20:29.328940] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-26T19:20:29.329101] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPQ took 24.9s. Estimated remaining: 2h 56m 41s. Rate: 7.5 symbols/min [2025-09-26T19:20:29.517712] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-26T19:20:29.517579] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:29.574157] [DEBUG] [LOCAL ] HRB: Loaded 48936 existing records from primary storage. [2025-09-26T19:20:29.574345] [INFO ] [MAIN ] HRB: Loaded 48936 existing records. [2025-09-26T19:20:29.778729] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:29.779083] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-26T19:20:29.779143] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-26T19:20:29.780740] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-26T19:20:29.780806] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-26T19:20:30.176760] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:30.232112] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:20:30.311734] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-26T19:20:30.908619] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-26T19:20:30.914879] [INFO ] [REMOTE ] HQH: Full fetch complete (37356 records). [2025-09-26T19:20:30.915084] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-26T19:20:31.122337] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-26T19:20:31.355238] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-26T19:20:31.355350] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-26T19:20:31.356106] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-26T19:20:31.356188] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-26T19:20:31.357197] [DEBUG] [LOCAL ] HQH: Trimmed 37356 records to 25387 (keeping 200 days of data) [2025-09-26T19:20:31.529182] [DEBUG] [LOCAL ] HQH: Primary data saved (25387 records). [2025-09-26T19:20:31.529343] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-26T19:20:31.529496] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HQH took 21.9s. Estimated remaining: 2h 56m 26s. Rate: 7.5 symbols/min [2025-09-26T19:20:31.713212] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:31.766801] [DEBUG] [LOCAL ] HRI: Loaded 33319 existing records from primary storage. [2025-09-26T19:20:31.766977] [INFO ] [MAIN ] HRI: Loaded 33319 existing records. [2025-09-26T19:20:31.916877] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-26T19:20:31.976235] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:31.976938] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-26T19:20:31.977072] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-26T19:20:31.978285] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-26T19:20:31.978363] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-26T19:20:32.330546] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T19:20:32.473858] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:32.711744] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-26T19:20:32.853628] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:20:33.005251] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T19:20:33.511763] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-26T19:20:33.945938] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T19:20:34.311752] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-26T19:20:35.111730] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-26T19:20:35.142582] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:20:35.303313] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T19:20:35.911743] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-26T19:20:36.348227] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-26T19:20:36.711769] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-26T19:20:36.746629] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T19:20:37.511723] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-26T19:20:38.311720] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-26T19:20:38.466404] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T19:20:39.096573] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:20:39.111683] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-26T19:20:39.300395] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T19:20:39.911742] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-26T19:20:40.261320] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T19:20:40.711739] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-26T19:20:41.515384] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-26T19:20:41.521925] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T19:20:41.710445] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T19:20:42.311744] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-26T19:20:43.111707] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-26T19:20:43.221924] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-26T19:20:43.767408] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-26T19:20:43.911729] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-26T19:20:44.230682] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T19:20:44.234297] [INFO ] [REMOTE ] HQL: Full fetch complete (24405 records). [2025-09-26T19:20:44.234384] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-26T19:20:44.642818] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-26T19:20:44.642915] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-26T19:20:44.643455] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-26T19:20:44.643517] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-26T19:20:44.644792] [DEBUG] [LOCAL ] HQL: Trimmed 24405 records to 16206 (keeping 200 days of data) [2025-09-26T19:20:44.727321] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-26T19:20:44.759038] [DEBUG] [LOCAL ] HQL: Primary data saved (16206 records). [2025-09-26T19:20:44.759221] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-26T19:20:44.759337] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HQL took 29.8s. Estimated remaining: 2h 56m 24s. Rate: 7.5 symbols/min [2025-09-26T19:20:44.945223] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:45.010893] [DEBUG] [LOCAL ] HRL: Loaded 53474 existing records from primary storage. [2025-09-26T19:20:45.011089] [INFO ] [MAIN ] HRL: Loaded 53474 existing records. [2025-09-26T19:20:45.220804] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:45.221327] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-26T19:20:45.221400] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-26T19:20:45.223073] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-26T19:20:45.223143] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-26T19:20:45.362998] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T19:20:45.518988] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-26T19:20:45.656012] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:46.311724] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-26T19:20:46.633981] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T19:20:47.017542] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:20:47.111737] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-26T19:20:47.911735] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-26T19:20:48.081029] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T19:20:48.657103] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:20:48.711717] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-26T19:20:49.511700] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-26T19:20:49.700704] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-26T19:20:50.311768] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-26T19:20:50.459339] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-26T19:20:50.833107] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T19:20:51.111744] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-26T19:20:51.911709] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-26T19:20:52.044817] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T19:20:52.186427] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-26T19:20:52.711752] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-26T19:20:53.511739] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-26T19:20:53.627776] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:20:54.169637] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T19:20:54.311796] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-26T19:20:55.111744] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-26T19:20:55.284952] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:20:55.852699] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T19:20:55.859172] [INFO ] [REMOTE ] HRI: Full fetch complete (46062 records). [2025-09-26T19:20:55.859334] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-26T19:20:55.921756] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-26T19:20:56.268621] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-26T19:20:56.268756] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-26T19:20:56.269490] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-26T19:20:56.269553] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-26T19:20:56.270770] [DEBUG] [LOCAL ] HRI: Trimmed 46062 records to 33507 (keeping 200 days of data) [2025-09-26T19:20:56.493690] [DEBUG] [LOCAL ] HRI: Primary data saved (33507 records). [2025-09-26T19:20:56.493894] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-26T19:20:56.494024] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HRI took 25.0s. Estimated remaining: 2h 56m 21s. Rate: 7.5 symbols/min [2025-09-26T19:20:56.683189] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:56.711713] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-26T19:20:56.728521] [DEBUG] [LOCAL ] HRTG: Loaded 33404 existing records from primary storage. [2025-09-26T19:20:56.728740] [INFO ] [MAIN ] HRTG: Loaded 33404 existing records. [2025-09-26T19:20:56.934038] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:56.934547] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-26T19:20:56.934687] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-26T19:20:56.945607] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-26T19:20:56.965374] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-26T19:20:57.008411] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T19:20:57.087368] [INFO ] [REMOTE ] HR: Full fetch complete (74846 records). [2025-09-26T19:20:57.105318] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-26T19:20:57.669608] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:57.683542] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-26T19:20:57.842241] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-26T19:20:57.842354] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-26T19:20:57.843369] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-26T19:20:57.843526] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-26T19:20:57.873717] [DEBUG] [LOCAL ] HR: Trimmed 74846 records to 52716 (keeping 200 days of data) [2025-09-26T19:20:57.875065] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-26T19:20:58.232286] [DEBUG] [LOCAL ] HR: Primary data saved (52716 records). [2025-09-26T19:20:58.232490] [INFO ] [MAIN ] HR: Full history saved. [2025-09-26T19:20:58.232637] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HR took 38.6s. Estimated remaining: 2h 56m 5s. Rate: 7.5 symbols/min [2025-09-26T19:20:58.314512] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-26T19:20:58.419826] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:20:58.474187] [DEBUG] [LOCAL ] HSBC: Loaded 51502 existing records from primary storage. [2025-09-26T19:20:58.474348] [INFO ] [MAIN ] HSBC: Loaded 51502 existing records. [2025-09-26T19:20:58.663989] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:20:58.664509] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-26T19:20:58.664570] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-26T19:20:58.676762] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-26T19:20:58.695482] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-26T19:20:58.745229] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-26T19:20:59.036529] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-26T19:20:59.116857] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-26T19:20:59.159924] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:20:59.829239] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T19:20:59.911732] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-26T19:21:00.723473] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-26T19:21:00.730382] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:21:01.511707] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-26T19:21:01.692752] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:21:01.733388] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T19:21:02.311726] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-26T19:21:03.111705] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-26T19:21:03.292439] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-26T19:21:03.318969] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T19:21:03.911743] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-26T19:21:04.711728] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-26T19:21:05.005227] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:21:05.015068] [INFO ] [REMOTE ] HRB: Full fetch complete (69782 records). [2025-09-26T19:21:05.015233] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-26T19:21:05.446049] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-26T19:21:05.446239] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-26T19:21:05.447324] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-26T19:21:05.447426] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-26T19:21:05.449149] [DEBUG] [LOCAL ] HRB: Trimmed 69782 records to 49275 (keeping 200 days of data) [2025-09-26T19:21:05.519541] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-26T19:21:05.582146] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:21:05.821461] [DEBUG] [LOCAL ] HRB: Primary data saved (49275 records). [2025-09-26T19:21:05.821708] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-26T19:21:05.821842] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRB took 36.5s. Estimated remaining: 2h 55m 56s. Rate: 7.5 symbols/min [2025-09-26T19:21:05.998051] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:06.016739] [DEBUG] [LOCAL ] HSHP: Loaded 15656 existing records from primary storage. [2025-09-26T19:21:06.016903] [INFO ] [MAIN ] HSHP: Loaded 15656 existing records. [2025-09-26T19:21:06.210010] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:06.210455] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-26T19:21:06.210537] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-26T19:21:06.211426] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-26T19:21:06.211498] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-26T19:21:06.312726] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-26T19:21:06.530684] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T19:21:06.644175] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:06.662271] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:21:07.111797] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-26T19:21:07.911731] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-26T19:21:08.049832] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T19:21:08.548828] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T19:21:08.711729] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-26T19:21:09.511772] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-26T19:21:09.715460] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T19:21:10.136328] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-26T19:21:10.311737] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-26T19:21:11.111755] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-26T19:21:11.325366] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T19:21:11.381712] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T19:21:11.911759] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-26T19:21:12.711739] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-26T19:21:13.200572] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-26T19:21:13.473150] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:21:13.511677] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-26T19:21:13.754077] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:21:14.311743] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-26T19:21:14.960060] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T19:21:15.111773] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-26T19:21:15.320729] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T19:21:15.911734] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-26T19:21:16.711757] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-26T19:21:17.199982] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-26T19:21:17.380624] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T19:21:17.511730] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-26T19:21:18.311710] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-26T19:21:18.663682] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:21:18.898179] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T19:21:19.111734] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-26T19:21:19.339232] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T19:21:19.911745] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-26T19:21:20.711735] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-26T19:21:20.783057] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T19:21:21.089749] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-26T19:21:21.511760] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-26T19:21:22.311771] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-26T19:21:22.357154] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:21:22.365268] [INFO ] [REMOTE ] HRTG: Full fetch complete (42599 records). [2025-09-26T19:21:22.365485] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-26T19:21:22.715787] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T19:21:22.811770] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-26T19:21:22.811877] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-26T19:21:22.812679] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-26T19:21:22.812749] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-26T19:21:22.814176] [DEBUG] [LOCAL ] HRTG: Trimmed 42599 records to 33658 (keeping 200 days of data) [2025-09-26T19:21:23.043237] [DEBUG] [LOCAL ] HRTG: Primary data saved (33658 records). [2025-09-26T19:21:23.043470] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-26T19:21:23.043700] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HRTG took 26.5s. Estimated remaining: 2h 55m 60s. Rate: 7.5 symbols/min [2025-09-26T19:21:23.116881] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-26T19:21:23.235950] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:23.291926] [DEBUG] [LOCAL ] HSY: Loaded 50791 existing records from primary storage. [2025-09-26T19:21:23.292136] [INFO ] [MAIN ] HSY: Loaded 50791 existing records. [2025-09-26T19:21:23.489042] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:23.489338] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-26T19:21:23.489386] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-26T19:21:23.490887] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-26T19:21:23.490954] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-26T19:21:23.891145] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:23.911699] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-26T19:21:24.145005] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T19:21:24.411073] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T19:21:24.422409] [INFO ] [REMOTE ] HRL: Full fetch complete (76682 records). [2025-09-26T19:21:24.422594] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-26T19:21:24.716908] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-26T19:21:24.870680] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-26T19:21:24.870804] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-26T19:21:24.871880] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-26T19:21:24.871983] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-26T19:21:24.873855] [DEBUG] [LOCAL ] HRL: Trimmed 76682 records to 53855 (keeping 200 days of data) [2025-09-26T19:21:25.234307] [DEBUG] [LOCAL ] HRL: Primary data saved (53855 records). [2025-09-26T19:21:25.234567] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-26T19:21:25.235962] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HRL took 40.5s. Estimated remaining: 2h 55m 45s. Rate: 7.5 symbols/min [2025-09-26T19:21:25.445204] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:25.445536] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-26T19:21:25.445677] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-26T19:21:25.445849] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-26T19:21:25.445906] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-26T19:21:25.445979] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-26T19:21:25.446037] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-26T19:21:25.513964] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-26T19:21:25.890964] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:25.923299] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T19:21:26.267044] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T19:21:26.311751] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-26T19:21:26.531546] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:21:26.531987] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-26T19:21:26.640419] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-26T19:21:27.111718] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-26T19:21:27.473090] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:21:27.473455] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-26T19:21:27.911727] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-26T19:21:28.711778] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-26T19:21:29.511771] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-26T19:21:29.838735] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:21:29.843033] [INFO ] [REMOTE ] HSHP: Full fetch complete (23441 records). [2025-09-26T19:21:29.843195] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-26T19:21:30.067230] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-26T19:21:30.313364] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-26T19:21:30.313113] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-26T19:21:30.314489] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-26T19:21:30.315219] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-26T19:21:30.315287] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-26T19:21:30.316426] [DEBUG] [LOCAL ] HSHP: Trimmed 23441 records to 15773 (keeping 200 days of data) [2025-09-26T19:21:30.417126] [DEBUG] [LOCAL ] HSHP: Primary data saved (15773 records). [2025-09-26T19:21:30.417301] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-26T19:21:30.417412] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSHP took 24.6s. Estimated remaining: 2h 55m 33s. Rate: 7.5 symbols/min [2025-09-26T19:21:30.630842] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:30.626499] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-26T19:21:30.647975] [DEBUG] [LOCAL ] HTD: Loaded 13643 existing records from primary storage. [2025-09-26T19:21:30.648134] [INFO ] [MAIN ] HTD: Loaded 13643 existing records. [2025-09-26T19:21:30.836434] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:30.836811] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-26T19:21:30.836867] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-26T19:21:30.837575] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-26T19:21:30.837639] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-26T19:21:31.116895] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-26T19:21:31.241926] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:31.273953] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:21:31.911710] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-26T19:21:31.986858] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-26T19:21:32.711731] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-26T19:21:33.436914] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-26T19:21:33.511703] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-26T19:21:33.818388] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T19:21:34.179163] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T19:21:34.311725] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-26T19:21:35.111743] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-26T19:21:35.127124] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T19:21:35.911740] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-26T19:21:36.658213] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T19:21:36.711688] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-26T19:21:36.985885] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T19:21:37.511731] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-26T19:21:38.311720] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-26T19:21:38.434770] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T19:21:38.702477] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T19:21:39.111767] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-26T19:21:39.868563] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T19:21:39.911705] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-26T19:21:39.944420] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T19:21:40.711729] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-26T19:21:41.511758] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-26T19:21:41.626269] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:21:41.636462] [INFO ] [REMOTE ] HSBC: Full fetch complete (73676 records). [2025-09-26T19:21:41.636743] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-26T19:21:42.074542] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-26T19:21:42.074719] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-26T19:21:42.075748] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-26T19:21:42.075815] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-26T19:21:42.077699] [DEBUG] [LOCAL ] HSBC: Trimmed 73676 records to 51868 (keeping 200 days of data) [2025-09-26T19:21:42.312761] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-26T19:21:42.429820] [DEBUG] [LOCAL ] HSBC: Primary data saved (51868 records). [2025-09-26T19:21:42.430023] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-26T19:21:42.430160] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HSBC took 44.2s. Estimated remaining: 2h 55m 30s. Rate: 7.5 symbols/min [2025-09-26T19:21:42.597773] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T19:21:42.650240] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:42.650739] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-26T19:21:42.650817] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-26T19:21:42.651116] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-26T19:21:42.651176] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-26T19:21:42.651421] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-26T19:21:42.651480] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-26T19:21:42.780719] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-26T19:21:43.070907] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T19:21:43.076622] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:43.111697] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-26T19:21:43.619128] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-26T19:21:43.911758] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-26T19:21:44.711790] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-26T19:21:45.511744] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-26T19:21:45.581434] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T19:21:45.618459] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:21:45.891337] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-26T19:21:46.311967] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-26T19:21:46.661242] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-26T19:21:47.111770] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-26T19:21:47.815776] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-26T19:21:47.911741] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-26T19:21:48.240638] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T19:21:48.711739] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-26T19:21:49.511711] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-26T19:21:49.586185] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T19:21:49.842216] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-26T19:21:50.311796] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-26T19:21:51.111738] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-26T19:21:51.346077] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-26T19:21:51.911734] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-26T19:21:52.045604] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-26T19:21:52.048514] [INFO ] [REMOTE ] HTB: Full fetch complete (7890 records). [2025-09-26T19:21:52.048633] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-26T19:21:52.251474] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 146 unique days, need 200 days [2025-09-26T19:21:52.251784] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:21:52.251858] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:21:52.251957] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-26T19:21:52.252085] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-26T19:21:52.252158] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-26T19:21:52.252240] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-26T19:21:52.252328] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HTB took 27.0s. Estimated remaining: 2h 55m 24s. Rate: 7.5 symbols/min [2025-09-26T19:21:52.439523] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:52.503158] [DEBUG] [LOCAL ] HTGC: Loaded 47908 existing records from primary storage. [2025-09-26T19:21:52.503355] [INFO ] [MAIN ] HTGC: Loaded 47908 existing records. [2025-09-26T19:21:52.698233] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:52.698500] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-26T19:21:52.698549] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-26T19:21:52.699969] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-26T19:21:52.700031] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-26T19:21:52.721033] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-26T19:21:53.087681] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:53.511732] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-26T19:21:53.613831] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:21:53.841500] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T19:21:53.958876] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-26T19:21:54.311748] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-26T19:21:55.111735] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-26T19:21:55.911736] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-26T19:21:56.140049] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:21:56.204783] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-26T19:21:56.208258] [INFO ] [REMOTE ] HTD: Full fetch complete (18946 records). [2025-09-26T19:21:56.208342] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-26T19:21:56.298453] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-26T19:21:56.618551] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-26T19:21:56.618664] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-26T19:21:56.619121] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-26T19:21:56.619205] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-26T19:21:56.620054] [DEBUG] [LOCAL ] HTD: Trimmed 18946 records to 13754 (keeping 200 days of data) [2025-09-26T19:21:56.709975] [DEBUG] [LOCAL ] HTD: Primary data saved (13754 records). [2025-09-26T19:21:56.710153] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-26T19:21:56.710249] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTD took 26.3s. Estimated remaining: 2h 55m 12s. Rate: 7.5 symbols/min [2025-09-26T19:21:56.716937] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-26T19:21:56.904751] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:21:56.939292] [DEBUG] [LOCAL ] HTH: Loaded 32572 existing records from primary storage. [2025-09-26T19:21:56.939483] [INFO ] [MAIN ] HTH: Loaded 32572 existing records. [2025-09-26T19:21:57.139990] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:21:57.140295] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-26T19:21:57.140348] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-26T19:21:57.141606] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-26T19:21:57.141699] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-26T19:21:57.522528] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-26T19:21:57.530527] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:21:58.311736] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-26T19:21:58.464246] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:21:59.111708] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-26T19:21:59.409924] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:21:59.420174] [INFO ] [REMOTE ] HSY: Full fetch complete (73779 records). [2025-09-26T19:21:59.420343] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-26T19:21:59.471003] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-26T19:21:59.554174] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T19:21:59.868958] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-26T19:21:59.869064] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-26T19:21:59.870026] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-26T19:21:59.870099] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-26T19:21:59.871823] [DEBUG] [LOCAL ] HSY: Trimmed 73779 records to 51161 (keeping 200 days of data) [2025-09-26T19:21:59.927913] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-26T19:22:00.216404] [DEBUG] [LOCAL ] HSY: Primary data saved (51161 records). [2025-09-26T19:22:00.216580] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-26T19:22:00.216721] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HSY took 37.2s. Estimated remaining: 2h 54m 58s. Rate: 7.5 symbols/min [2025-09-26T19:22:00.443838] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:00.483670] [DEBUG] [LOCAL ] HUBB: Loaded 37414 existing records from primary storage. [2025-09-26T19:22:00.483861] [INFO ] [MAIN ] HUBB: Loaded 37414 existing records. [2025-09-26T19:22:00.686048] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:00.686332] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-26T19:22:00.686383] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-26T19:22:00.687707] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-26T19:22:00.687770] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-26T19:22:00.720791] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-26T19:22:01.079124] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:01.511758] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-26T19:22:01.769003] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-26T19:22:01.845049] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-26T19:22:02.252329] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:22:02.311775] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-26T19:22:03.111727] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-26T19:22:03.835905] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:22:03.911732] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-26T19:22:04.128625] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T19:22:04.711773] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-26T19:22:05.488987] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:22:05.511684] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-26T19:22:05.589553] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T19:22:05.745785] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-26T19:22:06.311744] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-26T19:22:07.111736] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-26T19:22:07.738402] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-26T19:22:07.911733] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-26T19:22:08.365089] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-26T19:22:08.366101] [INFO ] [REMOTE ] HTFC: Full fetch complete (837 records). [2025-09-26T19:22:08.366177] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-26T19:22:08.603249] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-26T19:22:08.607910] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-26T19:22:08.615760] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:22:08.616340] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:22:08.616902] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-26T19:22:08.617060] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-26T19:22:08.617132] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-26T19:22:08.617219] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-26T19:22:08.617337] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HTFC took 26.2s. Estimated remaining: 2h 54m 51s. Rate: 7.5 symbols/min [2025-09-26T19:22:08.716873] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-26T19:22:08.828611] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:08.892462] [DEBUG] [LOCAL ] HUBS: Loaded 39738 existing records from primary storage. [2025-09-26T19:22:08.892670] [INFO ] [MAIN ] HUBS: Loaded 39738 existing records. [2025-09-26T19:22:09.095935] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:09.096413] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-26T19:22:09.096481] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-26T19:22:09.098269] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-26T19:22:09.098359] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-26T19:22:09.525933] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-26T19:22:09.533030] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:10.311703] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-26T19:22:10.481183] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T19:22:11.111775] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-26T19:22:11.242865] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T19:22:11.718713] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-26T19:22:11.911722] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-26T19:22:12.711751] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-26T19:22:12.831144] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T19:22:13.344378] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T19:22:13.511740] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-26T19:22:14.311737] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-26T19:22:14.527120] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T19:22:14.775925] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T19:22:15.111756] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-26T19:22:15.524935] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T19:22:15.911732] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-26T19:22:16.711748] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-26T19:22:17.019749] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:22:17.504160] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:22:17.512484] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-26T19:22:18.242303] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:22:18.311726] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-26T19:22:18.967792] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-26T19:22:19.111724] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-26T19:22:19.911737] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-26T19:22:19.977029] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T19:22:20.541518] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-26T19:22:20.711743] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-26T19:22:21.275201] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T19:22:21.511778] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-26T19:22:22.250929] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:22:22.311731] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-26T19:22:22.996258] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T19:22:23.002534] [INFO ] [REMOTE ] HTH: Full fetch complete (46708 records). [2025-09-26T19:22:23.002677] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-26T19:22:23.112606] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-26T19:22:23.410967] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-26T19:22:23.411074] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-26T19:22:23.411817] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-26T19:22:23.411885] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-26T19:22:23.413127] [DEBUG] [LOCAL ] HTH: Trimmed 46708 records to 32696 (keeping 200 days of data) [2025-09-26T19:22:23.629801] [DEBUG] [LOCAL ] HTH: Primary data saved (32696 records). [2025-09-26T19:22:23.629962] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-26T19:22:23.630103] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTH took 26.9s. Estimated remaining: 2h 54m 51s. Rate: 7.5 symbols/min [2025-09-26T19:22:23.821341] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:23.846070] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:22:23.900906] [DEBUG] [LOCAL ] HUM: Loaded 49222 existing records from primary storage. [2025-09-26T19:22:23.901089] [INFO ] [MAIN ] HUM: Loaded 49222 existing records. [2025-09-26T19:22:23.916835] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-26T19:22:24.101941] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:24.102270] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-26T19:22:24.102361] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-26T19:22:24.104332] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-26T19:22:24.104412] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-26T19:22:24.530366] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:24.711743] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-26T19:22:24.987387] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T19:22:25.374551] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-26T19:22:25.511760] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-26T19:22:25.982404] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-26T19:22:26.311740] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-26T19:22:27.111726] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-26T19:22:27.180065] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:22:27.191034] [INFO ] [REMOTE ] HUBB: Full fetch complete (53706 records). [2025-09-26T19:22:27.191215] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-26T19:22:27.662474] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-26T19:22:27.662688] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-26T19:22:27.664630] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-26T19:22:27.664750] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-26T19:22:27.667531] [DEBUG] [LOCAL ] HUBB: Trimmed 53706 records to 37650 (keeping 200 days of data) [2025-09-26T19:22:27.918165] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-26T19:22:27.944308] [DEBUG] [LOCAL ] HUBB: Primary data saved (37650 records). [2025-09-26T19:22:27.944872] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-26T19:22:27.945110] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBB took 27.7s. Estimated remaining: 2h 54m 39s. Rate: 7.5 symbols/min [2025-09-26T19:22:28.021610] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T19:22:28.242395] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:28.311530] [DEBUG] [LOCAL ] HUN: Loaded 53586 existing records from primary storage. [2025-09-26T19:22:28.311726] [INFO ] [MAIN ] HUN: Loaded 53586 existing records. [2025-09-26T19:22:28.528134] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:28.528395] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-26T19:22:28.528467] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-26T19:22:28.530091] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-26T19:22:28.530153] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-26T19:22:28.714473] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-26T19:22:28.944764] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:28.963409] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T19:22:29.511715] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-26T19:22:29.759349] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-26T19:22:30.219537] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-26T19:22:30.311730] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-26T19:22:30.836103] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-26T19:22:31.111759] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-26T19:22:31.911719] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-26T19:22:32.162270] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T19:22:32.640863] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:22:32.711725] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-26T19:22:33.503158] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:22:33.513441] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-26T19:22:34.319423] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-26T19:22:34.336795] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:22:35.111711] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-26T19:22:35.320193] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:22:35.334979] [INFO ] [REMOTE ] HTGC: Full fetch complete (68170 records). [2025-09-26T19:22:35.335173] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-26T19:22:35.760725] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-26T19:22:35.760874] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-26T19:22:35.761899] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-26T19:22:35.762091] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-26T19:22:35.763818] [DEBUG] [LOCAL ] HTGC: Trimmed 68170 records to 48222 (keeping 200 days of data) [2025-09-26T19:22:35.912293] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-26T19:22:35.937520] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:22:36.141162] [DEBUG] [LOCAL ] HTGC: Primary data saved (48222 records). [2025-09-26T19:22:36.141343] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-26T19:22:36.142306] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HTGC took 43.9s. Estimated remaining: 2h 54m 31s. Rate: 7.5 symbols/min [2025-09-26T19:22:36.324480] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:36.372253] [DEBUG] [LOCAL ] HUYA: Loaded 44671 existing records from primary storage. [2025-09-26T19:22:36.372439] [INFO ] [MAIN ] HUYA: Loaded 44671 existing records. [2025-09-26T19:22:36.617457] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:36.617855] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-26T19:22:36.617933] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-26T19:22:36.619399] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-26T19:22:36.619480] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-26T19:22:36.712995] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-26T19:22:37.030722] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:37.059432] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:22:37.511739] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-26T19:22:37.763839] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T19:22:38.248903] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:22:38.311730] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-26T19:22:39.095088] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:22:39.111670] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-26T19:22:39.911720] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-26T19:22:40.205332] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T19:22:40.713248] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-26T19:22:40.719582] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:22:41.344052] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T19:22:41.511757] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-26T19:22:42.311690] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-26T19:22:42.407229] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T19:22:42.417362] [INFO ] [REMOTE ] HUBS: Full fetch complete (55297 records). [2025-09-26T19:22:42.417677] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-26T19:22:42.817565] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T19:22:42.911678] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-26T19:22:42.911787] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-26T19:22:42.912676] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-26T19:22:42.912742] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-26T19:22:42.916393] [DEBUG] [LOCAL ] HUBS: Trimmed 55297 records to 39953 (keeping 200 days of data) [2025-09-26T19:22:43.112495] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-26T19:22:43.180180] [DEBUG] [LOCAL ] HUBS: Primary data saved (39953 records). [2025-09-26T19:22:43.180362] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-26T19:22:43.180474] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUBS took 34.6s. Estimated remaining: 2h 54m 21s. Rate: 7.5 symbols/min [2025-09-26T19:22:43.362044] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:22:43.379751] [DEBUG] [LOCAL ] HVT: Loaded 16061 existing records from primary storage. [2025-09-26T19:22:43.379883] [INFO ] [MAIN ] HVT: Loaded 16061 existing records. [2025-09-26T19:22:43.572213] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:22:43.572580] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-26T19:22:43.572635] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-26T19:22:43.573410] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-26T19:22:43.573475] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-26T19:22:43.912679] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-26T19:22:43.999590] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:22:44.081435] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-26T19:22:44.703780] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:22:44.714382] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-26T19:22:45.511719] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-26T19:22:45.652513] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T19:22:46.311697] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-26T19:22:46.836709] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-26T19:22:47.111739] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-26T19:22:47.554202] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-26T19:22:47.604818] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T19:22:47.911710] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-26T19:22:48.143729] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:22:48.711757] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-26T19:22:49.326152] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-26T19:22:49.366377] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T19:22:49.511732] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-26T19:22:50.311764] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-26T19:22:51.111773] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-26T19:22:51.288755] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-26T19:22:51.340473] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:22:51.911773] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-26T19:22:52.711757] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-26T19:22:53.511769] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-26T19:23:05.769369] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (13.86 seconds). [2025-09-26T19:23:05.774524] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-26T19:23:05.939792] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (13.23 seconds). [2025-09-26T19:23:05.949001] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-26T19:23:06.219148] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (12.71 seconds). [2025-09-26T19:23:06.231594] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-26T19:23:06.928499] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-26T19:23:06.933914] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-26T19:23:07.755004] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (16.64 seconds). [2025-09-26T19:23:07.766065] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-26T19:23:07.885969] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:23:07.896740] [INFO ] [REMOTE ] HUN: Full fetch complete (76608 records). [2025-09-26T19:23:07.896902] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-26T19:23:08.342010] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-26T19:23:08.342255] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-26T19:23:08.343223] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-26T19:23:08.343310] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-26T19:23:08.345320] [DEBUG] [LOCAL ] HUN: Trimmed 76608 records to 53976 (keeping 200 days of data) [2025-09-26T19:23:08.421331] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:23:08.453944] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-26T19:23:08.714797] [DEBUG] [LOCAL ] HUN: Primary data saved (53976 records). [2025-09-26T19:23:08.715041] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-26T19:23:08.715206] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HUN took 40.8s. Estimated remaining: 2h 54m 35s. Rate: 7.5 symbols/min [2025-09-26T19:23:08.902857] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:08.964518] [DEBUG] [LOCAL ] HWM: Loaded 53388 existing records from primary storage. [2025-09-26T19:23:08.964718] [INFO ] [MAIN ] HWM: Loaded 53388 existing records. [2025-09-26T19:23:09.162633] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:09.163230] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-26T19:23:09.163301] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-26T19:23:09.174612] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-26T19:23:09.194246] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-26T19:23:09.252147] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-09-26T19:23:09.327594] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-26T19:23:09.506388] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-26T19:23:09.554346] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-26T19:23:09.646479] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:09.647186] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-26T19:23:09.750462] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T19:23:09.762065] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-26T19:23:10.681696] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T19:23:10.686366] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-26T19:23:10.852116] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T19:23:10.862682] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-26T19:23:11.363674] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T19:23:11.375507] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-26T19:23:11.601782] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T19:23:11.617388] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-26T19:23:11.715620] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-26T19:23:11.719384] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-26T19:23:12.398052] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T19:23:12.410887] [INFO ] [REMOTE ] HUYA: Full fetch complete (63698 records). [2025-09-26T19:23:12.411096] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-26T19:23:12.962049] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-26T19:23:12.971739] [INFO ] [REMOTE ] HVT: Full fetch complete (23546 records). [2025-09-26T19:23:12.982133] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-26T19:23:13.228778] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-26T19:23:13.250191] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-26T19:23:13.271794] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-26T19:23:13.296077] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-26T19:23:13.372057] [DEBUG] [LOCAL ] HUYA: Trimmed 63698 records to 44956 (keeping 200 days of data) [2025-09-26T19:23:13.667378] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-26T19:23:13.697708] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-26T19:23:13.698678] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-26T19:23:13.699482] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-26T19:23:13.703547] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T19:23:13.715835] [DEBUG] [LOCAL ] HVT: Trimmed 23546 records to 16133 (keeping 200 days of data) [2025-09-26T19:23:13.719534] [INFO ] [REMOTE ] HUM: Full fetch complete (70944 records). [2025-09-26T19:23:13.721628] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-26T19:23:13.840284] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-26T19:23:13.946173] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-26T19:23:14.429031] [DEBUG] [LOCAL ] HVT: Primary data saved (16133 records). [2025-09-26T19:23:14.435050] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-26T19:23:14.440431] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HVT took 31.3s. Estimated remaining: 2h 54m 24s. Rate: 7.5 symbols/min [2025-09-26T19:23:14.843469] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:15.008122] [DEBUG] [LOCAL ] HUYA: Primary data saved (44956 records). [2025-09-26T19:23:15.042782] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-26T19:23:15.043149] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-26T19:23:15.043628] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HUYA took 38.9s. Estimated remaining: 2h 54m 7s. Rate: 7.5 symbols/min [2025-09-26T19:23:15.043912] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-26T19:23:15.045512] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-26T19:23:15.046056] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-26T19:23:15.155897] [DEBUG] [LOCAL ] HUM: Trimmed 70944 records to 49568 (keeping 200 days of data) [2025-09-26T19:23:15.345354] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:15.375061] [DEBUG] [LOCAL ] HXL: Loaded 46282 existing records from primary storage. [2025-09-26T19:23:15.376098] [INFO ] [MAIN ] HXL: Loaded 46282 existing records. [2025-09-26T19:23:15.479844] [DEBUG] [LOCAL ] HY: Loaded 10146 existing records from primary storage. [2025-09-26T19:23:15.493877] [INFO ] [MAIN ] HY: Loaded 10146 existing records. [2025-09-26T19:23:15.706096] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:15.727677] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-26T19:23:15.738877] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-26T19:23:15.751872] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-26T19:23:15.753784] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-26T19:23:15.881763] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:15.919821] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-26T19:23:15.943328] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-26T19:23:15.955103] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-26T19:23:15.955745] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-26T19:23:16.748562] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:16.772231] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-26T19:23:16.826736] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (2.88 seconds). [2025-09-26T19:23:16.921078] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:16.923019] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-26T19:23:16.929674] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-26T19:23:16.932256] [DEBUG] [LOCAL ] HUM: Primary data saved (49568 records). [2025-09-26T19:23:16.932485] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-26T19:23:16.933479] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HUM took 53.3s. Estimated remaining: 2h 53m 51s. Rate: 7.5 symbols/min [2025-09-26T19:23:17.118134] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:17.118351] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-26T19:23:17.118402] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-26T19:23:17.118554] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-26T19:23:17.118599] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-26T19:23:17.118664] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-26T19:23:17.118725] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-26T19:23:17.514036] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:17.514444] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-26T19:23:17.795017] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-26T19:23:17.798005] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-26T19:23:17.865766] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-26T19:23:17.866763] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-26T19:23:18.489510] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T19:23:18.490620] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-26T19:23:18.522299] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:23:18.531354] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-26T19:23:18.632598] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T19:23:18.635606] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-26T19:23:18.786442] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-26T19:23:18.787460] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-26T19:23:18.836615] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-26T19:23:18.847893] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-26T19:23:19.019378] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-26T19:23:19.020308] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-26T19:23:19.260987] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-26T19:23:19.261926] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-26T19:23:19.433254] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T19:23:19.436030] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-26T19:23:19.591709] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-26T19:23:19.592991] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-26T19:23:19.852394] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-26T19:23:19.853431] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-26T19:23:20.047151] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:23:20.057959] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-26T19:23:20.124298] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T19:23:20.135940] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-26T19:23:20.657464] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T19:23:20.711703] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-26T19:23:21.167781] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T19:23:21.511721] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-26T19:23:22.311730] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-26T19:23:22.362817] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T19:23:22.547154] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-26T19:23:22.643623] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-26T19:23:23.111739] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-26T19:23:23.911747] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-26T19:23:24.269836] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-26T19:23:24.270837] [INFO ] [REMOTE ] HYAC: Full fetch complete (866 records). [2025-09-26T19:23:24.270912] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-26T19:23:24.271457] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:23:24.271545] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:23:24.271590] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:23:24.271639] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-26T19:23:24.271772] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-26T19:23:24.271830] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-26T19:23:24.271921] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-26T19:23:24.272028] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HYAC took 7.3s. Estimated remaining: 2h 53m 43s. Rate: 7.5 symbols/min [2025-09-26T19:23:24.464630] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:24.464843] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-26T19:23:24.464898] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-26T19:23:24.465298] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-26T19:23:24.465351] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-26T19:23:24.465397] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-26T19:23:24.465430] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-26T19:23:24.716144] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-26T19:23:24.892388] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:24.925541] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T19:23:25.511794] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-26T19:23:25.630877] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-26T19:23:26.311755] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-26T19:23:26.650950] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-26T19:23:27.111720] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-26T19:23:27.576810] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-26T19:23:27.911738] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-26T19:23:28.711697] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-26T19:23:28.852871] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-26T19:23:29.466722] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-26T19:23:29.511726] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-26T19:23:30.030250] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-26T19:23:30.031308] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-26T19:23:30.311730] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-26T19:23:30.658625] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-26T19:23:31.111741] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-26T19:23:31.876858] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:23:31.911722] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-26T19:23:32.711686] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-26T19:23:32.756367] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-26T19:23:32.759531] [INFO ] [REMOTE ] HY: Full fetch complete (15210 records). [2025-09-26T19:23:32.759611] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-26T19:23:33.046727] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-26T19:23:33.172045] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-26T19:23:33.172148] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-26T19:23:33.172498] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-26T19:23:33.172552] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-26T19:23:33.173148] [DEBUG] [LOCAL ] HY: Trimmed 15210 records to 10192 (keeping 200 days of data) [2025-09-26T19:23:33.239216] [DEBUG] [LOCAL ] HY: Primary data saved (10192 records). [2025-09-26T19:23:33.239384] [INFO ] [MAIN ] HY: Full history saved. [2025-09-26T19:23:33.239535] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HY took 18.2s. Estimated remaining: 2h 53m 36s. Rate: 7.5 symbols/min [2025-09-26T19:23:33.430475] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:33.442541] [DEBUG] [LOCAL ] HYI: Loaded 9110 existing records from primary storage. [2025-09-26T19:23:33.442715] [INFO ] [MAIN ] HYI: Loaded 9110 existing records. [2025-09-26T19:23:33.516909] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-26T19:23:33.677162] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:33.677541] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-26T19:23:33.677606] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-26T19:23:33.678263] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-26T19:23:33.678326] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-26T19:23:33.839850] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-26T19:23:34.076071] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:34.311729] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-26T19:23:35.111745] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-26T19:23:35.911701] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-26T19:23:36.012215] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:23:36.043192] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T19:23:36.249096] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-26T19:23:36.711728] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-26T19:23:37.511735] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-26T19:23:38.311746] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-26T19:23:38.361816] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:23:38.660172] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-26T19:23:38.663420] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:23:39.111748] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-26T19:23:39.911785] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-26T19:23:39.933710] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:23:40.251487] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-26T19:23:40.711735] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-26T19:23:41.511751] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-26T19:23:41.842455] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-26T19:23:42.312589] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:23:42.312735] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-26T19:23:43.111730] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-26T19:23:43.163691] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-26T19:23:43.911737] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-26T19:23:44.711731] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-26T19:23:44.930070] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T19:23:44.964050] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-26T19:23:45.511740] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-26T19:23:46.273091] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T19:23:46.311729] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-26T19:23:46.657551] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-26T19:23:46.751045] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-26T19:23:46.763064] [INFO ] [REMOTE ] HWM: Full fetch complete (76636 records). [2025-09-26T19:23:46.763268] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-26T19:23:47.116846] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-26T19:23:47.217664] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-26T19:23:47.218226] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-26T19:23:47.219346] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-26T19:23:47.219569] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-26T19:23:47.222773] [DEBUG] [LOCAL ] HWM: Trimmed 76636 records to 53767 (keeping 200 days of data) [2025-09-26T19:23:47.591713] [DEBUG] [LOCAL ] HWM: Primary data saved (53767 records). [2025-09-26T19:23:47.592073] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-26T19:23:47.592200] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HWM took 38.9s. Estimated remaining: 2h 53m 35s. Rate: 7.5 symbols/min [2025-09-26T19:23:47.783480] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:47.818209] [DEBUG] [LOCAL ] HYT: Loaded 33532 existing records from primary storage. [2025-09-26T19:23:47.818382] [INFO ] [MAIN ] HYT: Loaded 33532 existing records. [2025-09-26T19:23:47.915300] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-26T19:23:47.945151] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T19:23:48.038083] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:48.038385] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-26T19:23:48.038486] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-26T19:23:48.040272] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-26T19:23:48.040337] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-26T19:23:48.427540] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:48.711747] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-26T19:23:49.511704] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-26T19:23:49.551777] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:23:49.862816] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-26T19:23:49.863662] [INFO ] [REMOTE ] HYBX: Full fetch complete (799 records). [2025-09-26T19:23:49.863741] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-26T19:23:50.097017] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-26T19:23:50.097331] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:23:50.107601] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:23:50.113519] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-26T19:23:50.115076] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:23:50.114260] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-26T19:23:50.115195] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-26T19:23:50.121745] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-26T19:23:50.121848] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYBX took 25.8s. Estimated remaining: 2h 53m 21s. Rate: 7.5 symbols/min [2025-09-26T19:23:50.308993] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:50.311690] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-26T19:23:50.315105] [DEBUG] [LOCAL ] HYTR: Loaded 3189 existing records from primary storage. [2025-09-26T19:23:50.315298] [INFO ] [MAIN ] HYTR: Loaded 3189 existing records. [2025-09-26T19:23:50.520018] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:50.520327] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-26T19:23:50.520392] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-26T19:23:50.520860] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-26T19:23:50.520925] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-26T19:23:50.905298] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:51.111741] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-26T19:23:51.244420] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T19:23:51.568964] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-26T19:23:51.911770] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-26T19:23:52.711762] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-26T19:23:53.511731] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-26T19:23:53.731310] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:23:53.741039] [INFO ] [REMOTE ] HXL: Full fetch complete (66197 records). [2025-09-26T19:23:53.741299] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-26T19:23:54.110991] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T19:23:54.221692] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-26T19:23:54.224586] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-26T19:23:54.225716] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-26T19:23:54.225860] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-26T19:23:54.224467] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T19:23:54.235454] [DEBUG] [LOCAL ] HXL: Trimmed 66197 records to 46661 (keeping 200 days of data) [2025-09-26T19:23:54.327769] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-26T19:23:54.543238] [DEBUG] [LOCAL ] HXL: Primary data saved (46661 records). [2025-09-26T19:23:54.543400] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-26T19:23:54.543495] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HXL took 40.1s. Estimated remaining: 2h 53m 8s. Rate: 7.5 symbols/min [2025-09-26T19:23:54.734419] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:23:54.763681] [DEBUG] [LOCAL ] HZO: Loaded 29552 existing records from primary storage. [2025-09-26T19:23:54.763834] [INFO ] [MAIN ] HZO: Loaded 29552 existing records. [2025-09-26T19:23:54.960110] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:23:54.960381] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-26T19:23:54.960449] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-26T19:23:54.961869] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-26T19:23:54.961961] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-26T19:23:55.117006] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-26T19:23:55.379335] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:23:55.717106] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-26T19:23:55.717423] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-26T19:23:55.911769] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-26T19:23:56.469568] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-26T19:23:56.711751] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-26T19:23:57.511750] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-26T19:23:58.079257] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-26T19:23:58.147041] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:23:58.311732] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-26T19:23:59.111729] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-26T19:23:59.862907] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-26T19:23:59.867406] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:23:59.870202] [INFO ] [REMOTE ] HYI: Full fetch complete (13073 records). [2025-09-26T19:23:59.884518] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-26T19:23:59.917189] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-26T19:24:00.290007] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-26T19:24:00.290140] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-26T19:24:00.290746] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-26T19:24:00.290834] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-26T19:24:00.291851] [DEBUG] [LOCAL ] HYI: Trimmed 13073 records to 9254 (keeping 200 days of data) [2025-09-26T19:24:00.352176] [DEBUG] [LOCAL ] HYI: Primary data saved (9254 records). [2025-09-26T19:24:00.352362] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-26T19:24:00.352495] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYI took 27.1s. Estimated remaining: 2h 52m 58s. Rate: 7.5 symbols/min [2025-09-26T19:24:00.711723] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-26T19:24:01.481214] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:24:01.511713] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-26T19:24:01.821116] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-26T19:24:02.083952] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T19:24:02.311762] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-26T19:24:02.892799] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-26T19:24:03.111735] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-26T19:24:03.911726] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-26T19:24:04.388118] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-26T19:24:04.453138] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-26T19:24:04.711772] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-26T19:24:05.266771] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-26T19:24:05.511749] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-26T19:24:06.311703] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-26T19:24:06.593203] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-26T19:24:06.779168] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T19:24:07.111729] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-26T19:24:07.911719] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-26T19:24:08.566629] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T19:24:08.711727] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-26T19:24:09.260169] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-26T19:24:09.283845] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-26T19:24:09.285041] [INFO ] [REMOTE ] HYTR: Full fetch complete (4472 records). [2025-09-26T19:24:09.285113] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-26T19:24:09.516963] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-26T19:24:09.674275] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-26T19:24:09.674369] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-26T19:24:09.674540] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-26T19:24:09.674582] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-26T19:24:09.675026] [DEBUG] [LOCAL ] HYTR: Trimmed 4472 records to 3208 (keeping 200 days of data) [2025-09-26T19:24:09.696218] [DEBUG] [LOCAL ] HYTR: Primary data saved (3208 records). [2025-09-26T19:24:09.696388] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-26T19:24:09.696500] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. HYTR took 19.6s. Estimated remaining: 2h 52m 51s. Rate: 7.5 symbols/min [2025-09-26T19:24:10.311751] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-26T19:24:11.102060] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:24:11.111683] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-26T19:24:11.731962] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T19:24:11.912192] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-26T19:24:11.915388] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T19:24:12.711763] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-26T19:24:13.530098] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:24:13.538704] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-26T19:24:13.948554] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T19:24:14.311792] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-26T19:24:15.035430] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:24:15.042305] [INFO ] [REMOTE ] HYT: Full fetch complete (47109 records). [2025-09-26T19:24:15.042491] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-26T19:24:15.472928] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-26T19:24:15.473062] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-26T19:24:15.474201] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-26T19:24:15.474275] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-26T19:24:15.476111] [DEBUG] [LOCAL ] HYT: Trimmed 47109 records to 33853 (keeping 200 days of data) [2025-09-26T19:24:15.723621] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T19:24:15.723847] [DEBUG] [LOCAL ] HYT: Primary data saved (33853 records). [2025-09-26T19:24:15.734432] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-26T19:24:15.735214] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HYT took 28.1s. Estimated remaining: 2h 52m 41s. Rate: 7.5 symbols/min [2025-09-26T19:24:15.735760] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-26T19:24:17.008992] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-26T19:24:17.015936] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-26T19:24:18.588610] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T19:24:18.594845] [INFO ] [REMOTE ] HZO: Full fetch complete (40819 records). [2025-09-26T19:24:18.594980] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-26T19:24:19.017562] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-26T19:24:19.017675] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-26T19:24:19.018407] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-26T19:24:19.018451] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-26T19:24:19.019421] [DEBUG] [LOCAL ] HZO: Trimmed 40819 records to 29733 (keeping 200 days of data) [2025-09-26T19:24:19.206046] [DEBUG] [LOCAL ] HZO: Primary data saved (29733 records). [2025-09-26T19:24:19.206192] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-26T19:24:19.206325] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. HZO took 24.7s. Estimated remaining: 2h 52m 27s. Rate: 7.5 symbols/min [2025-09-26T19:24:19.986569] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:20.036416] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:20.077246] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:20.050766] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:20.089271] [DEBUG] [LOCAL ] IAE: Loaded 6040 existing records from primary storage. [2025-09-26T19:24:20.089624] [INFO ] [MAIN ] IAE: Loaded 6040 existing records. [2025-09-26T19:24:20.365261] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:20.398244] [DEBUG] [LOCAL ] IBM: Loaded 54026 existing records from primary storage. [2025-09-26T19:24:20.397476] [DEBUG] [LOCAL ] IBN: Loaded 53266 existing records from primary storage. [2025-09-26T19:24:20.398705] [INFO ] [MAIN ] IBM: Loaded 54026 existing records. [2025-09-26T19:24:20.398827] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-26T19:24:20.398939] [INFO ] [MAIN ] IBN: Loaded 53266 existing records. [2025-09-26T19:24:20.404185] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-26T19:24:20.464391] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-26T19:24:20.520958] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-26T19:24:20.643010] [DEBUG] [LOCAL ] IAG: Loaded 53835 existing records from primary storage. [2025-09-26T19:24:20.653579] [INFO ] [MAIN ] IAG: Loaded 53835 existing records. [2025-09-26T19:24:20.936864] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:21.032285] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-26T19:24:21.137242] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-26T19:24:21.131968] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:21.186142] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-26T19:24:21.253676] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-26T19:24:21.289869] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-26T19:24:21.325031] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-26T19:24:21.366437] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-26T19:24:21.361094] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:21.366596] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-26T19:24:21.499395] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-26T19:24:21.620125] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-26T19:24:21.631601] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:21.670562] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-26T19:24:21.686883] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-26T19:24:21.698406] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-26T19:24:22.557504] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:22.612089] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:22.633600] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-26T19:24:22.649679] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-26T19:24:22.641129] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:24:22.681492] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-26T19:24:22.774853] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:22.775180] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-26T19:24:23.354023] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-26T19:24:23.355804] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-26T19:24:24.146878] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T19:24:24.149070] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-26T19:24:24.515928] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T19:24:24.528534] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-26T19:24:24.609765] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:24:24.621972] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-26T19:24:24.953463] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-26T19:24:24.953737] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T19:24:24.967374] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-26T19:24:24.968528] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-26T19:24:25.564923] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:24:25.566588] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-26T19:24:26.385299] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:24:26.405815] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-26T19:24:26.407983] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-26T19:24:26.441008] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T19:24:27.111726] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-26T19:24:27.379745] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-26T19:24:27.847587] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-26T19:24:27.911742] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-26T19:24:28.177020] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:24:28.711742] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-26T19:24:29.511689] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-26T19:24:29.569739] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-26T19:24:29.986162] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T19:24:30.311717] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-26T19:24:30.736810] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-26T19:24:31.111723] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-26T19:24:31.740625] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-26T19:24:31.911759] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-26T19:24:32.120191] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-26T19:24:32.711761] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-26T19:24:33.511747] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-26T19:24:34.108496] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-26T19:24:34.311753] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-26T19:24:34.409047] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T19:24:34.412629] [INFO ] [REMOTE ] IAE: Full fetch complete (8681 records). [2025-09-26T19:24:34.412786] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-26T19:24:34.849249] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-26T19:24:34.863000] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-26T19:24:34.880472] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-26T19:24:34.883822] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-26T19:24:34.886935] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-26T19:24:34.887119] [DEBUG] [LOCAL ] IAE: Trimmed 8681 records to 6104 (keeping 200 days of data) [2025-09-26T19:24:34.943865] [DEBUG] [LOCAL ] IAE: Primary data saved (6104 records). [2025-09-26T19:24:34.944026] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-26T19:24:34.944253] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IAE took 15.7s. Estimated remaining: 2h 52m 28s. Rate: 7.5 symbols/min [2025-09-26T19:24:35.112720] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-26T19:24:35.134476] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:35.171425] [DEBUG] [LOCAL ] IBP: Loaded 29439 existing records from primary storage. [2025-09-26T19:24:35.171577] [INFO ] [MAIN ] IBP: Loaded 29439 existing records. [2025-09-26T19:24:35.359221] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:35.359548] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-26T19:24:35.359597] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-26T19:24:35.361046] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-26T19:24:35.361119] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-26T19:24:35.746621] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:35.911714] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-26T19:24:36.173683] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T19:24:36.711751] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-26T19:24:36.932555] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T19:24:37.446268] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-26T19:24:37.511743] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-26T19:24:38.311723] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-26T19:24:38.704773] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-26T19:24:39.111759] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-26T19:24:39.753908] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-26T19:24:39.901522] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T19:24:39.911664] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-26T19:24:40.103398] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T19:24:40.711728] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-26T19:24:41.216784] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-26T19:24:41.511760] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-26T19:24:42.311743] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-26T19:24:42.847831] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-26T19:24:42.926963] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-26T19:24:43.111739] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-26T19:24:43.911763] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-26T19:24:44.157988] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:24:44.534322] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T19:24:44.711763] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-26T19:24:45.511772] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-26T19:24:45.792325] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T19:24:46.311728] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-26T19:24:46.540910] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T19:24:47.111735] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-26T19:24:47.195556] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-26T19:24:47.809286] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:24:47.911723] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-26T19:24:48.449101] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T19:24:48.711712] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-26T19:24:49.511737] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-26T19:24:49.874297] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-26T19:24:50.311728] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-26T19:24:50.907137] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T19:24:50.981440] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T19:24:51.111736] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-26T19:24:51.165106] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-26T19:24:51.911733] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-26T19:24:52.711728] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-26T19:24:53.115189] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-26T19:24:53.201157] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T19:24:53.511724] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-26T19:24:54.311694] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-26T19:24:54.731862] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:24:54.743498] [INFO ] [REMOTE ] IBN: Full fetch complete (76263 records). [2025-09-26T19:24:54.743758] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-26T19:24:55.116597] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-26T19:24:55.120613] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T19:24:55.229241] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-26T19:24:55.229344] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-26T19:24:55.230415] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-26T19:24:55.230482] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-26T19:24:55.232627] [DEBUG] [LOCAL ] IBN: Trimmed 76263 records to 53654 (keeping 200 days of data) [2025-09-26T19:24:55.580563] [DEBUG] [LOCAL ] IBN: Primary data saved (53654 records). [2025-09-26T19:24:55.580738] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-26T19:24:55.582952] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBN took 36.4s. Estimated remaining: 2h 52m 35s. Rate: 7.5 symbols/min [2025-09-26T19:24:55.759438] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:55.822687] [DEBUG] [LOCAL ] IBTA: Loaded 38211 existing records from primary storage. [2025-09-26T19:24:55.822853] [INFO ] [MAIN ] IBTA: Loaded 38211 existing records. [2025-09-26T19:24:55.921015] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-26T19:24:56.017564] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:56.017854] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-26T19:24:56.017917] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-26T19:24:56.018893] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-26T19:24:56.018954] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-26T19:24:56.388884] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:24:56.711726] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-26T19:24:56.964290] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-26T19:24:56.977191] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-09-26T19:24:56.977364] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-26T19:24:57.087806] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T19:24:57.160190] [INFO ] [REMOTE ] IBP: Full fetch complete (41131 records). [2025-09-26T19:24:57.195897] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-26T19:24:57.620516] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-26T19:24:57.643736] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-26T19:24:57.658428] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-26T19:24:57.748114] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-26T19:24:57.850203] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-26T19:24:57.893098] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 54416 (keeping 200 days of data) [2025-09-26T19:24:57.906250] [INFO ] [REMOTE ] IAG: Full fetch complete (77226 records). [2025-09-26T19:24:57.906749] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-26T19:24:57.922235] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-26T19:24:57.934508] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-26T19:24:58.000413] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-26T19:24:58.062193] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-26T19:24:58.121405] [DEBUG] [LOCAL ] IBP: Trimmed 41131 records to 29584 (keeping 200 days of data) [2025-09-26T19:24:58.145873] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:24:58.172917] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-26T19:24:58.722225] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-26T19:24:58.726077] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-26T19:24:58.728703] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-26T19:24:58.736993] [DEBUG] [LOCAL ] IBP: Primary data saved (29584 records). [2025-09-26T19:24:58.732544] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-26T19:24:58.737127] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-26T19:24:58.738101] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBP took 23.8s. Estimated remaining: 2h 52m 22s. Rate: 7.5 symbols/min [2025-09-26T19:24:58.827147] [DEBUG] [LOCAL ] IAG: Trimmed 77226 records to 54225 (keeping 200 days of data) [2025-09-26T19:24:59.164941] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:24:59.337869] [DEBUG] [LOCAL ] ICE: Loaded 53415 existing records from primary storage. [2025-09-26T19:24:59.339281] [INFO ] [MAIN ] ICE: Loaded 53415 existing records. [2025-09-26T19:24:59.585058] [DEBUG] [LOCAL ] IBM: Primary data saved (54416 records). [2025-09-26T19:24:59.597388] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-26T19:24:59.631148] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBM took 40.4s. Estimated remaining: 2h 52m 5s. Rate: 7.5 symbols/min [2025-09-26T19:24:59.732477] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:24:59.793324] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-26T19:24:59.803679] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-26T19:24:59.811070] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T19:24:59.822494] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-26T19:24:59.833904] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-26T19:24:59.839446] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-26T19:25:00.038826] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:00.386731] [DEBUG] [LOCAL ] ICL: Loaded 38902 existing records from primary storage. [2025-09-26T19:25:00.411325] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:00.412631] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-26T19:25:00.412801] [INFO ] [MAIN ] ICL: Loaded 38902 existing records. [2025-09-26T19:25:00.506054] [DEBUG] [LOCAL ] IAG: Primary data saved (54225 records). [2025-09-26T19:25:00.518943] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-26T19:25:00.533052] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. IAG took 41.3s. Estimated remaining: 2h 51m 49s. Rate: 7.5 symbols/min [2025-09-26T19:25:00.849345] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:00.845033] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:00.850030] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-26T19:25:00.850092] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-26T19:25:00.851111] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-26T19:25:00.851174] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-26T19:25:01.184168] [DEBUG] [LOCAL ] IDA: Loaded 32201 existing records from primary storage. [2025-09-26T19:25:01.190185] [INFO ] [MAIN ] IDA: Loaded 32201 existing records. [2025-09-26T19:25:01.364517] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:01.365801] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:25:01.371639] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-26T19:25:01.410435] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-26T19:25:01.509558] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:01.509841] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-26T19:25:01.509895] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-26T19:25:01.510990] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-26T19:25:01.511052] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-26T19:25:01.892099] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:01.892462] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-26T19:25:02.582954] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T19:25:02.594525] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-26T19:25:03.012349] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T19:25:03.111706] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-26T19:25:03.180132] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:25:03.206276] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T19:25:03.911717] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-26T19:25:04.349736] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:25:04.528060] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T19:25:04.711732] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-26T19:25:05.511728] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-26T19:25:05.680131] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-26T19:25:06.121252] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:25:06.311758] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-26T19:25:07.111704] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-26T19:25:07.289445] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T19:25:07.701574] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-26T19:25:07.911733] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-26T19:25:08.663404] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T19:25:08.711770] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-26T19:25:09.511702] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-26T19:25:09.829600] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T19:25:10.250246] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T19:25:10.311741] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-26T19:25:10.870969] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T19:25:11.111761] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-26T19:25:11.911762] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-26T19:25:12.341078] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T19:25:12.370692] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-26T19:25:12.711747] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-26T19:25:13.205955] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T19:25:13.511730] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-26T19:25:14.311708] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-26T19:25:14.584356] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T19:25:14.639982] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-26T19:25:15.111759] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-26T19:25:15.806846] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T19:25:15.911729] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-26T19:25:16.272389] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T19:25:16.711729] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-26T19:25:17.511766] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-26T19:25:17.928161] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-26T19:25:18.311723] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-26T19:25:18.443705] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T19:25:18.981063] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-26T19:25:19.111771] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-26T19:25:19.911698] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-26T19:25:20.294880] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-26T19:25:20.370055] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-26T19:25:20.711782] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-26T19:25:21.152364] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T19:25:21.511752] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-26T19:25:22.311786] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-26T19:25:22.379349] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:25:22.387280] [INFO ] [REMOTE ] ICL: Full fetch complete (56067 records). [2025-09-26T19:25:22.387459] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-26T19:25:22.817255] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-26T19:25:22.817481] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-26T19:25:22.818380] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-26T19:25:22.818538] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-26T19:25:22.820079] [DEBUG] [LOCAL ] ICL: Trimmed 56067 records to 39135 (keeping 200 days of data) [2025-09-26T19:25:22.952177] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T19:25:23.085661] [DEBUG] [LOCAL ] ICL: Primary data saved (39135 records). [2025-09-26T19:25:23.085825] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-26T19:25:23.085918] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. ICL took 23.4s. Estimated remaining: 2h 51m 58s. Rate: 7.5 symbols/min [2025-09-26T19:25:23.118613] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-26T19:25:23.268350] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:23.278780] [DEBUG] [LOCAL ] IDE: Loaded 8650 existing records from primary storage. [2025-09-26T19:25:23.278929] [INFO ] [MAIN ] IDE: Loaded 8650 existing records. [2025-09-26T19:25:23.463865] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:23.464200] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-26T19:25:23.464257] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-26T19:25:23.464638] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-26T19:25:23.464747] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-26T19:25:23.917363] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-26T19:25:23.922753] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:23.956062] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T19:25:23.964720] [INFO ] [REMOTE ] IBTA: Full fetch complete (50652 records). [2025-09-26T19:25:23.964898] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-26T19:25:24.402542] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-26T19:25:24.402636] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-26T19:25:24.403517] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-26T19:25:24.403585] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-26T19:25:24.404946] [DEBUG] [LOCAL ] IBTA: Trimmed 50652 records to 38445 (keeping 200 days of data) [2025-09-26T19:25:24.647010] [DEBUG] [LOCAL ] IBTA: Primary data saved (38445 records). [2025-09-26T19:25:24.647239] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-26T19:25:24.647347] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. IBTA took 29.1s. Estimated remaining: 2h 51m 42s. Rate: 7.5 symbols/min [2025-09-26T19:25:24.720349] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-26T19:25:24.847536] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:24.870902] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T19:25:24.892430] [DEBUG] [LOCAL ] IDT: Loaded 17791 existing records from primary storage. [2025-09-26T19:25:24.892573] [INFO ] [MAIN ] IDT: Loaded 17791 existing records. [2025-09-26T19:25:25.080732] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:25.081004] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-26T19:25:25.081052] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-26T19:25:25.082048] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-26T19:25:25.082109] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-26T19:25:25.487827] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T19:25:25.486514] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:25.511716] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-26T19:25:25.734588] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T19:25:26.311741] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-26T19:25:26.878462] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-26T19:25:27.111724] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-26T19:25:27.211379] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-26T19:25:27.911729] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-26T19:25:28.483165] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T19:25:28.697132] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-26T19:25:28.711713] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-26T19:25:29.475415] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-26T19:25:29.511760] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-26T19:25:30.311745] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-26T19:25:30.794795] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T19:25:31.111719] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-26T19:25:31.400864] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-26T19:25:31.911741] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-26T19:25:32.676502] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T19:25:32.711696] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-26T19:25:33.088327] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:25:33.099113] [INFO ] [REMOTE ] ICE: Full fetch complete (76767 records). [2025-09-26T19:25:33.099279] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-26T19:25:33.521007] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-26T19:25:33.517097] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-26T19:25:33.521169] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-26T19:25:33.523096] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-26T19:25:33.523261] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-26T19:25:33.524935] [DEBUG] [LOCAL ] ICE: Trimmed 76767 records to 53800 (keeping 200 days of data) [2025-09-26T19:25:33.891477] [DEBUG] [LOCAL ] ICE: Primary data saved (53800 records). [2025-09-26T19:25:33.891718] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-26T19:25:33.891859] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. ICE took 35.2s. Estimated remaining: 2h 51m 36s. Rate: 7.5 symbols/min [2025-09-26T19:25:34.087298] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:34.132002] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T19:25:34.138376] [INFO ] [REMOTE ] IDA: Full fetch complete (44684 records). [2025-09-26T19:25:34.138588] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-26T19:25:34.199194] [DEBUG] [LOCAL ] IEX: Loaded 38697 existing records from primary storage. [2025-09-26T19:25:34.222606] [INFO ] [MAIN ] IEX: Loaded 38697 existing records. [2025-09-26T19:25:34.314838] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-26T19:25:34.659070] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:34.678009] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-26T19:25:34.690790] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-26T19:25:34.696818] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-26T19:25:34.712018] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-26T19:25:34.719736] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T19:25:34.897158] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-26T19:25:34.902672] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-26T19:25:34.923199] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-26T19:25:34.950036] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-26T19:25:34.951349] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-26T19:25:34.997682] [DEBUG] [LOCAL ] IDA: Trimmed 44684 records to 32398 (keeping 200 days of data) [2025-09-26T19:25:35.151276] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-26T19:25:35.324799] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:35.445161] [DEBUG] [LOCAL ] IDA: Primary data saved (32398 records). [2025-09-26T19:25:35.445367] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-26T19:25:35.445472] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDA took 34.9s. Estimated remaining: 2h 51m 20s. Rate: 7.5 symbols/min [2025-09-26T19:25:35.636785] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:35.695409] [DEBUG] [LOCAL ] IFF: Loaded 51351 existing records from primary storage. [2025-09-26T19:25:35.695593] [INFO ] [MAIN ] IFF: Loaded 51351 existing records. [2025-09-26T19:25:35.881936] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:35.882304] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-26T19:25:35.882361] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-26T19:25:35.883914] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-26T19:25:35.883977] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-26T19:25:35.916802] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-26T19:25:36.221370] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T19:25:36.284589] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:36.683366] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-26T19:25:36.711689] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-26T19:25:37.511743] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-26T19:25:38.157199] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T19:25:38.163974] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-26T19:25:38.311781] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-26T19:25:38.845251] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-26T19:25:39.111769] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-26T19:25:39.909186] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T19:25:39.911941] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-26T19:25:40.697133] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:25:40.711677] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-26T19:25:41.511730] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-26T19:25:41.534051] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-26T19:25:42.311738] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-26T19:25:43.111705] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-26T19:25:43.199552] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T19:25:43.251186] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T19:25:43.254599] [INFO ] [REMOTE ] IDE: Full fetch complete (12813 records). [2025-09-26T19:25:43.254795] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-26T19:25:43.696544] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-26T19:25:43.696676] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-26T19:25:43.697083] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-26T19:25:43.697152] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-26T19:25:43.698002] [DEBUG] [LOCAL ] IDE: Trimmed 12813 records to 8755 (keeping 200 days of data) [2025-09-26T19:25:43.755970] [DEBUG] [LOCAL ] IDE: Primary data saved (8755 records). [2025-09-26T19:25:43.756161] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-26T19:25:43.756312] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IDE took 20.7s. Estimated remaining: 2h 51m 12s. Rate: 7.5 symbols/min [2025-09-26T19:25:43.917635] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-26T19:25:43.956622] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:43.978222] [DEBUG] [LOCAL ] IFN: Loaded 18336 existing records from primary storage. [2025-09-26T19:25:43.978387] [INFO ] [MAIN ] IFN: Loaded 18336 existing records. [2025-09-26T19:25:44.173340] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:44.173727] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-26T19:25:44.173800] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-26T19:25:44.174472] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-26T19:25:44.174544] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-26T19:25:44.579510] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:44.601278] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:25:44.711691] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-26T19:25:45.027733] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:25:45.508931] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-26T19:25:45.513974] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-26T19:25:46.311713] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-26T19:25:46.629938] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T19:25:47.111721] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-26T19:25:47.740741] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:25:47.911734] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-26T19:25:48.360243] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T19:25:48.711743] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-26T19:25:49.510064] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:25:49.517425] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-26T19:25:49.648207] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T19:25:50.311731] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-26T19:25:51.111728] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-26T19:25:51.208952] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:25:51.911711] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-26T19:25:51.960116] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:25:52.252017] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T19:25:52.711692] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-26T19:25:53.072771] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-26T19:25:53.076905] [INFO ] [REMOTE ] IDT: Full fetch complete (22484 records). [2025-09-26T19:25:53.077032] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-26T19:25:53.494044] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-26T19:25:53.494141] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-26T19:25:53.494712] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-26T19:25:53.494810] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-26T19:25:53.495784] [DEBUG] [LOCAL ] IDT: Trimmed 22484 records to 17885 (keeping 200 days of data) [2025-09-26T19:25:53.544376] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-26T19:25:53.616020] [DEBUG] [LOCAL ] IDT: Primary data saved (17885 records). [2025-09-26T19:25:53.616200] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-26T19:25:53.616333] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IDT took 29.0s. Estimated remaining: 2h 51m 6s. Rate: 7.5 symbols/min [2025-09-26T19:25:53.819224] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:25:53.844858] [DEBUG] [LOCAL ] IFS: Loaded 23244 existing records from primary storage. [2025-09-26T19:25:53.845019] [INFO ] [MAIN ] IFS: Loaded 23244 existing records. [2025-09-26T19:25:54.096583] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:25:54.097227] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-26T19:25:54.097323] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-26T19:25:54.098566] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-26T19:25:54.098699] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-26T19:25:54.324917] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-26T19:25:54.413813] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:25:54.547448] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:25:54.681193] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:25:55.111726] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-26T19:25:55.911711] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-26T19:25:56.019744] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:25:56.058719] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:25:56.711742] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-26T19:25:57.351490] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:25:57.511743] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-26T19:25:58.165840] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-26T19:25:58.311745] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-26T19:25:58.568114] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T19:25:59.111752] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-26T19:25:59.517328] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T19:25:59.911733] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-26T19:26:00.711742] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-26T19:26:01.056585] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T19:26:01.369455] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-26T19:26:01.511738] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-26T19:26:01.905773] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-26T19:26:02.311717] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-26T19:26:02.791701] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T19:26:03.111720] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-26T19:26:03.911722] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-26T19:26:03.980168] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:26:04.172772] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T19:26:04.711687] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-26T19:26:05.176338] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T19:26:05.511723] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-26T19:26:06.311726] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-26T19:26:06.377269] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-26T19:26:06.770209] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-26T19:26:06.778261] [INFO ] [REMOTE ] IEX: Full fetch complete (53425 records). [2025-09-26T19:26:06.778450] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-26T19:26:07.126918] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-26T19:26:07.186289] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-26T19:26:07.186383] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-26T19:26:07.187285] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-26T19:26:07.187370] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-26T19:26:07.188589] [DEBUG] [LOCAL ] IEX: Trimmed 53425 records to 38978 (keeping 200 days of data) [2025-09-26T19:26:07.446805] [DEBUG] [LOCAL ] IEX: Primary data saved (38978 records). [2025-09-26T19:26:07.446991] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-26T19:26:07.448239] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IEX took 33.6s. Estimated remaining: 2h 51m 5s. Rate: 7.5 symbols/min [2025-09-26T19:26:07.583511] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T19:26:07.652694] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:07.668281] [DEBUG] [LOCAL ] IGA: Loaded 9727 existing records from primary storage. [2025-09-26T19:26:07.668424] [INFO ] [MAIN ] IGA: Loaded 9727 existing records. [2025-09-26T19:26:07.863029] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:07.863298] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-26T19:26:07.863348] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-26T19:26:07.863836] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-26T19:26:07.863896] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-26T19:26:07.923305] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-26T19:26:08.248845] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:08.711697] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-26T19:26:09.041881] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T19:26:09.082084] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T19:26:09.511735] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-26T19:26:09.795898] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T19:26:10.311745] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-26T19:26:10.615986] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T19:26:11.111762] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-26T19:26:11.538482] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T19:26:11.911720] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-26T19:26:11.942728] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-26T19:26:12.711743] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-26T19:26:13.511785] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-26T19:26:13.736443] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T19:26:13.875390] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-26T19:26:14.311744] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-26T19:26:14.483727] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:26:15.111739] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-26T19:26:15.401012] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-26T19:26:15.911731] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-26T19:26:16.171609] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T19:26:16.711701] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-26T19:26:17.082089] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T19:26:17.086164] [INFO ] [REMOTE ] IFN: Full fetch complete (29023 records). [2025-09-26T19:26:17.086302] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-26T19:26:17.500095] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-26T19:26:17.500239] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-26T19:26:17.500934] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-26T19:26:17.501019] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-26T19:26:17.502512] [DEBUG] [LOCAL ] IFN: Trimmed 29023 records to 18475 (keeping 200 days of data) [2025-09-26T19:26:17.551854] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-26T19:26:17.625114] [DEBUG] [LOCAL ] IFN: Primary data saved (18475 records). [2025-09-26T19:26:17.625280] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-26T19:26:17.625379] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFN took 33.9s. Estimated remaining: 2h 50m 60s. Rate: 7.5 symbols/min [2025-09-26T19:26:17.813504] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:17.833855] [DEBUG] [LOCAL ] IGD: Loaded 19050 existing records from primary storage. [2025-09-26T19:26:17.834013] [INFO ] [MAIN ] IGD: Loaded 19050 existing records. [2025-09-26T19:26:18.036504] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:18.036824] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-26T19:26:18.036876] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-26T19:26:18.037814] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-26T19:26:18.037884] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-26T19:26:18.316467] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-26T19:26:18.489910] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:18.592470] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:26:18.603119] [INFO ] [REMOTE ] IFF: Full fetch complete (72914 records). [2025-09-26T19:26:18.603309] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-26T19:26:19.014727] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T19:26:19.044395] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-26T19:26:19.045108] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-26T19:26:19.046134] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-26T19:26:19.044991] [INFO ] [REMOTE ] IFS: Full fetch complete (31470 records). [2025-09-26T19:26:19.046296] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-26T19:26:19.046423] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-26T19:26:19.116822] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-26T19:26:19.128222] [DEBUG] [LOCAL ] IFF: Trimmed 72914 records to 51727 (keeping 200 days of data) [2025-09-26T19:26:19.156786] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-26T19:26:19.724310] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-26T19:26:19.725348] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-26T19:26:19.726161] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-26T19:26:19.726519] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-26T19:26:19.743495] [DEBUG] [LOCAL ] IFS: Trimmed 31470 records to 23359 (keeping 200 days of data) [2025-09-26T19:26:19.914295] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-26T19:26:19.914183] [DEBUG] [LOCAL ] IFF: Primary data saved (51727 records). [2025-09-26T19:26:19.918310] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-26T19:26:19.920116] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFF took 44.5s. Estimated remaining: 2h 50m 45s. Rate: 7.5 symbols/min [2025-09-26T19:26:20.144076] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:20.158511] [DEBUG] [LOCAL ] IFS: Primary data saved (23359 records). [2025-09-26T19:26:20.158786] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-26T19:26:20.158956] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IFS took 26.5s. Estimated remaining: 2h 50m 28s. Rate: 7.5 symbols/min [2025-09-26T19:26:20.202086] [DEBUG] [LOCAL ] IGI: Loaded 3710 existing records from primary storage. [2025-09-26T19:26:20.215102] [INFO ] [MAIN ] IGI: Loaded 3710 existing records. [2025-09-26T19:26:20.391158] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-26T19:26:20.544740] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T19:26:20.579560] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:20.605309] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:20.607296] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-26T19:26:20.607479] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-26T19:26:20.607806] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-26T19:26:20.607883] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-26T19:26:20.714406] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-26T19:26:20.906618] [DEBUG] [LOCAL ] IGR: Loaded 30674 existing records from primary storage. [2025-09-26T19:26:20.924033] [INFO ] [MAIN ] IGR: Loaded 30674 existing records. [2025-09-26T19:26:21.168316] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:21.252841] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:21.253111] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-26T19:26:21.253164] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-26T19:26:21.254118] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-26T19:26:21.254183] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-26T19:26:21.516798] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-26T19:26:21.631366] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:21.741915] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T19:26:22.311755] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-26T19:26:22.506857] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T19:26:22.805790] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-26T19:26:23.111711] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-26T19:26:23.911692] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-26T19:26:24.150507] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:26:24.641275] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-26T19:26:24.711738] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-26T19:26:25.477546] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T19:26:25.511694] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-26T19:26:26.311693] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-26T19:26:26.446242] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-26T19:26:27.111746] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-26T19:26:27.377768] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-26T19:26:27.911718] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-26T19:26:28.527113] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:26:28.716092] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-26T19:26:28.719258] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-26T19:26:29.511748] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-26T19:26:29.856005] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T19:26:30.311746] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-26T19:26:30.887530] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-26T19:26:31.111699] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-26T19:26:31.384003] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T19:26:31.911737] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-26T19:26:32.086492] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T19:26:32.089119] [INFO ] [REMOTE ] IGA: Full fetch complete (13620 records). [2025-09-26T19:26:32.089228] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-26T19:26:32.475576] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-26T19:26:32.475767] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-26T19:26:32.475833] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-26T19:26:32.477578] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-26T19:26:32.477630] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-26T19:26:32.478170] [DEBUG] [LOCAL ] IGA: Trimmed 13620 records to 9779 (keeping 200 days of data) [2025-09-26T19:26:32.541723] [DEBUG] [LOCAL ] IGA: Primary data saved (9779 records). [2025-09-26T19:26:32.541907] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-26T19:26:32.542012] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGA took 25.1s. Estimated remaining: 2h 50m 25s. Rate: 7.5 symbols/min [2025-09-26T19:26:32.715173] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-26T19:26:32.738153] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:32.743429] [DEBUG] [LOCAL ] IH: Loaded 3429 existing records from primary storage. [2025-09-26T19:26:32.743540] [INFO ] [MAIN ] IH: Loaded 3429 existing records. [2025-09-26T19:26:32.927962] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:32.928229] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-26T19:26:32.928277] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-26T19:26:32.928596] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-26T19:26:32.928687] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-26T19:26:33.223548] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-26T19:26:33.312087] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:33.511756] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-26T19:26:34.311721] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-26T19:26:34.738086] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-26T19:26:34.905292] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T19:26:35.111734] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-26T19:26:35.552617] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-26T19:26:35.911719] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-26T19:26:36.711734] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-26T19:26:37.198895] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-26T19:26:37.209591] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T19:26:37.511720] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-26T19:26:38.065788] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T19:26:38.311724] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-26T19:26:39.111699] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-26T19:26:39.352253] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-26T19:26:39.911725] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-26T19:26:40.451125] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T19:26:40.452382] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-26T19:26:40.711728] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-26T19:26:41.328132] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-26T19:26:41.511747] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-26T19:26:42.125776] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T19:26:42.311721] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-26T19:26:42.746232] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-26T19:26:43.111728] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-26T19:26:43.697359] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T19:26:43.911722] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-26T19:26:44.711685] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-26T19:26:45.076571] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T19:26:45.511699] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-26T19:26:45.905701] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T19:26:46.214970] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-26T19:26:46.216294] [INFO ] [REMOTE ] IGI: Full fetch complete (5223 records). [2025-09-26T19:26:46.216370] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-26T19:26:46.316888] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-26T19:26:46.607209] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-26T19:26:46.607297] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-26T19:26:46.607452] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-26T19:26:46.607493] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-26T19:26:46.607960] [DEBUG] [LOCAL ] IGI: Trimmed 5223 records to 3756 (keeping 200 days of data) [2025-09-26T19:26:46.631923] [DEBUG] [LOCAL ] IGI: Primary data saved (3756 records). [2025-09-26T19:26:46.632052] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-26T19:26:46.632205] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGI took 26.7s. Estimated remaining: 2h 50m 24s. Rate: 7.5 symbols/min [2025-09-26T19:26:46.816113] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:46.826569] [DEBUG] [LOCAL ] IHD: Loaded 7189 existing records from primary storage. [2025-09-26T19:26:46.826696] [INFO ] [MAIN ] IHD: Loaded 7189 existing records. [2025-09-26T19:26:47.010217] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:47.010493] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-26T19:26:47.010541] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-26T19:26:47.010890] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-26T19:26:47.010988] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-26T19:26:47.116937] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-26T19:26:47.415126] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:47.436288] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T19:26:47.893818] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:26:47.911663] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-26T19:26:48.407950] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T19:26:48.711720] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-26T19:26:49.511737] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-26T19:26:49.844837] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-26T19:26:50.311724] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-26T19:26:50.352448] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T19:26:51.111731] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-26T19:26:51.525760] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-26T19:26:51.529934] [INFO ] [REMOTE ] IGD: Full fetch complete (29433 records). [2025-09-26T19:26:51.530142] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-26T19:26:51.914116] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-26T19:26:51.958505] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-26T19:26:51.958956] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-26T19:26:51.959812] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-26T19:26:51.959973] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-26T19:26:51.961215] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:26:51.965981] [DEBUG] [LOCAL ] IGD: Trimmed 29433 records to 19170 (keeping 200 days of data) [2025-09-26T19:26:52.090464] [DEBUG] [LOCAL ] IGD: Primary data saved (19170 records). [2025-09-26T19:26:52.090625] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-26T19:26:52.090899] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IGD took 34.5s. Estimated remaining: 2h 50m 13s. Rate: 7.5 symbols/min [2025-09-26T19:26:52.275086] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:26:52.309295] [DEBUG] [LOCAL ] IHG: Loaded 24781 existing records from primary storage. [2025-09-26T19:26:52.309543] [INFO ] [MAIN ] IHG: Loaded 24781 existing records. [2025-09-26T19:26:52.507181] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:26:52.507491] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-26T19:26:52.507553] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-26T19:26:52.508455] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-26T19:26:52.508540] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-26T19:26:52.716811] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-26T19:26:52.889375] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:26:53.431876] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-26T19:26:53.511731] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-26T19:26:53.663326] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T19:26:54.311727] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-26T19:26:54.753696] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T19:26:54.761983] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T19:26:55.111735] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-26T19:26:55.911758] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-26T19:26:56.167489] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T19:26:56.368749] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T19:26:56.711728] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-26T19:26:57.396168] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T19:26:57.511737] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-26T19:26:58.311748] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-26T19:26:58.656563] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-26T19:26:59.111764] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-26T19:26:59.748814] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T19:26:59.756912] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T19:26:59.911728] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-26T19:27:00.711693] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-26T19:27:01.116695] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T19:27:01.511716] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-26T19:27:02.088709] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:27:02.095754] [INFO ] [REMOTE ] IGR: Full fetch complete (45785 records). [2025-09-26T19:27:02.095954] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-26T19:27:02.278698] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-26T19:27:02.312989] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-26T19:27:02.534748] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-26T19:27:02.534851] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-26T19:27:02.535783] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-26T19:27:02.535849] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-26T19:27:02.536998] [DEBUG] [LOCAL ] IGR: Trimmed 45785 records to 30882 (keeping 200 days of data) [2025-09-26T19:27:02.737010] [DEBUG] [LOCAL ] IGR: Primary data saved (30882 records). [2025-09-26T19:27:02.737174] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-26T19:27:02.737337] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IGR took 42.6s. Estimated remaining: 2h 50m 8s. Rate: 7.5 symbols/min [2025-09-26T19:27:02.920140] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:02.962177] [DEBUG] [LOCAL ] IHS: Loaded 39219 existing records from primary storage. [2025-09-26T19:27:02.962319] [INFO ] [MAIN ] IHS: Loaded 39219 existing records. [2025-09-26T19:27:03.067335] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T19:27:03.119765] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-26T19:27:03.166469] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:03.166747] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-26T19:27:03.166805] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-26T19:27:03.168802] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-26T19:27:03.168885] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-26T19:27:03.550331] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:03.911223] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T19:27:03.912930] [INFO ] [REMOTE ] IH: Full fetch complete (4969 records). [2025-09-26T19:27:03.913029] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-26T19:27:03.911761] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-26T19:27:04.302200] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-26T19:27:04.302316] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-26T19:27:04.302483] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-26T19:27:04.302524] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-26T19:27:04.302944] [DEBUG] [LOCAL ] IH: Trimmed 4969 records to 3450 (keeping 200 days of data) [2025-09-26T19:27:04.325027] [DEBUG] [LOCAL ] IH: Primary data saved (3450 records). [2025-09-26T19:27:04.325165] [INFO ] [MAIN ] IH: Full history saved. [2025-09-26T19:27:04.325261] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IH took 31.8s. Estimated remaining: 2h 49m 53s. Rate: 7.5 symbols/min [2025-09-26T19:27:04.504765] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:04.516049] [DEBUG] [LOCAL ] IIF: Loaded 5769 existing records from primary storage. [2025-09-26T19:27:04.516194] [INFO ] [MAIN ] IIF: Loaded 5769 existing records. [2025-09-26T19:27:04.714928] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-26T19:27:04.724187] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:04.725566] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-26T19:27:04.725671] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-26T19:27:04.726271] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-26T19:27:04.726341] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-26T19:27:04.859639] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-26T19:27:05.128822] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:05.511741] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-26T19:27:06.276437] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:27:06.297597] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-26T19:27:06.311680] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-26T19:27:07.105349] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:27:07.111667] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-26T19:27:07.735486] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-26T19:27:07.911759] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-26T19:27:08.711708] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-26T19:27:08.813283] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T19:27:08.815490] [INFO ] [REMOTE ] IHD: Full fetch complete (11865 records). [2025-09-26T19:27:08.815568] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-26T19:27:09.209690] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-26T19:27:09.209786] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-26T19:27:09.210105] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-26T19:27:09.210145] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-26T19:27:09.210696] [DEBUG] [LOCAL ] IHD: Trimmed 11865 records to 7225 (keeping 200 days of data) [2025-09-26T19:27:09.258122] [DEBUG] [LOCAL ] IHD: Primary data saved (7225 records). [2025-09-26T19:27:09.258277] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-26T19:27:09.258395] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IHD took 22.6s. Estimated remaining: 2h 49m 41s. Rate: 7.5 symbols/min [2025-09-26T19:27:09.437124] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:09.437340] [DEBUG] [LOCAL ] IIIN: No existing data file found in primary storage. [2025-09-26T19:27:09.437394] [WARN ] [MAIN ] IIIN: No existing data found, performing full refresh instead. [2025-09-26T19:27:09.437558] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-26T19:27:09.437621] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-26T19:27:09.437715] [DEBUG] [LOCAL ] IIIN: No primary data file found to delete. [2025-09-26T19:27:09.437757] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-26T19:27:09.516816] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-26T19:27:09.834230] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:10.219256] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:27:10.311704] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-26T19:27:10.817124] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-26T19:27:11.111738] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-26T19:27:11.798267] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:27:11.911725] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-26T19:27:12.144283] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:27:12.653550] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-26T19:27:12.711705] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-26T19:27:13.511744] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-26T19:27:13.797768] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-26T19:27:14.311697] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-26T19:27:14.327500] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T19:27:15.111717] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-26T19:27:15.450056] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T19:27:15.911715] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-26T19:27:15.930782] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:27:16.711713] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-26T19:27:16.928693] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:27:17.363745] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T19:27:17.511738] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-26T19:27:18.311734] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-26T19:27:18.713132] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-26T19:27:18.811826] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-26T19:27:19.111720] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-26T19:27:19.732245] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T19:27:19.911719] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-26T19:27:20.517944] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T19:27:20.711730] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-26T19:27:21.511688] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-26T19:27:21.831333] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-26T19:27:22.250680] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T19:27:22.311727] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-26T19:27:23.111725] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-26T19:27:23.753210] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:27:23.911722] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-26T19:27:24.294212] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-26T19:27:24.523940] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-26T19:27:24.711743] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-26T19:27:25.511733] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-26T19:27:26.147596] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-26T19:27:26.311728] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-26T19:27:26.831291] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T19:27:26.832740] [INFO ] [REMOTE ] IIF: Full fetch complete (9495 records). [2025-09-26T19:27:26.832936] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-26T19:27:26.890696] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:27:26.954522] [INFO ] [REMOTE ] IHG: Full fetch complete (33663 records). [2025-09-26T19:27:26.957205] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-26T19:27:27.116174] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-26T19:27:27.558921] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-26T19:27:27.564621] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-26T19:27:27.570036] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-26T19:27:27.575246] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-26T19:27:27.618891] [DEBUG] [LOCAL ] IIF: Trimmed 9495 records to 5787 (keeping 200 days of data) [2025-09-26T19:27:27.664601] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-26T19:27:27.675748] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-26T19:27:27.676716] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-26T19:27:27.679683] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-26T19:27:27.688408] [DEBUG] [LOCAL ] IIF: Primary data saved (5787 records). [2025-09-26T19:27:27.688801] [DEBUG] [LOCAL ] IHG: Trimmed 33663 records to 24977 (keeping 200 days of data) [2025-09-26T19:27:27.688699] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-26T19:27:27.689298] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IIF took 23.4s. Estimated remaining: 2h 49m 45s. Rate: 7.5 symbols/min [2025-09-26T19:27:27.915688] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-26T19:27:27.978574] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:28.027455] [DEBUG] [LOCAL ] IIM: Loaded 15993 existing records from primary storage. [2025-09-26T19:27:28.030614] [INFO ] [MAIN ] IIM: Loaded 15993 existing records. [2025-09-26T19:27:28.257208] [DEBUG] [LOCAL ] IHG: Primary data saved (24977 records). [2025-09-26T19:27:28.280199] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-26T19:27:28.280523] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IHG took 36.2s. Estimated remaining: 2h 49m 28s. Rate: 7.5 symbols/min [2025-09-26T19:27:28.280004] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:28.281388] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-26T19:27:28.327104] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-26T19:27:28.369923] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-26T19:27:28.394204] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-26T19:27:28.555379] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:28.846339] [DEBUG] [LOCAL ] IIPR: Loaded 29843 existing records from primary storage. [2025-09-26T19:27:28.850437] [INFO ] [MAIN ] IIPR: Loaded 29843 existing records. [2025-09-26T19:27:29.067296] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:29.095476] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-26T19:27:29.223472] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T19:27:29.232078] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:29.234171] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-26T19:27:29.234569] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-26T19:27:29.236186] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-26T19:27:29.245211] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-26T19:27:29.245495] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-26T19:27:29.516828] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-26T19:27:29.627570] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:30.320216] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-26T19:27:30.322312] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-26T19:27:30.692069] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:27:31.111735] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-26T19:27:31.779157] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:27:31.911732] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-26T19:27:32.205152] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-26T19:27:32.711723] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-26T19:27:33.378452] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-26T19:27:33.511719] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-26T19:27:34.218184] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:27:34.311699] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-26T19:27:34.622449] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T19:27:35.111762] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-26T19:27:35.809137] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:27:35.911725] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-26T19:27:36.387149] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T19:27:36.711726] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-26T19:27:37.303284] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T19:27:37.511725] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-26T19:27:37.647067] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-26T19:27:38.311740] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-26T19:27:38.865537] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T19:27:38.872113] [INFO ] [REMOTE ] IHS: Full fetch complete (52094 records). [2025-09-26T19:27:38.872262] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-26T19:27:39.116031] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-26T19:27:39.290118] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-26T19:27:39.290229] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-26T19:27:39.291069] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-26T19:27:39.291136] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-26T19:27:39.292487] [DEBUG] [LOCAL ] IHS: Trimmed 52094 records to 39400 (keeping 200 days of data) [2025-09-26T19:27:39.419589] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T19:27:39.545213] [DEBUG] [LOCAL ] IHS: Primary data saved (39400 records). [2025-09-26T19:27:39.545434] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-26T19:27:39.545577] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IHS took 36.8s. Estimated remaining: 2h 49m 24s. Rate: 7.5 symbols/min [2025-09-26T19:27:39.722045] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:39.762287] [DEBUG] [LOCAL ] IMAX: Loaded 43076 existing records from primary storage. [2025-09-26T19:27:39.762429] [INFO ] [MAIN ] IMAX: Loaded 43076 existing records. [2025-09-26T19:27:39.912039] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-26T19:27:39.951690] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:39.952819] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-26T19:27:39.952890] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-26T19:27:39.954023] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-26T19:27:39.954090] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-26T19:27:40.160748] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:27:40.360510] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:40.711715] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-26T19:27:41.511695] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-26T19:27:41.606168] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-26T19:27:41.746924] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T19:27:42.311719] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-26T19:27:42.869121] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T19:27:43.111786] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-26T19:27:43.303697] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T19:27:43.306990] [INFO ] [REMOTE ] IIIN: Full fetch complete (25128 records). [2025-09-26T19:27:43.307115] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-26T19:27:43.765254] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-26T19:27:43.765378] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-26T19:27:43.766048] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-26T19:27:43.766114] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-26T19:27:43.767838] [DEBUG] [LOCAL ] IIIN: Trimmed 25128 records to 16828 (keeping 200 days of data) [2025-09-26T19:27:43.887198] [DEBUG] [LOCAL ] IIIN: Primary data saved (16828 records). [2025-09-26T19:27:43.887362] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-26T19:27:43.887451] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IIIN took 34.6s. Estimated remaining: 2h 49m 12s. Rate: 7.5 symbols/min [2025-09-26T19:27:43.921474] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-26T19:27:44.077511] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:27:44.096398] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-26T19:27:44.154933] [DEBUG] [LOCAL ] INFA: Loaded 50299 existing records from primary storage. [2025-09-26T19:27:44.155081] [INFO ] [MAIN ] INFA: Loaded 50299 existing records. [2025-09-26T19:27:44.373477] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:27:44.373877] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-26T19:27:44.373935] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-26T19:27:44.375572] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-26T19:27:44.375634] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-26T19:27:44.720635] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-26T19:27:44.767380] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:27:45.511717] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-26T19:27:45.556439] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T19:27:45.745502] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T19:27:46.311731] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-26T19:27:46.871317] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T19:27:47.111702] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-26T19:27:47.911702] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-26T19:27:48.045455] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T19:27:48.047394] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:27:48.711718] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-26T19:27:49.418639] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-26T19:27:49.511716] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-26T19:27:50.246786] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T19:27:50.311726] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-26T19:27:50.776499] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:27:50.984864] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-26T19:27:51.111733] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-26T19:27:51.911708] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-26T19:27:52.347862] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T19:27:52.711725] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-26T19:27:53.511734] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-26T19:27:53.669519] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-26T19:27:54.201854] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:27:54.311721] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-26T19:27:55.005674] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T19:27:55.111749] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-26T19:27:55.315271] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-26T19:27:55.911715] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-26T19:27:56.717918] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-26T19:27:56.735065] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-26T19:27:56.879287] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-26T19:27:57.511724] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-26T19:27:58.154723] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T19:27:58.311751] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-26T19:27:59.111755] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-26T19:27:59.184461] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:27:59.846031] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-26T19:27:59.851895] [INFO ] [REMOTE ] IIPR: Full fetch complete (44165 records). [2025-09-26T19:27:59.852044] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-26T19:27:59.918271] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-26T19:28:00.255894] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-26T19:28:00.255997] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-26T19:28:00.256733] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-26T19:28:00.256798] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-26T19:28:00.258311] [DEBUG] [LOCAL ] IIPR: Trimmed 44165 records to 30052 (keeping 200 days of data) [2025-09-26T19:28:00.461843] [DEBUG] [LOCAL ] IIPR: Primary data saved (30052 records). [2025-09-26T19:28:00.461992] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-26T19:28:00.462093] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIPR took 32.2s. Estimated remaining: 2h 49m 14s. Rate: 7.5 symbols/min [2025-09-26T19:28:00.643316] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:00.705780] [DEBUG] [LOCAL ] INFY: Loaded 53988 existing records from primary storage. [2025-09-26T19:28:00.705998] [INFO ] [MAIN ] INFY: Loaded 53988 existing records. [2025-09-26T19:28:00.738138] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-26T19:28:00.898557] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:00.899342] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-26T19:28:00.899440] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-26T19:28:00.901772] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-26T19:28:00.901863] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-26T19:28:01.318771] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:01.324581] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-26T19:28:01.365527] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-26T19:28:01.511722] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-26T19:28:02.022844] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T19:28:02.027971] [INFO ] [REMOTE ] IIM: Full fetch complete (25277 records). [2025-09-26T19:28:02.028118] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-26T19:28:02.320454] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-26T19:28:02.418365] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-26T19:28:02.418444] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-26T19:28:02.418979] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-26T19:28:02.419040] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-26T19:28:02.420584] [DEBUG] [LOCAL ] IIM: Trimmed 25277 records to 16102 (keeping 200 days of data) [2025-09-26T19:28:02.526800] [DEBUG] [LOCAL ] IIM: Primary data saved (16102 records). [2025-09-26T19:28:02.527094] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-26T19:28:02.527204] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. IIM took 34.8s. Estimated remaining: 2h 48m 59s. Rate: 7.5 symbols/min [2025-09-26T19:28:02.701293] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:02.768975] [DEBUG] [LOCAL ] ING: Loaded 51166 existing records from primary storage. [2025-09-26T19:28:02.769161] [INFO ] [MAIN ] ING: Loaded 51166 existing records. [2025-09-26T19:28:02.953465] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:02.953793] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-26T19:28:02.953847] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-26T19:28:02.955849] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-26T19:28:02.955912] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-26T19:28:03.113904] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-26T19:28:03.360746] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:03.397840] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-26T19:28:03.655341] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:28:03.911727] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-26T19:28:04.650760] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T19:28:04.711709] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-26T19:28:05.208191] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-26T19:28:05.511746] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-26T19:28:06.318637] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-26T19:28:06.337383] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:28:07.111716] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-26T19:28:07.318190] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T19:28:07.911707] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-26T19:28:07.994451] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T19:28:08.716213] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-26T19:28:08.723020] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-26T19:28:09.511708] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-26T19:28:09.668526] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-26T19:28:10.311740] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-26T19:28:10.449120] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T19:28:11.111736] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-26T19:28:11.291004] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T19:28:11.911713] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-26T19:28:11.955697] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T19:28:11.964685] [INFO ] [REMOTE ] IMAX: Full fetch complete (59679 records). [2025-09-26T19:28:11.964879] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-26T19:28:12.386967] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-26T19:28:12.387077] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-26T19:28:12.388182] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-26T19:28:12.388262] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-26T19:28:12.389694] [DEBUG] [LOCAL ] IMAX: Trimmed 59679 records to 43382 (keeping 200 days of data) [2025-09-26T19:28:12.658554] [DEBUG] [LOCAL ] IMAX: Primary data saved (43382 records). [2025-09-26T19:28:12.658727] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-26T19:28:12.658845] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. IMAX took 33.1s. Estimated remaining: 2h 48m 53s. Rate: 7.5 symbols/min [2025-09-26T19:28:12.718694] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-26T19:28:12.847720] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:12.880474] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:28:12.917983] [DEBUG] [LOCAL ] INGM: Loaded 28961 existing records from primary storage. [2025-09-26T19:28:12.918148] [INFO ] [MAIN ] INGM: Loaded 28961 existing records. [2025-09-26T19:28:13.110889] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:13.111610] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-26T19:28:13.111722] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-26T19:28:13.112751] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-26T19:28:13.112815] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-26T19:28:13.507831] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:13.518068] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-26T19:28:13.537119] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:28:14.311735] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-26T19:28:14.669825] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-26T19:28:14.919731] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-26T19:28:15.111726] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-26T19:28:15.911710] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-26T19:28:16.059769] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T19:28:16.072715] [INFO ] [REMOTE ] INFA: Full fetch complete (71699 records). [2025-09-26T19:28:16.072878] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-26T19:28:16.510201] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-26T19:28:16.510466] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-26T19:28:16.511593] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-26T19:28:16.511690] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-26T19:28:16.515459] [DEBUG] [LOCAL ] INFA: Trimmed 71699 records to 50602 (keeping 200 days of data) [2025-09-26T19:28:16.731724] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-26T19:28:16.841262] [DEBUG] [LOCAL ] INFA: Primary data saved (50602 records). [2025-09-26T19:28:16.841419] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-26T19:28:16.841570] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFA took 33.0s. Estimated remaining: 2h 48m 41s. Rate: 7.5 symbols/min [2025-09-26T19:28:17.030578] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:17.067019] [DEBUG] [LOCAL ] INGR: Loaded 33657 existing records from primary storage. [2025-09-26T19:28:17.067205] [INFO ] [MAIN ] INGR: Loaded 33657 existing records. [2025-09-26T19:28:17.293619] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-26T19:28:17.300787] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:17.316940] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-26T19:28:17.317583] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-26T19:28:17.320279] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-26T19:28:17.320354] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-26T19:28:17.516857] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-26T19:28:17.767904] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:17.840849] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T19:28:17.851732] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:28:18.311728] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-26T19:28:19.111726] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-26T19:28:19.554503] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-26T19:28:19.679828] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T19:28:19.911724] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-26T19:28:20.271616] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T19:28:20.711729] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-26T19:28:21.511722] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-26T19:28:21.774981] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T19:28:22.311741] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-26T19:28:22.508948] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T19:28:22.962577] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T19:28:23.111719] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-26T19:28:23.785566] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:28:23.911717] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-26T19:28:24.525709] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-26T19:28:24.711745] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-26T19:28:25.511691] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-26T19:28:25.617790] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:28:26.056945] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T19:28:26.311744] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-26T19:28:26.943420] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:28:27.111719] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-26T19:28:27.701597] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-26T19:28:27.910759] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T19:28:27.917093] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-26T19:28:28.711720] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-26T19:28:29.511715] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-26T19:28:29.571357] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-26T19:28:30.311712] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-26T19:28:30.520824] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-26T19:28:30.764260] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T19:28:31.111723] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-26T19:28:31.843360] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T19:28:31.911688] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-26T19:28:32.667412] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:28:32.712886] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-26T19:28:32.715288] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-26T19:28:33.511740] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-26T19:28:34.311681] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-26T19:28:34.495867] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T19:28:34.531483] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:28:35.111776] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-26T19:28:35.344988] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-26T19:28:35.911767] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-26T19:28:36.402945] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-26T19:28:36.412062] [INFO ] [REMOTE ] INGM: Full fetch complete (42338 records). [2025-09-26T19:28:36.412277] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-26T19:28:36.717021] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-26T19:28:36.866209] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-26T19:28:36.866313] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-26T19:28:36.867273] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-26T19:28:36.867346] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-26T19:28:36.868767] [DEBUG] [LOCAL ] INGM: Trimmed 42338 records to 29224 (keeping 200 days of data) [2025-09-26T19:28:37.059248] [DEBUG] [LOCAL ] INGM: Primary data saved (29224 records). [2025-09-26T19:28:37.059414] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-26T19:28:37.059514] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INGM took 24.4s. Estimated remaining: 2h 48m 47s. Rate: 7.5 symbols/min [2025-09-26T19:28:37.249434] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:37.290746] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T19:28:37.311379] [DEBUG] [LOCAL ] INN: Loaded 42206 existing records from primary storage. [2025-09-26T19:28:37.311531] [INFO ] [MAIN ] INN: Loaded 42206 existing records. [2025-09-26T19:28:37.501877] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:37.502169] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-26T19:28:37.502221] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-26T19:28:37.504301] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-26T19:28:37.504374] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-26T19:28:37.516867] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-26T19:28:37.884526] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:38.311717] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-26T19:28:38.867024] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T19:28:38.878867] [INFO ] [REMOTE ] INFY: Full fetch complete (77540 records). [2025-09-26T19:28:38.879035] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-26T19:28:39.046813] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:28:39.116001] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-26T19:28:39.362258] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-26T19:28:39.362501] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-26T19:28:39.363761] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-26T19:28:39.363887] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-26T19:28:39.365901] [DEBUG] [LOCAL ] INFY: Trimmed 77540 records to 54378 (keeping 200 days of data) [2025-09-26T19:28:39.486064] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-26T19:28:39.745760] [DEBUG] [LOCAL ] INFY: Primary data saved (54378 records). [2025-09-26T19:28:39.745917] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-26T19:28:39.746055] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INFY took 39.3s. Estimated remaining: 2h 48m 33s. Rate: 7.5 symbols/min [2025-09-26T19:28:39.916885] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-26T19:28:39.950991] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:39.951167] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-26T19:28:39.951206] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-26T19:28:39.951366] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-26T19:28:39.951457] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-26T19:28:39.951800] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-26T19:28:39.951860] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-26T19:28:40.335402] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:40.711723] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-26T19:28:41.001715] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:28:41.012103] [INFO ] [REMOTE ] ING: Full fetch complete (73638 records). [2025-09-26T19:28:41.012298] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-26T19:28:41.464089] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-26T19:28:41.464379] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-26T19:28:41.468287] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T19:28:41.466918] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-26T19:28:41.475147] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-26T19:28:41.477356] [DEBUG] [LOCAL ] ING: Trimmed 73638 records to 51537 (keeping 200 days of data) [2025-09-26T19:28:41.531826] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-26T19:28:41.635698] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-26T19:28:41.872968] [DEBUG] [LOCAL ] ING: Primary data saved (51537 records). [2025-09-26T19:28:41.873120] [INFO ] [MAIN ] ING: Full history saved. [2025-09-26T19:28:41.874382] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. ING took 39.3s. Estimated remaining: 2h 48m 18s. Rate: 7.5 symbols/min [2025-09-26T19:28:42.060489] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:42.105091] [DEBUG] [LOCAL ] INSP: Loaded 37201 existing records from primary storage. [2025-09-26T19:28:42.105267] [INFO ] [MAIN ] INSP: Loaded 37201 existing records. [2025-09-26T19:28:42.300018] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:42.300289] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-26T19:28:42.300339] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-26T19:28:42.301432] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-26T19:28:42.301496] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-26T19:28:42.316917] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-26T19:28:42.601573] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:28:42.610600] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-26T19:28:42.694223] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:42.866992] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T19:28:43.111755] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-26T19:28:43.911729] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-26T19:28:44.327205] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-26T19:28:44.701180] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-26T19:28:44.709071] [INFO ] [REMOTE ] INGR: Full fetch complete (49958 records). [2025-09-26T19:28:44.709226] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-26T19:28:44.721693] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-26T19:28:45.122625] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-26T19:28:45.122781] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-26T19:28:45.123611] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-26T19:28:45.123716] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-26T19:28:45.124928] [DEBUG] [LOCAL ] INGR: Trimmed 49958 records to 33913 (keeping 200 days of data) [2025-09-26T19:28:45.339352] [DEBUG] [LOCAL ] INGR: Primary data saved (33913 records). [2025-09-26T19:28:45.339514] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-26T19:28:45.339625] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INGR took 28.5s. Estimated remaining: 2h 48m 5s. Rate: 7.5 symbols/min [2025-09-26T19:28:45.518691] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-26T19:28:45.523204] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:28:45.564541] [DEBUG] [LOCAL ] INSW: Loaded 40590 existing records from primary storage. [2025-09-26T19:28:45.564719] [INFO ] [MAIN ] INSW: Loaded 40590 existing records. [2025-09-26T19:28:45.754281] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:28:45.754549] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-26T19:28:45.754597] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-26T19:28:45.755831] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-26T19:28:45.755896] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-26T19:28:46.141006] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:28:46.311713] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-26T19:28:46.342708] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T19:28:46.854161] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T19:28:47.111719] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-26T19:28:47.868981] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:28:47.911708] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-26T19:28:48.605429] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:28:48.711724] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-26T19:28:49.511729] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-26T19:28:49.604206] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:28:50.078050] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T19:28:50.311727] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-26T19:28:51.099414] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:28:51.111673] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-26T19:28:51.278137] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T19:28:51.911717] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-26T19:28:52.610013] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T19:28:52.711686] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-26T19:28:53.110869] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-26T19:28:53.511712] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-26T19:28:54.311717] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-26T19:28:54.371703] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T19:28:54.957987] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T19:28:55.111699] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-26T19:28:55.495816] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T19:28:55.911720] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-26T19:28:56.249617] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T19:28:56.711735] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-26T19:28:57.398850] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:28:57.511752] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-26T19:28:58.051693] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-26T19:28:58.311704] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-26T19:28:59.113222] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-26T19:28:59.116364] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:28:59.752482] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:28:59.911727] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-26T19:29:00.476750] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T19:29:00.711759] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-26T19:29:01.147878] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T19:29:01.511743] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-26T19:29:02.051246] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T19:29:02.311724] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-26T19:29:02.787995] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-26T19:29:03.111729] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-26T19:29:03.845603] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T19:29:03.911690] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-26T19:29:04.356635] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T19:29:04.711728] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-26T19:29:05.332125] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T19:29:05.511773] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-26T19:29:06.272312] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T19:29:06.279850] [INFO ] [REMOTE ] INN: Full fetch complete (57782 records). [2025-09-26T19:29:06.279994] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-26T19:29:06.316807] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-26T19:29:06.687799] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-26T19:29:06.687916] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-26T19:29:06.689081] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-26T19:29:06.689159] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-26T19:29:06.690695] [DEBUG] [LOCAL ] INN: Trimmed 57782 records to 42433 (keeping 200 days of data) [2025-09-26T19:29:06.969537] [DEBUG] [LOCAL ] INN: Primary data saved (42433 records). [2025-09-26T19:29:06.982529] [INFO ] [MAIN ] INN: Full history saved. [2025-09-26T19:29:06.982828] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INN took 29.9s. Estimated remaining: 2h 48m 12s. Rate: 7.5 symbols/min [2025-09-26T19:29:07.024082] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T19:29:07.114143] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-26T19:29:07.199093] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:07.251567] [DEBUG] [LOCAL ] INVH: Loaded 53530 existing records from primary storage. [2025-09-26T19:29:07.251748] [INFO ] [MAIN ] INVH: Loaded 53530 existing records. [2025-09-26T19:29:07.443975] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:07.444308] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-26T19:29:07.444433] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-26T19:29:07.446560] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-26T19:29:07.446636] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-26T19:29:07.823207] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:07.911703] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-26T19:29:08.094251] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:29:08.397142] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-26T19:29:08.402884] [INFO ] [REMOTE ] INR: Full fetch complete (33416 records). [2025-09-26T19:29:08.402986] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-26T19:29:08.620375] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-26T19:29:08.620833] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:29:08.620906] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:29:08.620989] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-26T19:29:08.621064] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-26T19:29:08.621120] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-26T19:29:08.621204] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-26T19:29:08.621293] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INR took 28.9s. Estimated remaining: 2h 47m 57s. Rate: 7.5 symbols/min [2025-09-26T19:29:08.716996] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-26T19:29:08.801954] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:08.832375] [DEBUG] [LOCAL ] INVX: Loaded 29093 existing records from primary storage. [2025-09-26T19:29:08.832519] [INFO ] [MAIN ] INVX: Loaded 29093 existing records. [2025-09-26T19:29:09.018030] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:09.018350] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-26T19:29:09.018412] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-26T19:29:09.019341] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-26T19:29:09.019434] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-26T19:29:09.399997] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:09.511747] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-26T19:29:09.772449] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:29:10.324133] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-26T19:29:10.348504] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:29:11.111691] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-26T19:29:11.305934] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-26T19:29:11.315173] [INFO ] [REMOTE ] INSP: Full fetch complete (52615 records). [2025-09-26T19:29:11.315331] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-26T19:29:11.740800] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-26T19:29:11.740905] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-26T19:29:11.741800] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-26T19:29:11.741874] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-26T19:29:11.743311] [DEBUG] [LOCAL ] INSP: Trimmed 52615 records to 37492 (keeping 200 days of data) [2025-09-26T19:29:11.912758] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-26T19:29:11.988017] [DEBUG] [LOCAL ] INSP: Primary data saved (37492 records). [2025-09-26T19:29:11.988253] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-26T19:29:11.988885] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INSP took 30.1s. Estimated remaining: 2h 47m 44s. Rate: 7.5 symbols/min [2025-09-26T19:29:12.182956] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:12.216899] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T19:29:12.252221] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-26T19:29:12.309165] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-09-26T19:29:12.309354] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-09-26T19:29:12.501507] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:12.501847] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-26T19:29:12.501940] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-26T19:29:12.503588] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-26T19:29:12.503684] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-26T19:29:12.718383] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-26T19:29:12.911117] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:13.351972] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:29:13.511730] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-26T19:29:14.311689] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-26T19:29:14.427574] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T19:29:15.059085] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:29:15.111725] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-26T19:29:15.681801] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T19:29:15.911736] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-26T19:29:16.710571] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-26T19:29:16.718633] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-26T19:29:17.511761] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-26T19:29:18.311729] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-26T19:29:18.560611] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:29:18.672422] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-26T19:29:19.111690] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-26T19:29:19.350546] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T19:29:19.358337] [INFO ] [REMOTE ] INSW: Full fetch complete (60690 records). [2025-09-26T19:29:19.358477] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-26T19:29:19.799224] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-26T19:29:19.799381] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-26T19:29:19.800338] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-26T19:29:19.800434] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-26T19:29:19.801961] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:29:19.809787] [DEBUG] [LOCAL ] INSW: Trimmed 60690 records to 40831 (keeping 200 days of data) [2025-09-26T19:29:19.912794] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-26T19:29:20.079823] [DEBUG] [LOCAL ] INSW: Primary data saved (40831 records). [2025-09-26T19:29:20.080122] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-26T19:29:20.080606] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INSW took 34.7s. Estimated remaining: 2h 47m 36s. Rate: 7.5 symbols/min [2025-09-26T19:29:20.712719] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-26T19:29:20.722907] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:29:21.093020] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T19:29:21.511827] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-26T19:29:22.311753] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-26T19:29:22.820585] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-26T19:29:23.003959] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-26T19:29:23.111760] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-26T19:29:23.911783] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-26T19:29:24.189891] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T19:29:24.711760] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-26T19:29:25.237534] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:29:25.511736] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-26T19:29:25.723091] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-09-26T19:29:26.311771] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-26T19:29:26.483137] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T19:29:26.682603] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T19:29:27.111724] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-26T19:29:27.911789] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-26T19:29:29.035000] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:29:29.050639] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-26T19:29:29.097539] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-26T19:29:29.150852] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T19:29:29.511768] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-26T19:29:30.311729] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-26T19:29:30.821578] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:29:30.822685] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T19:29:31.111744] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-26T19:29:31.911734] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-26T19:29:32.496531] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:29:32.502535] [INFO ] [REMOTE ] INVX: Full fetch complete (44396 records). [2025-09-26T19:29:32.502768] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-26T19:29:32.930916] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-26T19:29:32.931167] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-26T19:29:32.931951] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-26T19:29:32.932147] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-26T19:29:32.933316] [DEBUG] [LOCAL ] INVX: Trimmed 44396 records to 29366 (keeping 200 days of data) [2025-09-26T19:29:33.068942] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-26T19:29:33.089843] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-26T19:29:33.165138] [DEBUG] [LOCAL ] INVX: Primary data saved (29366 records). [2025-09-26T19:29:33.165300] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-26T19:29:33.165438] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. INVX took 24.5s. Estimated remaining: 2h 47m 33s. Rate: 7.5 symbols/min [2025-09-26T19:29:33.585751] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:29:33.597006] [INFO ] [REMOTE ] INVH: Full fetch complete (76719 records). [2025-09-26T19:29:33.597151] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-26T19:29:34.013867] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-26T19:29:34.013972] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-26T19:29:34.015030] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-26T19:29:34.015096] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-26T19:29:34.017365] [DEBUG] [LOCAL ] INVH: Trimmed 76719 records to 53918 (keeping 200 days of data) [2025-09-26T19:29:34.370819] [DEBUG] [LOCAL ] INVH: Primary data saved (53918 records). [2025-09-26T19:29:34.370961] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-26T19:29:34.371045] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. INVH took 27.4s. Estimated remaining: 2h 47m 18s. Rate: 7.5 symbols/min [2025-09-26T19:29:35.811933] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-26T19:29:35.823466] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-26T19:29:38.329732] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-26T19:29:38.340970] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-26T19:29:41.137608] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-26T19:29:41.149794] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-26T19:29:43.772559] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-26T19:29:43.784463] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-26T19:29:46.827960] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (3.04 seconds). [2025-09-26T19:29:46.839004] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-26T19:29:46.839206] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-26T19:29:47.262535] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-26T19:29:47.262623] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-26T19:29:47.263717] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-26T19:29:47.263787] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-26T19:29:47.265432] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-09-26T19:29:47.626447] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-09-26T19:29:47.626630] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-26T19:29:47.627363] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IONQ took 35.6s. Estimated remaining: 2h 47m 15s. Rate: 7.5 symbols/min [2025-09-26T19:29:48.357176] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:48.382548] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:48.402539] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:48.423959] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:29:48.474188] [DEBUG] [LOCAL ] IPI: Loaded 21545 existing records from primary storage. [2025-09-26T19:29:48.474493] [INFO ] [MAIN ] IPI: Loaded 21545 existing records. [2025-09-26T19:29:48.666891] [DEBUG] [LOCAL ] IOT: Loaded 53859 existing records from primary storage. [2025-09-26T19:29:48.711105] [DEBUG] [LOCAL ] IPG: Loaded 53721 existing records from primary storage. [2025-09-26T19:29:48.711353] [INFO ] [MAIN ] IPG: Loaded 53721 existing records. [2025-09-26T19:29:48.725772] [INFO ] [MAIN ] IOT: Loaded 53859 existing records. [2025-09-26T19:29:48.857313] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:48.963311] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-26T19:29:48.969804] [DEBUG] [LOCAL ] IP: Loaded 53703 existing records from primary storage. [2025-09-26T19:29:48.963590] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-26T19:29:48.990627] [INFO ] [MAIN ] IP: Loaded 53703 existing records. [2025-09-26T19:29:49.033984] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-26T19:29:49.136706] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-26T19:29:49.362891] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:49.380094] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:49.405818] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-26T19:29:49.416300] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-26T19:29:49.446164] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-26T19:29:49.446360] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-26T19:29:49.446426] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-26T19:29:49.517466] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-26T19:29:49.558811] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:29:49.592907] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-26T19:29:49.637577] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-26T19:29:49.632359] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-26T19:29:49.725618] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-26T19:29:49.699824] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-26T19:29:49.807676] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-26T19:29:50.213710] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:50.308314] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-26T19:29:50.678694] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:50.729377] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-26T19:29:50.947292] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:50.966029] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-26T19:29:51.004273] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:29:51.004575] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-26T19:29:51.565807] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-26T19:29:51.569715] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-26T19:29:52.606564] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-26T19:29:52.612366] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-26T19:29:52.711065] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T19:29:52.722336] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-26T19:29:53.066288] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T19:29:53.078087] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-26T19:29:53.152938] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-26T19:29:53.164001] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-26T19:29:53.433356] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:29:53.437718] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-26T19:29:54.482291] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T19:29:54.493668] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-26T19:29:54.526634] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-26T19:29:54.538506] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-26T19:29:54.600518] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-26T19:29:54.605862] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-26T19:29:54.780873] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T19:29:54.792255] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-26T19:29:55.745728] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T19:29:55.751250] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-26T19:29:56.107841] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T19:29:56.118871] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-26T19:29:56.148384] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-26T19:29:56.159672] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-26T19:29:56.518865] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T19:29:56.529233] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-26T19:29:57.047831] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:29:57.053846] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-26T19:29:57.819446] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-26T19:29:57.824815] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-26T19:29:57.992111] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T19:29:58.004804] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-26T19:29:58.076363] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T19:29:58.087961] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-26T19:29:58.573507] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T19:29:58.584993] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-26T19:29:58.926306] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T19:29:58.930919] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-26T19:29:59.783526] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T19:29:59.795334] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-26T19:29:59.945991] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T19:29:59.958432] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-26T19:29:59.989711] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T19:29:59.994298] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-26T19:30:00.496786] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-26T19:30:00.508428] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-26T19:30:01.217952] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-26T19:30:01.223047] [INFO ] [REMOTE ] IPI: Full fetch complete (29263 records). [2025-09-26T19:30:01.223294] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-26T19:30:01.619689] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-26T19:30:01.698485] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-26T19:30:01.699107] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-26T19:30:01.698665] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-26T19:30:01.700057] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-26T19:30:01.701079] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-26T19:30:01.702775] [DEBUG] [LOCAL ] IPI: Trimmed 29263 records to 21704 (keeping 200 days of data) [2025-09-26T19:30:01.843135] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T19:30:01.857746] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-26T19:30:01.895008] [DEBUG] [LOCAL ] IPI: Primary data saved (21704 records). [2025-09-26T19:30:01.895143] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-26T19:30:01.895243] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IPI took 14.3s. Estimated remaining: 2h 47m 14s. Rate: 7.5 symbols/min [2025-09-26T19:30:02.101236] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:02.144153] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T19:30:02.156394] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-26T19:30:02.163594] [DEBUG] [LOCAL ] IQI: Loaded 18062 existing records from primary storage. [2025-09-26T19:30:02.163706] [INFO ] [MAIN ] IQI: Loaded 18062 existing records. [2025-09-26T19:30:02.370960] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:02.371311] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-26T19:30:02.371368] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-26T19:30:02.371961] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-26T19:30:02.372022] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-26T19:30:02.768158] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:02.768523] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-26T19:30:03.443167] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-26T19:30:03.459451] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-26T19:30:03.713162] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-26T19:30:03.725990] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-26T19:30:03.870721] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T19:30:03.911682] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-26T19:30:04.024313] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T19:30:04.711757] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-26T19:30:05.199718] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:30:05.455957] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T19:30:05.511730] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-26T19:30:05.660605] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-26T19:30:06.311859] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-26T19:30:06.615503] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-26T19:30:06.657721] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T19:30:07.111732] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-26T19:30:07.911719] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-26T19:30:08.258867] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:30:08.711730] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-26T19:30:08.807422] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-26T19:30:08.950598] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T19:30:09.511756] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-26T19:30:10.311751] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-26T19:30:10.454100] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:30:11.111787] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-26T19:30:11.403275] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-26T19:30:11.575128] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-26T19:30:11.586230] [INFO ] [REMOTE ] IP: Full fetch complete (77056 records). [2025-09-26T19:30:11.586432] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-26T19:30:11.915587] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-26T19:30:12.014408] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-26T19:30:12.014505] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-26T19:30:12.015471] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-26T19:30:12.015537] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-26T19:30:12.019232] [DEBUG] [LOCAL ] IP: Trimmed 77056 records to 54093 (keeping 200 days of data) [2025-09-26T19:30:12.360460] [DEBUG] [LOCAL ] IP: Primary data saved (54093 records). [2025-09-26T19:30:12.360616] [INFO ] [MAIN ] IP: Full history saved. [2025-09-26T19:30:12.360755] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IP took 24.7s. Estimated remaining: 2h 47m 9s. Rate: 7.5 symbols/min [2025-09-26T19:30:12.546473] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:12.601253] [DEBUG] [LOCAL ] IQV: Loaded 50564 existing records from primary storage. [2025-09-26T19:30:12.601438] [INFO ] [MAIN ] IQV: Loaded 50564 existing records. [2025-09-26T19:30:12.716902] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-26T19:30:12.795256] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:12.795576] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-26T19:30:12.795625] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-26T19:30:12.797176] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-26T19:30:12.797247] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-26T19:30:13.183899] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:13.258705] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T19:30:13.272152] [INFO ] [REMOTE ] IOT: Full fetch complete (77380 records). [2025-09-26T19:30:13.272427] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-26T19:30:13.523954] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-26T19:30:13.711899] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-26T19:30:13.712062] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-26T19:30:13.713364] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-26T19:30:13.719231] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-26T19:30:13.725242] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T19:30:13.757895] [DEBUG] [LOCAL ] IOT: Trimmed 77380 records to 54249 (keeping 200 days of data) [2025-09-26T19:30:13.760879] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:30:13.828696] [INFO ] [REMOTE ] IPG: Full fetch complete (77254 records). [2025-09-26T19:30:13.855047] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-26T19:30:14.322244] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-26T19:30:14.414528] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-26T19:30:14.415334] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-26T19:30:14.417180] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-26T19:30:14.417269] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-26T19:30:14.422087] [DEBUG] [LOCAL ] IPG: Trimmed 77254 records to 54110 (keeping 200 days of data) [2025-09-26T19:30:14.767631] [DEBUG] [LOCAL ] IOT: Primary data saved (54249 records). [2025-09-26T19:30:14.768583] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-26T19:30:14.769035] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IOT took 27.1s. Estimated remaining: 2h 46m 55s. Rate: 7.5 symbols/min [2025-09-26T19:30:14.964553] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:15.095943] [DEBUG] [LOCAL ] IR: Loaded 53084 existing records from primary storage. [2025-09-26T19:30:15.096773] [INFO ] [MAIN ] IR: Loaded 53084 existing records. [2025-09-26T19:30:15.336420] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:15.337381] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T19:30:15.336714] [DEBUG] [LOCAL ] IPG: Primary data saved (54110 records). [2025-09-26T19:30:15.341402] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-26T19:30:15.342051] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-26T19:30:15.342161] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-26T19:30:15.342596] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IPG took 27.7s. Estimated remaining: 2h 46m 38s. Rate: 7.5 symbols/min [2025-09-26T19:30:15.343571] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-26T19:30:15.348887] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-26T19:30:15.362489] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-26T19:30:15.709807] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:15.826869] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-26T19:30:15.916294] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-26T19:30:15.983973] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:16.017229] [DEBUG] [LOCAL ] IRM: Loaded 49808 existing records from primary storage. [2025-09-26T19:30:16.017404] [INFO ] [MAIN ] IRM: Loaded 49808 existing records. [2025-09-26T19:30:16.233777] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:16.234135] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-26T19:30:16.234193] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-26T19:30:16.236079] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-26T19:30:16.236144] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-26T19:30:16.586989] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-26T19:30:16.655002] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:16.711733] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-26T19:30:17.511727] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-26T19:30:17.647338] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T19:30:17.820161] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T19:30:18.311741] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-26T19:30:19.111699] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-26T19:30:19.164604] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-26T19:30:19.419599] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-26T19:30:19.424589] [INFO ] [REMOTE ] IQI: Full fetch complete (27131 records). [2025-09-26T19:30:19.424773] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-26T19:30:19.829699] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-26T19:30:19.829804] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-26T19:30:19.830360] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-26T19:30:19.830406] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-26T19:30:19.831374] [DEBUG] [LOCAL ] IQI: Trimmed 27131 records to 18161 (keeping 200 days of data) [2025-09-26T19:30:19.926156] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-26T19:30:19.964235] [DEBUG] [LOCAL ] IQI: Primary data saved (18161 records). [2025-09-26T19:30:19.964405] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-26T19:30:19.964534] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IQI took 18.1s. Estimated remaining: 2h 46m 27s. Rate: 7.5 symbols/min [2025-09-26T19:30:20.151316] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:20.174728] [DEBUG] [LOCAL ] IRS: Loaded 21983 existing records from primary storage. [2025-09-26T19:30:20.174876] [INFO ] [MAIN ] IRS: Loaded 21983 existing records. [2025-09-26T19:30:20.363995] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:20.364281] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-26T19:30:20.364356] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-26T19:30:20.365011] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-26T19:30:20.365073] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-26T19:30:20.736697] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-26T19:30:20.776028] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:20.845539] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T19:30:21.511698] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-26T19:30:21.836429] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-26T19:30:22.311774] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-26T19:30:22.606801] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-26T19:30:22.725120] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T19:30:23.111725] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-26T19:30:23.911972] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:30:23.912123] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-26T19:30:24.711700] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-26T19:30:24.798211] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:30:25.511738] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-26T19:30:25.617020] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T19:30:26.359537] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-26T19:30:26.385133] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-26T19:30:26.741034] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-26T19:30:27.111730] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-26T19:30:27.911745] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-26T19:30:28.024969] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:30:28.711762] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-26T19:30:28.987770] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T19:30:29.511765] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-26T19:30:29.841749] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T19:30:30.183909] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:30:30.311979] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-26T19:30:30.521778] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-26T19:30:31.111720] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-26T19:30:31.911692] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-26T19:30:32.001815] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T19:30:32.093782] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:30:32.711753] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-26T19:30:33.511729] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-26T19:30:33.727173] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T19:30:33.808797] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-26T19:30:34.311725] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-26T19:30:35.111696] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-26T19:30:35.355243] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-26T19:30:35.391103] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T19:30:35.911716] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-26T19:30:36.711725] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-26T19:30:37.042386] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-26T19:30:37.516896] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-26T19:30:37.545626] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:30:38.311733] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-26T19:30:38.353923] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:30:38.674031] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-26T19:30:39.111727] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-26T19:30:39.911692] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-26T19:30:40.069967] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T19:30:40.178611] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-26T19:30:40.711728] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-26T19:30:41.516817] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-26T19:30:41.537390] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:30:42.311771] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-26T19:30:42.518238] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-26T19:30:42.618961] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T19:30:43.111753] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-26T19:30:43.825532] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-26T19:30:43.911716] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-26T19:30:44.711721] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-26T19:30:44.826954] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-26T19:30:45.511730] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-26T19:30:45.740594] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:30:45.897633] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:30:45.904632] [INFO ] [REMOTE ] IRS: Full fetch complete (32249 records). [2025-09-26T19:30:45.904834] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-26T19:30:46.300822] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-26T19:30:46.300921] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-26T19:30:46.301568] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-26T19:30:46.301612] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-26T19:30:46.302547] [DEBUG] [LOCAL ] IRS: Trimmed 32249 records to 22136 (keeping 200 days of data) [2025-09-26T19:30:46.351312] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-26T19:30:46.435342] [DEBUG] [LOCAL ] IRS: Primary data saved (22136 records). [2025-09-26T19:30:46.435485] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-26T19:30:46.435586] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IRS took 26.5s. Estimated remaining: 2h 46m 39s. Rate: 7.5 symbols/min [2025-09-26T19:30:46.619173] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:46.679752] [DEBUG] [LOCAL ] IRT: Loaded 50769 existing records from primary storage. [2025-09-26T19:30:46.679906] [INFO ] [MAIN ] IRT: Loaded 50769 existing records. [2025-09-26T19:30:46.877849] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:46.878129] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-26T19:30:46.878178] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-26T19:30:46.879879] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-26T19:30:46.879941] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-26T19:30:47.119216] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-26T19:30:47.276831] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:47.401141] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:30:47.411695] [INFO ] [REMOTE ] IR: Full fetch complete (76148 records). [2025-09-26T19:30:47.411862] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-26T19:30:47.837024] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-26T19:30:47.837120] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-26T19:30:47.838107] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-26T19:30:47.838176] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-26T19:30:47.839730] [DEBUG] [LOCAL ] IR: Trimmed 76148 records to 53470 (keeping 200 days of data) [2025-09-26T19:30:47.935593] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-26T19:30:48.193304] [DEBUG] [LOCAL ] IR: Primary data saved (53470 records). [2025-09-26T19:30:48.193614] [INFO ] [MAIN ] IR: Full history saved. [2025-09-26T19:30:48.193768] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IR took 33.4s. Estimated remaining: 2h 46m 24s. Rate: 7.5 symbols/min [2025-09-26T19:30:48.302192] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T19:30:48.349117] [INFO ] [REMOTE ] IQV: Full fetch complete (72257 records). [2025-09-26T19:30:48.359620] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-26T19:30:48.470251] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:48.701968] [DEBUG] [LOCAL ] ISD: Loaded 15685 existing records from primary storage. [2025-09-26T19:30:48.724671] [INFO ] [MAIN ] ISD: Loaded 15685 existing records. [2025-09-26T19:30:48.984104] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-26T19:30:48.984406] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-26T19:30:48.985953] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-26T19:30:48.986097] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-26T19:30:49.070829] [DEBUG] [LOCAL ] IQV: Trimmed 72257 records to 50895 (keeping 200 days of data) [2025-09-26T19:30:49.071146] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:49.071587] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-26T19:30:49.071675] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-26T19:30:49.124792] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-26T19:30:49.134084] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-26T19:30:49.253870] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-26T19:30:49.351595] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-26T19:30:49.646679] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:49.647506] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-26T19:30:49.679169] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:30:49.883041] [DEBUG] [LOCAL ] IQV: Primary data saved (50895 records). [2025-09-26T19:30:49.883202] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-26T19:30:49.883297] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IQV took 37.5s. Estimated remaining: 2h 46m 9s. Rate: 7.5 symbols/min [2025-09-26T19:30:50.060840] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:50.099940] [DEBUG] [LOCAL ] IT: Loaded 41941 existing records from primary storage. [2025-09-26T19:30:50.100144] [INFO ] [MAIN ] IT: Loaded 41941 existing records. [2025-09-26T19:30:50.291089] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:50.291401] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-26T19:30:50.291469] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-26T19:30:50.293530] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-26T19:30:50.293598] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-26T19:30:50.327827] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-26T19:30:50.673953] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:30:50.735370] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:51.111700] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-26T19:30:51.204043] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:30:51.214047] [INFO ] [REMOTE ] IRM: Full fetch complete (72260 records). [2025-09-26T19:30:51.214250] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-26T19:30:51.624040] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-26T19:30:51.624124] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-26T19:30:51.625132] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-26T19:30:51.625297] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-26T19:30:51.626764] [DEBUG] [LOCAL ] IRM: Trimmed 72260 records to 50159 (keeping 200 days of data) [2025-09-26T19:30:51.914544] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-26T19:30:51.956380] [DEBUG] [LOCAL ] IRM: Primary data saved (50159 records). [2025-09-26T19:30:51.956551] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-26T19:30:51.956710] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. IRM took 36.6s. Estimated remaining: 2h 45m 55s. Rate: 7.5 symbols/min [2025-09-26T19:30:52.098071] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-26T19:30:52.181576] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:30:52.214304] [DEBUG] [LOCAL ] ITGR: Loaded 31817 existing records from primary storage. [2025-09-26T19:30:52.214478] [INFO ] [MAIN ] ITGR: Loaded 31817 existing records. [2025-09-26T19:30:52.404154] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:30:52.404539] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-26T19:30:52.404777] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-26T19:30:52.405784] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-26T19:30:52.405846] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-26T19:30:52.543762] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-26T19:30:52.716862] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-26T19:30:52.828188] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:30:52.986916] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T19:30:53.511751] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-26T19:30:54.157729] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T19:30:54.311718] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-26T19:30:54.609469] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-26T19:30:55.111733] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-26T19:30:55.753799] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T19:30:55.911718] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-26T19:30:56.637287] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:30:56.711752] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-26T19:30:57.435884] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-26T19:30:57.511697] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-26T19:30:58.311708] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-26T19:30:58.467424] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-26T19:30:58.913630] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-26T19:30:59.111730] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-26T19:30:59.311134] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-26T19:30:59.911750] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-26T19:31:00.413687] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:31:00.711745] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-26T19:31:01.019757] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T19:31:01.511746] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-26T19:31:01.585132] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T19:31:02.311759] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-26T19:31:02.933941] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T19:31:03.111704] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-26T19:31:03.469353] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-26T19:31:03.911771] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-26T19:31:04.711687] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-26T19:31:04.814340] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T19:31:05.400059] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:31:05.511755] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-26T19:31:06.311739] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-26T19:31:06.687399] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:31:06.722121] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T19:31:07.111781] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-26T19:31:07.911700] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-26T19:31:08.157634] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-26T19:31:08.180015] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-26T19:31:08.711736] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-26T19:31:09.516858] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-26T19:31:09.530310] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-26T19:31:10.252469] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-26T19:31:10.311759] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-26T19:31:11.069717] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-26T19:31:11.111673] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-26T19:31:11.911678] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-26T19:31:12.100185] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-26T19:31:12.711695] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-26T19:31:13.041042] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T19:31:13.050924] [INFO ] [REMOTE ] IT: Full fetch complete (55635 records). [2025-09-26T19:31:13.051142] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-26T19:31:13.521272] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-26T19:31:13.515129] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-26T19:31:13.523607] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:31:13.572911] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-26T19:31:13.573455] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-26T19:31:13.574819] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-26T19:31:13.574927] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-26T19:31:13.576548] [DEBUG] [LOCAL ] IT: Trimmed 55635 records to 42234 (keeping 200 days of data) [2025-09-26T19:31:13.838002] [DEBUG] [LOCAL ] IT: Primary data saved (42234 records). [2025-09-26T19:31:13.838170] [INFO ] [MAIN ] IT: Full history saved. [2025-09-26T19:31:13.838272] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IT took 24.0s. Estimated remaining: 2h 46m 2s. Rate: 7.5 symbols/min [2025-09-26T19:31:14.015779] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:14.062077] [DEBUG] [LOCAL ] ITT: Loaded 33310 existing records from primary storage. [2025-09-26T19:31:14.062222] [INFO ] [MAIN ] ITT: Loaded 33310 existing records. [2025-09-26T19:31:14.252506] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:14.252845] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-26T19:31:14.252899] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-26T19:31:14.254121] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-26T19:31:14.254198] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-26T19:31:14.321107] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-26T19:31:14.629971] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:15.111696] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-26T19:31:15.300296] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-26T19:31:15.838489] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-26T19:31:15.911700] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-26T19:31:16.221233] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-26T19:31:16.711718] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-26T19:31:17.156473] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-26T19:31:17.511737] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-26T19:31:18.154438] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T19:31:18.311742] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-26T19:31:19.111719] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-26T19:31:19.204901] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T19:31:19.215049] [INFO ] [REMOTE ] IRT: Full fetch complete (72483 records). [2025-09-26T19:31:19.215235] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-26T19:31:19.550553] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T19:31:19.651937] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-26T19:31:19.652033] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-26T19:31:19.652999] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-26T19:31:19.653073] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-26T19:31:19.654811] [DEBUG] [LOCAL ] IRT: Trimmed 72483 records to 51146 (keeping 200 days of data) [2025-09-26T19:31:19.918346] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-26T19:31:20.005466] [DEBUG] [LOCAL ] IRT: Primary data saved (51146 records). [2025-09-26T19:31:20.005700] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-26T19:31:20.006757] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. IRT took 33.6s. Estimated remaining: 2h 45m 52s. Rate: 7.5 symbols/min [2025-09-26T19:31:20.184919] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:20.217282] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T19:31:20.268887] [DEBUG] [LOCAL ] ITUB: Loaded 53694 existing records from primary storage. [2025-09-26T19:31:20.269076] [INFO ] [MAIN ] ITUB: Loaded 53694 existing records. [2025-09-26T19:31:20.500443] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:20.500821] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-26T19:31:20.500880] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-26T19:31:20.502457] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-26T19:31:20.502528] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-26T19:31:20.712888] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-26T19:31:20.901323] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:20.962463] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:31:20.965857] [INFO ] [REMOTE ] ISD: Full fetch complete (23916 records). [2025-09-26T19:31:20.965936] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-26T19:31:21.379306] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-26T19:31:21.379401] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-26T19:31:21.379991] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-26T19:31:21.380060] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-26T19:31:21.380974] [DEBUG] [LOCAL ] ISD: Trimmed 23916 records to 15803 (keeping 200 days of data) [2025-09-26T19:31:21.483295] [DEBUG] [LOCAL ] ISD: Primary data saved (15803 records). [2025-09-26T19:31:21.483454] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-26T19:31:21.483549] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. ISD took 33.3s. Estimated remaining: 2h 45m 37s. Rate: 7.5 symbols/min [2025-09-26T19:31:21.517276] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-26T19:31:21.702354] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:21.749072] [DEBUG] [LOCAL ] ITW: Loaded 46541 existing records from primary storage. [2025-09-26T19:31:21.749236] [INFO ] [MAIN ] ITW: Loaded 46541 existing records. [2025-09-26T19:31:21.943419] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:21.943735] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-26T19:31:21.943814] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-26T19:31:21.945326] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-26T19:31:21.945398] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-26T19:31:22.311829] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-26T19:31:22.347929] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:22.435265] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:31:22.441538] [INFO ] [REMOTE ] ITGR: Full fetch complete (41524 records). [2025-09-26T19:31:22.441664] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-26T19:31:22.840015] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-26T19:31:22.840104] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-26T19:31:22.840791] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-26T19:31:22.840856] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-26T19:31:22.841948] [DEBUG] [LOCAL ] ITGR: Trimmed 41524 records to 31996 (keeping 200 days of data) [2025-09-26T19:31:23.042182] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:31:23.070761] [DEBUG] [LOCAL ] ITGR: Primary data saved (31996 records). [2025-09-26T19:31:23.070926] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-26T19:31:23.071023] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITGR took 31.1s. Estimated remaining: 2h 45m 21s. Rate: 7.5 symbols/min [2025-09-26T19:31:23.116976] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-26T19:31:23.280457] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:23.350688] [DEBUG] [LOCAL ] IVR: Loaded 48228 existing records from primary storage. [2025-09-26T19:31:23.350874] [INFO ] [MAIN ] IVR: Loaded 48228 existing records. [2025-09-26T19:31:23.548696] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:23.549152] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-26T19:31:23.549217] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-26T19:31:23.550512] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-26T19:31:23.550593] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-26T19:31:23.917710] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-26T19:31:23.946583] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:24.030093] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T19:31:24.711714] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-26T19:31:24.873214] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-26T19:31:25.408988] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:31:25.511725] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-26T19:31:26.311703] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-26T19:31:26.397849] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-26T19:31:26.927113] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-26T19:31:27.111726] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-26T19:31:27.569460] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-26T19:31:27.911740] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-26T19:31:28.671412] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T19:31:28.711705] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-26T19:31:29.511727] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-26T19:31:29.836208] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T19:31:30.157917] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T19:31:30.311722] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-26T19:31:31.111726] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-26T19:31:31.370358] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T19:31:31.911721] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-26T19:31:32.287732] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T19:31:32.711742] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-26T19:31:33.204049] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-26T19:31:33.511731] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-26T19:31:33.659110] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T19:31:34.317687] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-26T19:31:34.342330] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:31:35.111746] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-26T19:31:35.324051] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T19:31:35.911780] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-26T19:31:36.221049] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T19:31:36.711726] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-26T19:31:36.941277] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:31:37.513377] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-26T19:31:37.519330] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:31:38.311692] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-26T19:31:38.428359] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:31:38.496168] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-26T19:31:39.111713] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-26T19:31:39.911736] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-26T19:31:40.339473] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-26T19:31:40.711686] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-26T19:31:40.901594] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T19:31:41.462264] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:31:41.511727] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-26T19:31:42.054717] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T19:31:42.311738] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-26T19:31:43.111687] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-26T19:31:43.342075] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-26T19:31:43.911731] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-26T19:31:44.231755] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T19:31:44.711724] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-26T19:31:44.858757] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T19:31:44.888769] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-26T19:31:45.511738] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-26T19:31:46.311720] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-26T19:31:46.635698] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:31:47.116849] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-26T19:31:47.139792] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T19:31:47.911741] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-26T19:31:48.007796] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:31:48.594241] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-26T19:31:48.600244] [INFO ] [REMOTE ] ITT: Full fetch complete (46959 records). [2025-09-26T19:31:48.600368] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-26T19:31:48.713518] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-26T19:31:49.009427] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-26T19:31:49.009520] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-26T19:31:49.010304] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-26T19:31:49.010370] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-26T19:31:49.013367] [DEBUG] [LOCAL ] ITT: Trimmed 46959 records to 33511 (keeping 200 days of data) [2025-09-26T19:31:49.246978] [DEBUG] [LOCAL ] ITT: Primary data saved (33511 records). [2025-09-26T19:31:49.247135] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-26T19:31:49.247330] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITT took 35.4s. Estimated remaining: 2h 45m 33s. Rate: 7.5 symbols/min [2025-09-26T19:31:49.427580] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:49.475546] [DEBUG] [LOCAL ] IVT: Loaded 31117 existing records from primary storage. [2025-09-26T19:31:49.475713] [INFO ] [MAIN ] IVT: Loaded 31117 existing records. [2025-09-26T19:31:49.521287] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-26T19:31:49.672052] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:49.672497] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-26T19:31:49.672589] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-26T19:31:49.673790] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-26T19:31:49.673856] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-26T19:31:50.026622] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-26T19:31:50.128631] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:50.311741] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-26T19:31:50.532422] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:31:50.545991] [INFO ] [REMOTE ] ITW: Full fetch complete (66445 records). [2025-09-26T19:31:50.546194] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-26T19:31:51.019673] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-26T19:31:51.019819] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-26T19:31:51.021233] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-26T19:31:51.021333] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-26T19:31:51.026576] [DEBUG] [LOCAL ] ITW: Trimmed 66445 records to 46782 (keeping 200 days of data) [2025-09-26T19:31:51.131012] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-26T19:31:51.351784] [DEBUG] [LOCAL ] ITW: Primary data saved (46782 records). [2025-09-26T19:31:51.352004] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-26T19:31:51.352149] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. ITW took 29.9s. Estimated remaining: 2h 45m 19s. Rate: 7.5 symbols/min [2025-09-26T19:31:51.559176] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:51.596096] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T19:31:51.687088] [DEBUG] [LOCAL ] IVZ: Loaded 53522 existing records from primary storage. [2025-09-26T19:31:51.687285] [INFO ] [MAIN ] IVZ: Loaded 53522 existing records. [2025-09-26T19:31:51.913803] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-26T19:31:51.964549] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:51.965058] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-26T19:31:51.965139] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-26T19:31:51.966667] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-26T19:31:51.966746] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-26T19:31:52.366255] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:52.398626] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T19:31:52.412184] [INFO ] [REMOTE ] ITUB: Full fetch complete (77169 records). [2025-09-26T19:31:52.412351] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-26T19:31:52.719737] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-26T19:31:52.722042] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T19:31:52.879751] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-26T19:31:52.879863] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-26T19:31:52.880918] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-26T19:31:52.880989] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-26T19:31:52.882719] [DEBUG] [LOCAL ] ITUB: Trimmed 77169 records to 54084 (keeping 200 days of data) [2025-09-26T19:31:53.244379] [DEBUG] [LOCAL ] ITUB: Primary data saved (54084 records). [2025-09-26T19:31:53.244557] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-26T19:31:53.245333] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. ITUB took 33.2s. Estimated remaining: 2h 45m 4s. Rate: 7.5 symbols/min [2025-09-26T19:31:53.425598] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:53.458966] [DEBUG] [LOCAL ] IX: Loaded 22798 existing records from primary storage. [2025-09-26T19:31:53.459219] [INFO ] [MAIN ] IX: Loaded 22798 existing records. [2025-09-26T19:31:53.524889] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-26T19:31:53.665014] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:53.665331] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-26T19:31:53.665408] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-26T19:31:53.666168] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-26T19:31:53.666233] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-26T19:31:54.071465] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:54.109686] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-26T19:31:54.311733] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-26T19:31:54.684191] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-26T19:31:54.717979] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-26T19:31:55.084425] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-26T19:31:55.111732] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-26T19:31:55.911716] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-26T19:31:56.689448] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:31:56.711680] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-26T19:31:57.511767] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-26T19:31:57.787547] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:31:57.797436] [INFO ] [REMOTE ] IVR: Full fetch complete (69005 records). [2025-09-26T19:31:57.797602] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-26T19:31:58.252183] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-26T19:31:58.259551] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-26T19:31:58.259316] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T19:31:58.260891] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-26T19:31:58.261412] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-26T19:31:58.277355] [DEBUG] [LOCAL ] IVR: Trimmed 69005 records to 48557 (keeping 200 days of data) [2025-09-26T19:31:58.302325] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:31:58.312499] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-26T19:31:58.612806] [DEBUG] [LOCAL ] IVR: Primary data saved (48557 records). [2025-09-26T19:31:58.612974] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-26T19:31:58.613072] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVR took 35.5s. Estimated remaining: 2h 44m 53s. Rate: 7.5 symbols/min [2025-09-26T19:31:58.824099] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:31:58.870158] [DEBUG] [LOCAL ] J: Loaded 40657 existing records from primary storage. [2025-09-26T19:31:58.870312] [INFO ] [MAIN ] J: Loaded 40657 existing records. [2025-09-26T19:31:59.067473] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:31:59.067804] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-26T19:31:59.067864] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-26T19:31:59.069193] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-26T19:31:59.069263] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-26T19:31:59.116905] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-26T19:31:59.425234] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-26T19:31:59.459460] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:31:59.911730] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-26T19:32:00.328175] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T19:32:00.711718] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-26T19:32:01.496805] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T19:32:01.511682] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-26T19:32:01.850693] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:32:02.311726] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-26T19:32:03.101114] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:32:03.111664] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-26T19:32:03.517476] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T19:32:03.911721] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-26T19:32:04.632531] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:32:04.711724] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-26T19:32:05.275218] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-26T19:32:05.511753] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-26T19:32:06.007168] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:32:06.311748] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-26T19:32:07.076603] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:32:07.111703] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-26T19:32:07.911703] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-26T19:32:08.249749] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:32:08.685992] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T19:32:08.711715] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-26T19:32:09.186121] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-26T19:32:09.511725] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-26T19:32:10.311712] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-26T19:32:10.383429] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:32:10.620163] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:32:11.111742] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-26T19:32:11.911736] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-26T19:32:12.181223] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T19:32:12.384133] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T19:32:12.711727] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-26T19:32:13.451714] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T19:32:13.511742] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-26T19:32:13.907241] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-26T19:32:14.311760] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-26T19:32:14.932162] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T19:32:15.111750] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-26T19:32:15.329147] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-26T19:32:15.911718] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-26T19:32:16.434061] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T19:32:16.711748] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-26T19:32:17.507756] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:32:17.518096] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-26T19:32:18.257377] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:32:18.311693] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-26T19:32:18.637017] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-26T19:32:18.641107] [INFO ] [REMOTE ] IX: Full fetch complete (27070 records). [2025-09-26T19:32:18.641238] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-26T19:32:19.044599] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-26T19:32:19.044714] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-26T19:32:19.045280] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-26T19:32:19.045342] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-26T19:32:19.046115] [DEBUG] [LOCAL ] IX: Trimmed 27070 records to 22926 (keeping 200 days of data) [2025-09-26T19:32:19.115720] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-26T19:32:19.199092] [DEBUG] [LOCAL ] IX: Primary data saved (22926 records). [2025-09-26T19:32:19.199233] [INFO ] [MAIN ] IX: Full history saved. [2025-09-26T19:32:19.199344] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IX took 26.0s. Estimated remaining: 2h 44m 59s. Rate: 7.5 symbols/min [2025-09-26T19:32:19.381133] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:19.432745] [DEBUG] [LOCAL ] JBGS: Loaded 42776 existing records from primary storage. [2025-09-26T19:32:19.432895] [INFO ] [MAIN ] JBGS: Loaded 42776 existing records. [2025-09-26T19:32:19.637120] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:32:19.637661] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-26T19:32:19.637789] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-26T19:32:19.640211] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-26T19:32:19.640280] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-26T19:32:19.915322] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-26T19:32:20.069666] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:20.076000] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:32:20.463948] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T19:32:20.711718] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-26T19:32:21.511705] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-26T19:32:21.915263] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-26T19:32:22.161229] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T19:32:22.311733] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-26T19:32:22.894949] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:32:22.901998] [INFO ] [REMOTE ] IVT: Full fetch complete (45555 records). [2025-09-26T19:32:22.902170] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-26T19:32:23.118058] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-26T19:32:23.322207] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-26T19:32:23.322307] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-26T19:32:23.323133] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-26T19:32:23.323205] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-26T19:32:23.324478] [DEBUG] [LOCAL ] IVT: Trimmed 45555 records to 31325 (keeping 200 days of data) [2025-09-26T19:32:23.556088] [DEBUG] [LOCAL ] IVT: Primary data saved (31325 records). [2025-09-26T19:32:23.556286] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-26T19:32:23.556400] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. IVT took 34.3s. Estimated remaining: 2h 44m 47s. Rate: 7.5 symbols/min [2025-09-26T19:32:23.759467] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:23.803689] [DEBUG] [LOCAL ] JBI: Loaded 44143 existing records from primary storage. [2025-09-26T19:32:23.803858] [INFO ] [MAIN ] JBI: Loaded 44143 existing records. [2025-09-26T19:32:23.916175] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-26T19:32:24.004076] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:32:24.004374] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-26T19:32:24.004425] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-26T19:32:24.006151] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-26T19:32:24.006223] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-26T19:32:24.405781] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:24.443638] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-26T19:32:24.542429] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T19:32:24.711733] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-26T19:32:25.511734] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-26T19:32:25.563827] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:32:25.572465] [INFO ] [REMOTE ] J: Full fetch complete (59082 records). [2025-09-26T19:32:25.572636] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-26T19:32:26.034047] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-26T19:32:26.034287] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-26T19:32:26.035155] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-26T19:32:26.035246] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-26T19:32:26.059911] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T19:32:26.060097] [DEBUG] [LOCAL ] J: Trimmed 59082 records to 40873 (keeping 200 days of data) [2025-09-26T19:32:26.313780] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-26T19:32:26.351537] [DEBUG] [LOCAL ] J: Primary data saved (40873 records). [2025-09-26T19:32:26.351726] [INFO ] [MAIN ] J: Full history saved. [2025-09-26T19:32:26.352086] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. J took 27.7s. Estimated remaining: 2h 44m 33s. Rate: 7.5 symbols/min [2025-09-26T19:32:26.552794] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:26.600009] [DEBUG] [LOCAL ] JBL: Loaded 48770 existing records from primary storage. [2025-09-26T19:32:26.600179] [INFO ] [MAIN ] JBL: Loaded 48770 existing records. [2025-09-26T19:32:26.809114] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:32:26.809592] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-26T19:32:26.809704] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-26T19:32:26.811591] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-26T19:32:26.811693] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-26T19:32:27.118791] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-26T19:32:27.142918] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:32:27.259563] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:27.793488] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-26T19:32:27.911742] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-26T19:32:28.711785] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-26T19:32:28.854866] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:32:29.511709] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-26T19:32:29.630945] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:32:30.038864] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-26T19:32:30.311739] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-26T19:32:31.116247] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-26T19:32:31.122430] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:32:31.852269] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T19:32:31.911732] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-26T19:32:32.603193] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:32:32.711713] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-26T19:32:33.162055] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-26T19:32:33.511731] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-26T19:32:34.271841] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:32:34.311738] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-26T19:32:35.111689] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-26T19:32:35.456187] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:32:35.466903] [INFO ] [REMOTE ] IVZ: Full fetch complete (76766 records). [2025-09-26T19:32:35.467112] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-26T19:32:35.939239] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-26T19:32:35.940790] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-26T19:32:35.941466] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-26T19:32:35.944766] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-26T19:32:35.943156] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:32:35.944999] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-26T19:32:35.956701] [DEBUG] [LOCAL ] IVZ: Trimmed 76766 records to 53908 (keeping 200 days of data) [2025-09-26T19:32:36.320769] [DEBUG] [LOCAL ] IVZ: Primary data saved (53908 records). [2025-09-26T19:32:36.321248] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-26T19:32:36.321421] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. IVZ took 45.0s. Estimated remaining: 2h 44m 27s. Rate: 7.5 symbols/min [2025-09-26T19:32:36.521585] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:36.521845] [DEBUG] [LOCAL ] JBND: No existing data file found in primary storage. [2025-09-26T19:32:36.521902] [WARN ] [MAIN ] JBND: No existing data found, performing full refresh instead. [2025-09-26T19:32:36.522016] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-26T19:32:36.522056] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-26T19:32:36.522097] [DEBUG] [LOCAL ] JBND: No primary data file found to delete. [2025-09-26T19:32:36.522130] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-26T19:32:36.715012] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-26T19:32:36.989962] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:36.994808] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-26T19:32:37.469966] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T19:32:37.511720] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-26T19:32:38.311716] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-26T19:32:38.362364] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T19:32:39.111697] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-26T19:32:39.224066] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T19:32:39.911697] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-26T19:32:40.242334] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-26T19:32:40.711728] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-26T19:32:40.789815] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T19:32:40.798875] [INFO ] [REMOTE ] JBGS: Full fetch complete (59102 records). [2025-09-26T19:32:40.799038] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-26T19:32:41.217015] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-26T19:32:41.217116] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-26T19:32:41.217935] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-26T19:32:41.218002] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-26T19:32:41.219349] [DEBUG] [LOCAL ] JBGS: Trimmed 59102 records to 43089 (keeping 200 days of data) [2025-09-26T19:32:41.491688] [DEBUG] [LOCAL ] JBGS: Primary data saved (43089 records). [2025-09-26T19:32:41.491838] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-26T19:32:41.493283] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBGS took 22.3s. Estimated remaining: 2h 44m 16s. Rate: 7.5 symbols/min [2025-09-26T19:32:41.516964] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-26T19:32:41.709421] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:41.710135] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-26T19:32:41.710616] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-26T19:32:41.712437] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T19:32:41.712873] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-26T19:32:41.712949] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-26T19:32:41.722967] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-26T19:32:41.723162] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-26T19:32:42.121703] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:42.311695] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-26T19:32:42.707084] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:32:42.809966] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-26T19:32:43.111725] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-26T19:32:43.312813] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:43.313166] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-26T19:32:43.859032] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:32:43.911694] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-26T19:32:44.711804] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-26T19:32:44.861425] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T19:32:45.511741] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-26T19:32:46.316495] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-26T19:32:46.320175] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T19:32:46.461925] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-26T19:32:46.536229] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:46.536569] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-26T19:32:47.111728] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-26T19:32:47.911717] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-26T19:32:48.124126] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:48.124627] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-26T19:32:48.667072] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-26T19:32:48.711709] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-26T19:32:49.511731] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-26T19:32:50.311726] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-26T19:32:50.458992] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T19:32:50.518050] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T19:32:51.111722] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-26T19:32:51.555415] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-26T19:32:51.911740] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-26T19:32:52.435330] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-26T19:32:52.711733] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-26T19:32:53.481857] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-26T19:32:53.489573] [INFO ] [REMOTE ] JBI: Full fetch complete (64439 records). [2025-09-26T19:32:53.489752] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-26T19:32:53.521469] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-26T19:32:53.930520] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-26T19:32:53.930668] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-26T19:32:53.931926] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-26T19:32:53.932330] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-26T19:32:53.949432] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-26T19:32:53.954986] [DEBUG] [LOCAL ] JBI: Trimmed 64439 records to 44362 (keeping 200 days of data) [2025-09-26T19:32:54.216219] [DEBUG] [LOCAL ] JBI: Primary data saved (44362 records). [2025-09-26T19:32:54.216391] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-26T19:32:54.216585] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBI took 30.7s. Estimated remaining: 2h 44m 13s. Rate: 7.5 symbols/min [2025-09-26T19:32:54.318350] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-26T19:32:54.408163] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:32:54.408345] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-26T19:32:54.408445] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-26T19:32:54.408604] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-26T19:32:54.408672] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-26T19:32:54.408748] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-26T19:32:54.408790] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-26T19:32:54.638014] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:54.672971] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-26T19:32:54.794961] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:32:55.111745] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-26T19:32:55.322510] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:55.323002] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-26T19:32:55.364018] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T19:32:55.911758] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-26T19:32:56.711779] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-26T19:32:56.914583] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:56.914941] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-26T19:32:57.233140] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-26T19:32:57.511748] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-26T19:32:57.740816] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:32:57.741153] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-26T19:32:58.311764] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-26T19:32:59.111753] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-26T19:32:59.911755] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-26T19:33:00.055782] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:33:00.116314] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T19:33:00.711777] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-26T19:33:01.165966] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-26T19:33:01.394018] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-26T19:33:01.511724] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-26T19:33:02.311746] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-26T19:33:02.753722] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-26T19:33:03.111741] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-26T19:33:03.918006] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-26T19:33:03.935099] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T19:33:04.540351] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T19:33:04.711746] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-26T19:33:05.511741] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-26T19:33:05.887360] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T19:33:05.898379] [INFO ] [REMOTE ] JBL: Full fetch complete (70128 records). [2025-09-26T19:33:05.898735] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-26T19:33:06.310660] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-26T19:33:06.310814] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-26T19:33:06.312146] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-26T19:33:06.312319] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-26T19:33:06.312245] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-26T19:33:06.315141] [DEBUG] [LOCAL ] JBL: Trimmed 70128 records to 49145 (keeping 200 days of data) [2025-09-26T19:33:06.654772] [DEBUG] [LOCAL ] JBL: Primary data saved (49145 records). [2025-09-26T19:33:06.655007] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-26T19:33:06.655284] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBL took 40.3s. Estimated remaining: 2h 44m 10s. Rate: 7.5 symbols/min [2025-09-26T19:33:06.852862] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-26T19:33:06.897369] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:06.912014] [DEBUG] [LOCAL ] JCE: Loaded 6504 existing records from primary storage. [2025-09-26T19:33:06.912262] [INFO ] [MAIN ] JCE: Loaded 6504 existing records. [2025-09-26T19:33:07.126032] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-26T19:33:07.173830] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:07.174819] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-26T19:33:07.175132] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-26T19:33:07.189313] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-26T19:33:07.209690] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-26T19:33:07.273812] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:33:07.620188] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T19:33:07.705722] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:07.911932] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-26T19:33:08.711771] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-26T19:33:09.160738] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-26T19:33:09.161683] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-26T19:33:09.179479] [INFO ] [REMOTE ] JBS: Full fetch complete (27521 records). [2025-09-26T19:33:09.179996] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-26T19:33:09.404168] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-26T19:33:09.405561] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:33:09.409380] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:33:09.409581] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:33:09.416683] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-26T19:33:09.417005] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-26T19:33:09.417471] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-26T19:33:09.417794] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-26T19:33:09.417958] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBS took 27.9s. Estimated remaining: 2h 43m 56s. Rate: 7.5 symbols/min [2025-09-26T19:33:09.418257] [INFO ] [REMOTE ] JBND: Full fetch complete (33727 records). [2025-09-26T19:33:09.463323] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-26T19:33:09.516879] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-26T19:33:09.728366] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:10.063873] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-26T19:33:10.063976] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-26T19:33:10.064979] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-26T19:33:10.065056] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-26T19:33:10.066456] [DEBUG] [LOCAL ] JBND: Trimmed 33727 records to 26051 (keeping 200 days of data) [2025-09-26T19:33:10.191161] [DEBUG] [LOCAL ] JCI: Loaded 53937 existing records from primary storage. [2025-09-26T19:33:10.195702] [INFO ] [MAIN ] JCI: Loaded 53937 existing records. [2025-09-26T19:33:10.313855] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-26T19:33:10.452510] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:10.453667] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-26T19:33:10.453759] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-26T19:33:10.465809] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-26T19:33:10.466838] [DEBUG] [LOCAL ] JBND: Primary data saved (26051 records). [2025-09-26T19:33:10.467311] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-26T19:33:10.467195] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-26T19:33:10.467563] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JBND took 34.1s. Estimated remaining: 2h 43m 41s. Rate: 7.5 symbols/min [2025-09-26T19:33:10.998747] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:11.054192] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T19:33:11.100994] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:11.123864] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-26T19:33:11.133017] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-26T19:33:11.180237] [DEBUG] [LOCAL ] JEF: Loaded 50382 existing records from primary storage. [2025-09-26T19:33:11.180435] [INFO ] [MAIN ] JEF: Loaded 50382 existing records. [2025-09-26T19:33:11.364937] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:11.365197] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-26T19:33:11.365246] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-26T19:33:11.367027] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-26T19:33:11.367093] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-26T19:33:11.654149] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-26T19:33:11.785106] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:11.911764] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-26T19:33:12.711776] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-26T19:33:13.511714] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-26T19:33:13.714921] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T19:33:14.027680] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T19:33:14.311768] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-26T19:33:15.114861] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-26T19:33:15.121066] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-26T19:33:15.263804] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-26T19:33:15.911796] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-26T19:33:16.711798] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-26T19:33:16.971468] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-26T19:33:17.358856] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-26T19:33:17.511708] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-26T19:33:17.648947] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T19:33:18.311753] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-26T19:33:18.514593] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-26T19:33:19.111760] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-26T19:33:19.835705] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:33:19.911769] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-26T19:33:20.538098] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T19:33:20.544990] [INFO ] [REMOTE ] JBTM: Full fetch complete (42431 records). [2025-09-26T19:33:20.545163] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-26T19:33:20.712668] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-26T19:33:20.748758] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-26T19:33:20.749358] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:33:20.749433] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:33:20.749521] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-26T19:33:20.749615] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-26T19:33:20.749692] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-26T19:33:20.749754] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-26T19:33:20.749832] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JBTM took 26.5s. Estimated remaining: 2h 43m 35s. Rate: 7.5 symbols/min [2025-09-26T19:33:20.925820] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:20.972209] [DEBUG] [LOCAL ] JELD: Loaded 46491 existing records from primary storage. [2025-09-26T19:33:20.972423] [INFO ] [MAIN ] JELD: Loaded 46491 existing records. [2025-09-26T19:33:21.160861] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:21.161225] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-26T19:33:21.161280] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-26T19:33:21.162487] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-26T19:33:21.162557] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-26T19:33:21.517276] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-26T19:33:21.594361] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:21.740520] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:33:21.768490] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-26T19:33:22.311787] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-26T19:33:23.111711] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-26T19:33:23.446378] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-26T19:33:23.706274] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T19:33:23.769695] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-26T19:33:23.911721] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-26T19:33:24.707278] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-26T19:33:24.711637] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-26T19:33:25.432754] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-26T19:33:25.511749] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-26T19:33:26.201665] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-26T19:33:26.311729] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-26T19:33:27.111722] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-26T19:33:27.911708] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-26T19:33:28.014559] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-26T19:33:28.017479] [INFO ] [REMOTE ] JCE: Full fetch complete (9143 records). [2025-09-26T19:33:28.017629] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-26T19:33:28.424557] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-26T19:33:28.424817] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-26T19:33:28.425114] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-26T19:33:28.425162] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-26T19:33:28.425781] [DEBUG] [LOCAL ] JCE: Trimmed 9143 records to 6591 (keeping 200 days of data) [2025-09-26T19:33:28.560564] [DEBUG] [LOCAL ] JCE: Primary data saved (6591 records). [2025-09-26T19:33:28.561236] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-26T19:33:28.565893] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JCE took 21.9s. Estimated remaining: 2h 43m 27s. Rate: 7.5 symbols/min [2025-09-26T19:33:28.565684] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-26T19:33:28.716989] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-26T19:33:28.767828] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:28.779358] [DEBUG] [LOCAL ] JEQ: Loaded 9203 existing records from primary storage. [2025-09-26T19:33:28.780052] [INFO ] [MAIN ] JEQ: Loaded 9203 existing records. [2025-09-26T19:33:28.961608] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:28.962042] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-26T19:33:28.962100] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-26T19:33:28.962611] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-26T19:33:28.962708] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-26T19:33:29.335063] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:29.419271] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:33:29.511719] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-26T19:33:29.659506] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-26T19:33:30.136545] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T19:33:30.311726] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-26T19:33:30.940136] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-26T19:33:31.111729] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-26T19:33:31.722010] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-26T19:33:31.911722] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-26T19:33:32.711721] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-26T19:33:33.276816] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T19:33:33.511736] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-26T19:33:34.311727] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-26T19:33:34.462827] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T19:33:35.059565] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-26T19:33:35.111726] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-26T19:33:35.131593] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-26T19:33:35.911737] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-26T19:33:36.711725] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-26T19:33:36.833502] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:33:37.320372] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:33:37.511735] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-26T19:33:38.311725] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-26T19:33:38.663801] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-26T19:33:38.844675] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-26T19:33:39.111744] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-26T19:33:39.259618] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-26T19:33:39.911729] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-26T19:33:40.711713] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-26T19:33:40.863518] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-26T19:33:41.511697] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-26T19:33:41.556106] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:33:41.693743] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T19:33:42.311725] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-26T19:33:43.123150] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-26T19:33:43.129701] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T19:33:43.725195] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T19:33:43.738721] [INFO ] [REMOTE ] JEF: Full fetch complete (72893 records). [2025-09-26T19:33:43.738982] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-26T19:33:43.870699] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-26T19:33:43.911938] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-26T19:33:44.191179] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-26T19:33:44.191391] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-26T19:33:44.192356] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-26T19:33:44.192459] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-26T19:33:44.196840] [DEBUG] [LOCAL ] JEF: Trimmed 72893 records to 50763 (keeping 200 days of data) [2025-09-26T19:33:44.521046] [DEBUG] [LOCAL ] JEF: Primary data saved (50763 records). [2025-09-26T19:33:44.521194] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-26T19:33:44.521352] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JEF took 34.0s. Estimated remaining: 2h 43m 27s. Rate: 7.5 symbols/min [2025-09-26T19:33:44.702672] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:44.711707] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-26T19:33:44.738359] [DEBUG] [LOCAL ] JFR: Loaded 30635 existing records from primary storage. [2025-09-26T19:33:44.738507] [INFO ] [MAIN ] JFR: Loaded 30635 existing records. [2025-09-26T19:33:44.927907] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:44.928209] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-26T19:33:44.928265] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-26T19:33:44.929355] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-26T19:33:44.929432] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-26T19:33:45.312006] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:45.511761] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-26T19:33:46.010261] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-26T19:33:46.311736] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-26T19:33:47.000077] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-26T19:33:47.111725] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-26T19:33:47.224888] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:33:47.415500] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T19:33:47.911727] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-26T19:33:48.711736] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-26T19:33:48.886133] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:33:48.886408] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T19:33:49.511790] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-26T19:33:50.013888] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T19:33:50.311731] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-26T19:33:51.111761] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-26T19:33:51.652102] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T19:33:51.663940] [INFO ] [REMOTE ] JCI: Full fetch complete (77414 records). [2025-09-26T19:33:51.664128] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-26T19:33:51.915725] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-26T19:33:52.158912] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-26T19:33:52.165035] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T19:33:52.164338] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-26T19:33:52.172347] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T19:33:52.174037] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-26T19:33:52.174192] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-26T19:33:52.192539] [DEBUG] [LOCAL ] JCI: Trimmed 77414 records to 54327 (keeping 200 days of data) [2025-09-26T19:33:52.578495] [DEBUG] [LOCAL ] JCI: Primary data saved (54327 records). [2025-09-26T19:33:52.578692] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-26T19:33:52.578797] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JCI took 43.2s. Estimated remaining: 2h 43m 19s. Rate: 7.5 symbols/min [2025-09-26T19:33:52.716838] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-26T19:33:52.768530] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:52.783891] [DEBUG] [LOCAL ] JGH: Loaded 11018 existing records from primary storage. [2025-09-26T19:33:52.784101] [INFO ] [MAIN ] JGH: Loaded 11018 existing records. [2025-09-26T19:33:52.976093] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:52.976346] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-26T19:33:52.976411] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-26T19:33:52.976977] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-26T19:33:52.977038] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-26T19:33:53.367529] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:53.443950] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:33:53.511741] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-26T19:33:53.746892] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-26T19:33:53.749462] [INFO ] [REMOTE ] JEQ: Full fetch complete (11578 records). [2025-09-26T19:33:53.749560] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-26T19:33:54.151517] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-26T19:33:54.151622] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-26T19:33:54.152034] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-26T19:33:54.152099] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-26T19:33:54.152722] [DEBUG] [LOCAL ] JEQ: Trimmed 11578 records to 9336 (keeping 200 days of data) [2025-09-26T19:33:54.216118] [DEBUG] [LOCAL ] JEQ: Primary data saved (9336 records). [2025-09-26T19:33:54.216313] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-26T19:33:54.216454] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JEQ took 25.7s. Estimated remaining: 2h 43m 5s. Rate: 7.5 symbols/min [2025-09-26T19:33:54.316916] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-26T19:33:54.414588] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:54.485221] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-26T19:33:54.489487] [DEBUG] [LOCAL ] JHG: Loaded 48212 existing records from primary storage. [2025-09-26T19:33:54.490558] [INFO ] [MAIN ] JHG: Loaded 48212 existing records. [2025-09-26T19:33:54.684198] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:54.684568] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-26T19:33:54.684629] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-26T19:33:54.686121] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-26T19:33:54.686189] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-26T19:33:55.058071] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:55.111714] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-26T19:33:55.911703] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-26T19:33:56.065579] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-26T19:33:56.075364] [INFO ] [REMOTE ] JELD: Full fetch complete (63695 records). [2025-09-26T19:33:56.075521] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-26T19:33:56.479122] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-26T19:33:56.479238] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-26T19:33:56.480100] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-26T19:33:56.480163] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-26T19:33:56.481552] [DEBUG] [LOCAL ] JELD: Trimmed 63695 records to 46791 (keeping 200 days of data) [2025-09-26T19:33:56.711795] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-26T19:33:56.730759] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-26T19:33:56.784431] [DEBUG] [LOCAL ] JELD: Primary data saved (46791 records). [2025-09-26T19:33:56.784578] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-26T19:33:56.784705] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JELD took 36.0s. Estimated remaining: 2h 42m 51s. Rate: 7.5 symbols/min [2025-09-26T19:33:56.967635] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:33:56.975067] [DEBUG] [LOCAL ] JHI: Loaded 3617 existing records from primary storage. [2025-09-26T19:33:56.999053] [INFO ] [MAIN ] JHI: Loaded 3617 existing records. [2025-09-26T19:33:57.072811] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-26T19:33:57.208069] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:33:57.208342] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-26T19:33:57.208393] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-26T19:33:57.208723] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-26T19:33:57.208785] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-26T19:33:57.516887] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-26T19:33:57.593408] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:33:58.250906] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:33:58.311738] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-26T19:33:58.799265] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T19:33:59.111738] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-26T19:33:59.173562] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-26T19:33:59.911728] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-26T19:34:00.667157] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:34:00.667402] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-26T19:34:00.711688] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-26T19:34:01.511745] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-26T19:34:02.311698] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-26T19:34:02.513034] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:34:02.850412] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-26T19:34:03.090878] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:34:03.111701] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-26T19:34:03.911726] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-26T19:34:04.711701] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-26T19:34:04.823895] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T19:34:04.852586] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-26T19:34:05.304303] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-26T19:34:05.511729] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-26T19:34:06.311727] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-26T19:34:06.943490] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T19:34:07.063768] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-26T19:34:07.111690] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-26T19:34:07.911701] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-26T19:34:08.051563] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-26T19:34:08.577089] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-26T19:34:08.711740] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-26T19:34:09.511732] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-26T19:34:10.311734] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-26T19:34:10.490312] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-26T19:34:10.761458] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-26T19:34:11.105384] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T19:34:11.111668] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-26T19:34:11.794135] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T19:34:11.911725] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-26T19:34:12.497938] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-26T19:34:12.711730] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-26T19:34:13.281441] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-26T19:34:13.511734] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-26T19:34:14.311718] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-26T19:34:14.364065] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T19:34:14.919266] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T19:34:15.111725] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-26T19:34:15.911732] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-26T19:34:16.451596] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T19:34:16.547186] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:34:16.711746] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-26T19:34:17.511770] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-26T19:34:17.680844] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-26T19:34:17.682673] [INFO ] [REMOTE ] JHI: Full fetch complete (5261 records). [2025-09-26T19:34:17.682755] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-26T19:34:18.095841] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-26T19:34:18.095997] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-26T19:34:18.096201] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-26T19:34:18.096244] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-26T19:34:18.096712] [DEBUG] [LOCAL ] JHI: Trimmed 5261 records to 3641 (keeping 200 days of data) [2025-09-26T19:34:18.121716] [DEBUG] [LOCAL ] JHI: Primary data saved (3641 records). [2025-09-26T19:34:18.121830] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-26T19:34:18.121937] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JHI took 21.3s. Estimated remaining: 2h 42m 57s. Rate: 7.5 symbols/min [2025-09-26T19:34:18.296267] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:34:18.301510] [DEBUG] [LOCAL ] JHS: Loaded 2864 existing records from primary storage. [2025-09-26T19:34:18.301606] [INFO ] [MAIN ] JHS: Loaded 2864 existing records. [2025-09-26T19:34:18.316944] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-26T19:34:18.492225] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:34:18.492585] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-26T19:34:18.492635] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-26T19:34:18.493002] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-26T19:34:18.493064] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-26T19:34:18.887473] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:34:19.118562] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-26T19:34:19.148116] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:34:19.725262] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T19:34:19.911768] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-26T19:34:19.956139] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T19:34:20.711772] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-26T19:34:20.996215] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T19:34:21.301759] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T19:34:21.511735] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-26T19:34:22.079466] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T19:34:22.311723] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-26T19:34:23.111684] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-26T19:34:23.193256] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T19:34:23.578412] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-26T19:34:23.911721] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-26T19:34:24.711711] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-26T19:34:24.922449] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T19:34:24.925567] [INFO ] [REMOTE ] JGH: Full fetch complete (14868 records). [2025-09-26T19:34:24.925674] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-26T19:34:25.317981] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-26T19:34:25.318101] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-26T19:34:25.318511] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-26T19:34:25.318576] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-26T19:34:25.319184] [DEBUG] [LOCAL ] JGH: Trimmed 14868 records to 11064 (keeping 200 days of data) [2025-09-26T19:34:25.388451] [DEBUG] [LOCAL ] JGH: Primary data saved (11064 records). [2025-09-26T19:34:25.388596] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-26T19:34:25.388759] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JGH took 32.8s. Estimated remaining: 2h 42m 48s. Rate: 7.5 symbols/min [2025-09-26T19:34:25.516881] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-26T19:34:25.578133] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:34:25.633775] [DEBUG] [LOCAL ] JHX: Loaded 50827 existing records from primary storage. [2025-09-26T19:34:25.633999] [INFO ] [MAIN ] JHX: Loaded 50827 existing records. [2025-09-26T19:34:25.845358] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:34:25.845607] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-26T19:34:25.845682] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-26T19:34:25.847112] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-26T19:34:25.847174] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-26T19:34:26.118505] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-26T19:34:26.270179] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:34:26.272145] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T19:34:26.279368] [INFO ] [REMOTE ] JFR: Full fetch complete (48182 records). [2025-09-26T19:34:26.279499] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-26T19:34:26.316992] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-26T19:34:26.691888] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-26T19:34:26.691985] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-26T19:34:26.692836] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-26T19:34:26.692903] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-26T19:34:26.693965] [DEBUG] [LOCAL ] JFR: Trimmed 48182 records to 30975 (keeping 200 days of data) [2025-09-26T19:34:26.896014] [DEBUG] [LOCAL ] JFR: Primary data saved (30975 records). [2025-09-26T19:34:26.896167] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-26T19:34:26.896280] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JFR took 42.4s. Estimated remaining: 2h 42m 33s. Rate: 7.5 symbols/min [2025-09-26T19:34:27.079457] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:34:27.098397] [DEBUG] [LOCAL ] JILL: Loaded 16873 existing records from primary storage. [2025-09-26T19:34:27.098570] [INFO ] [MAIN ] JILL: Loaded 16873 existing records. [2025-09-26T19:34:27.120441] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-26T19:34:27.289823] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:34:27.290114] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-26T19:34:27.290172] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-26T19:34:27.290858] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-26T19:34:27.290931] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-26T19:34:27.673245] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:34:27.674137] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-26T19:34:27.911730] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-26T19:34:28.072512] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T19:34:28.711783] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-26T19:34:29.102103] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-26T19:34:29.511749] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-26T19:34:30.257628] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-26T19:34:30.311728] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-26T19:34:30.355104] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T19:34:31.111730] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-26T19:34:31.667351] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-26T19:34:31.838503] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-26T19:34:31.911685] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-26T19:34:32.711717] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-26T19:34:33.511727] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-26T19:34:33.601726] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-26T19:34:33.611174] [INFO ] [REMOTE ] JHG: Full fetch complete (68352 records). [2025-09-26T19:34:33.611349] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-26T19:34:33.768139] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-26T19:34:34.147861] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-26T19:34:34.147976] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-26T19:34:34.149006] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-26T19:34:34.149080] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-26T19:34:34.150622] [DEBUG] [LOCAL ] JHG: Trimmed 68352 records to 48497 (keeping 200 days of data) [2025-09-26T19:34:34.372724] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-26T19:34:34.564067] [DEBUG] [LOCAL ] JHG: Primary data saved (48497 records). [2025-09-26T19:34:34.575755] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T19:34:34.574893] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-26T19:34:34.575996] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 40.4s. Estimated remaining: 2h 42m 25s. Rate: 7.5 symbols/min [2025-09-26T19:34:34.809136] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:34:34.854488] [DEBUG] [LOCAL ] JKS: Loaded 40399 existing records from primary storage. [2025-09-26T19:34:34.854681] [INFO ] [MAIN ] JKS: Loaded 40399 existing records. [2025-09-26T19:34:35.051579] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-26T19:34:35.058518] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:34:35.060982] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-26T19:34:35.061035] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-26T19:34:35.062137] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-26T19:34:35.062204] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-26T19:34:35.121435] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-26T19:34:35.442977] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:34:35.781470] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T19:34:35.911719] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-26T19:34:36.711733] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-26T19:34:36.734571] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-26T19:34:37.511726] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-26T19:34:37.748380] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-26T19:34:38.311749] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-26T19:34:38.777386] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-26T19:34:38.857239] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T19:34:39.111724] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-26T19:34:39.911721] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-26T19:34:40.711716] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-26T19:34:40.778913] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T19:34:40.828302] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:34:41.511777] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-26T19:34:42.311739] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-26T19:34:42.880069] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-26T19:34:43.111725] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-26T19:34:43.239060] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-26T19:34:43.373111] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-26T19:34:43.911729] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-26T19:34:44.587297] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:34:44.711758] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-26T19:34:45.511730] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-26T19:34:45.766332] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:34:45.786821] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-26T19:34:46.238389] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-26T19:34:46.240158] [INFO ] [REMOTE ] JHS: Full fetch complete (4427 records). [2025-09-26T19:34:46.240251] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-26T19:34:46.316945] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-26T19:34:46.624284] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-26T19:34:46.624389] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-26T19:34:46.624562] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-26T19:34:46.624603] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-26T19:34:46.625100] [DEBUG] [LOCAL ] JHS: Trimmed 4427 records to 2878 (keeping 200 days of data) [2025-09-26T19:34:46.643779] [DEBUG] [LOCAL ] JHS: Primary data saved (2878 records). [2025-09-26T19:34:46.643889] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-26T19:34:46.644009] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHS took 28.5s. Estimated remaining: 2h 42m 21s. Rate: 7.5 symbols/min [2025-09-26T19:34:47.111753] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-26T19:34:47.911722] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-26T19:34:48.231945] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-26T19:34:48.534048] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-26T19:34:48.553519] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-26T19:34:48.711730] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-26T19:34:49.511746] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-26T19:34:50.209323] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-26T19:34:50.311734] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-26T19:34:51.111702] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-26T19:34:51.396277] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-26T19:34:51.442207] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:34:51.446225] [INFO ] [REMOTE ] JILL: Full fetch complete (22997 records). [2025-09-26T19:34:51.446333] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-26T19:34:51.844938] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-26T19:34:51.845021] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-26T19:34:51.845569] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-26T19:34:51.845609] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-26T19:34:51.846284] [DEBUG] [LOCAL ] JILL: Trimmed 22997 records to 16931 (keeping 200 days of data) [2025-09-26T19:34:51.923720] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-26T19:34:51.966183] [DEBUG] [LOCAL ] JILL: Primary data saved (16931 records). [2025-09-26T19:34:51.966383] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-26T19:34:51.966605] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JILL took 25.1s. Estimated remaining: 2h 42m 10s. Rate: 7.5 symbols/min [2025-09-26T19:34:52.836531] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:34:52.847359] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-26T19:34:53.844739] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-26T19:34:53.855478] [INFO ] [REMOTE ] JHX: Full fetch complete (57608 records). [2025-09-26T19:34:53.855620] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-26T19:34:54.294597] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-26T19:34:54.294841] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-26T19:34:54.295983] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-26T19:34:54.296098] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-26T19:34:54.319372] [DEBUG] [LOCAL ] JHX: Trimmed 57608 records to 51216 (keeping 200 days of data) [2025-09-26T19:34:54.321225] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:34:54.330297] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-26T19:34:54.651968] [DEBUG] [LOCAL ] JHX: Primary data saved (51216 records). [2025-09-26T19:34:54.652176] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-26T19:34:54.652324] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JHX took 29.3s. Estimated remaining: 2h 41m 56s. Rate: 7.5 symbols/min [2025-09-26T19:34:55.778398] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-26T19:34:55.786963] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-26T19:34:57.349690] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:34:57.360607] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-26T19:34:58.756172] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T19:34:58.764457] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-26T19:35:00.476258] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:35:00.485844] [INFO ] [REMOTE ] JKS: Full fetch complete (59258 records). [2025-09-26T19:35:00.486044] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-26T19:35:00.975914] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-26T19:35:00.976029] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-26T19:35:00.976961] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-26T19:35:00.977043] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-26T19:35:00.978381] [DEBUG] [LOCAL ] JKS: Trimmed 59258 records to 40672 (keeping 200 days of data) [2025-09-26T19:35:01.241853] [DEBUG] [LOCAL ] JKS: Primary data saved (40672 records). [2025-09-26T19:35:01.241995] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-26T19:35:01.242114] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 26.7s. Estimated remaining: 2h 41m 47s. Rate: 7.5 symbols/min [2025-09-26T19:35:01.887717] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:01.984091] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:01.975122] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-26T19:35:02.027899] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-26T19:35:02.032242] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:02.055330] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-26T19:35:02.064423] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-26T19:35:02.088147] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:02.090422] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-26T19:35:02.090724] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-26T19:35:02.115590] [DEBUG] [LOCAL ] JLS: Loaded 4110 existing records from primary storage. [2025-09-26T19:35:02.147709] [INFO ] [MAIN ] JLS: Loaded 4110 existing records. [2025-09-26T19:35:02.381982] [DEBUG] [LOCAL ] JLL: Loaded 32288 existing records from primary storage. [2025-09-26T19:35:02.420188] [INFO ] [MAIN ] JLL: Loaded 32288 existing records. [2025-09-26T19:35:02.778736] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:02.820817] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-26T19:35:02.820574] [DEBUG] [LOCAL ] JMIA: Loaded 50895 existing records from primary storage. [2025-09-26T19:35:02.842267] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-26T19:35:02.842170] [INFO ] [MAIN ] JMIA: Loaded 50895 existing records. [2025-09-26T19:35:02.888861] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-26T19:35:02.969861] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-26T19:35:03.015320] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:03.066026] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-26T19:35:03.075939] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-26T19:35:03.133286] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-26T19:35:03.176889] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-26T19:35:03.146275] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:03.206903] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-26T19:35:03.535169] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:03.610811] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-26T19:35:03.714633] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-26T19:35:03.762963] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-26T19:35:03.819822] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-26T19:35:04.038929] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:04.077461] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-26T19:35:04.116834] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T19:35:04.184933] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-26T19:35:04.276812] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:04.293499] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-26T19:35:04.478495] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:04.478909] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-26T19:35:04.703719] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-26T19:35:04.704759] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-26T19:35:04.997016] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-26T19:35:04.998569] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-26T19:35:05.151781] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T19:35:05.152985] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-26T19:35:05.493382] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:35:05.499357] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-26T19:35:05.591534] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-26T19:35:05.593100] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-26T19:35:05.618543] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-26T19:35:05.619584] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-26T19:35:05.990848] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-26T19:35:05.992312] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-26T19:35:06.224783] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-26T19:35:06.311721] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-26T19:35:06.614453] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-26T19:35:06.617314] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-26T19:35:06.660258] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T19:35:06.818248] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-26T19:35:07.111715] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-26T19:35:07.805008] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-26T19:35:07.911709] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-26T19:35:08.562384] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T19:35:08.711736] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-26T19:35:09.511754] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-26T19:35:10.311711] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-26T19:35:10.564859] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T19:35:10.656811] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-26T19:35:10.944146] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:35:11.111718] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-26T19:35:11.911710] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-26T19:35:12.524027] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-26T19:35:12.549122] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:35:12.711748] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-26T19:35:13.511811] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-26T19:35:14.275893] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-26T19:35:14.311679] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-26T19:35:14.850844] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T19:35:15.111693] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-26T19:35:15.219165] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T19:35:15.613929] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-26T19:35:15.911707] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-26T19:35:16.711725] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-26T19:35:17.351538] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-26T19:35:17.353060] [INFO ] [REMOTE ] JLS: Full fetch complete (5820 records). [2025-09-26T19:35:17.353155] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-26T19:35:17.511962] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-26T19:35:17.522101] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:35:17.802949] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-26T19:35:17.803078] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-26T19:35:17.803293] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-26T19:35:17.803361] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-26T19:35:17.803907] [DEBUG] [LOCAL ] JLS: Trimmed 5820 records to 4142 (keeping 200 days of data) [2025-09-26T19:35:17.831170] [DEBUG] [LOCAL ] JLS: Primary data saved (4142 records). [2025-09-26T19:35:17.831324] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-26T19:35:17.831471] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JLS took 16.6s. Estimated remaining: 2h 41m 48s. Rate: 7.5 symbols/min [2025-09-26T19:35:18.047987] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:18.043479] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-26T19:35:18.111854] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-09-26T19:35:18.112036] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-09-26T19:35:18.316544] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-26T19:35:18.321143] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:18.322503] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-26T19:35:18.322556] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-26T19:35:18.324214] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-26T19:35:18.324294] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-26T19:35:18.703321] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:19.111716] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-26T19:35:19.911742] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-26T19:35:20.087085] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:35:20.347974] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T19:35:20.711730] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-26T19:35:21.273633] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-26T19:35:21.274665] [INFO ] [REMOTE ] JMM: Full fetch complete (2292 records). [2025-09-26T19:35:21.274753] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-26T19:35:21.479926] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-26T19:35:21.480257] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:35:21.480414] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:35:21.480529] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-26T19:35:21.480634] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-26T19:35:21.480807] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-26T19:35:21.481006] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-26T19:35:21.481199] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JMM took 20.2s. Estimated remaining: 2h 41m 35s. Rate: 7.5 symbols/min [2025-09-26T19:35:21.516789] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-26T19:35:21.665568] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-26T19:35:21.734480] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:21.790579] [DEBUG] [LOCAL ] JOBY: Loaded 54189 existing records from primary storage. [2025-09-26T19:35:21.790761] [INFO ] [MAIN ] JOBY: Loaded 54189 existing records. [2025-09-26T19:35:21.989744] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:21.990025] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-26T19:35:21.990101] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-26T19:35:21.991551] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-26T19:35:21.991627] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-26T19:35:22.316879] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-26T19:35:22.391756] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:22.853948] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-26T19:35:23.111717] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-26T19:35:23.911705] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-26T19:35:24.150716] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:35:24.711731] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-26T19:35:25.172949] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-26T19:35:25.277275] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T19:35:25.511720] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-26T19:35:26.311732] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-26T19:35:26.628557] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-26T19:35:27.111721] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-26T19:35:27.594409] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-26T19:35:27.911736] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-26T19:35:28.649950] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T19:35:28.711761] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-26T19:35:28.962687] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-26T19:35:29.511719] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-26T19:35:29.672882] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T19:35:30.163210] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-26T19:35:30.170055] [INFO ] [REMOTE ] JLL: Full fetch complete (44863 records). [2025-09-26T19:35:30.170207] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-26T19:35:30.323975] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-26T19:35:30.621781] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-26T19:35:30.621865] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-26T19:35:30.622558] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-26T19:35:30.622600] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-26T19:35:30.623862] [DEBUG] [LOCAL ] JLL: Trimmed 44863 records to 32458 (keeping 200 days of data) [2025-09-26T19:35:30.830604] [DEBUG] [LOCAL ] JLL: Primary data saved (32458 records). [2025-09-26T19:35:30.830781] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-26T19:35:30.830878] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JLL took 29.6s. Estimated remaining: 2h 41m 29s. Rate: 7.5 symbols/min [2025-09-26T19:35:31.014693] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:31.039120] [DEBUG] [LOCAL ] JOE: Loaded 24733 existing records from primary storage. [2025-09-26T19:35:31.039346] [INFO ] [MAIN ] JOE: Loaded 24733 existing records. [2025-09-26T19:35:31.119960] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-26T19:35:31.250246] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:31.250485] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-26T19:35:31.250533] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-26T19:35:31.251272] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-26T19:35:31.251335] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-26T19:35:31.637140] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:31.773560] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-26T19:35:31.911717] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-26T19:35:32.618558] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-26T19:35:32.711739] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-26T19:35:33.068620] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T19:35:33.364192] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-26T19:35:33.511750] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-26T19:35:34.311754] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-26T19:35:34.817526] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T19:35:34.984454] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-26T19:35:35.111716] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-26T19:35:35.911727] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-26T19:35:36.711739] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-26T19:35:37.014352] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-26T19:35:37.235175] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-26T19:35:37.511705] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-26T19:35:37.858337] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-26T19:35:37.894975] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-26T19:35:38.311740] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-26T19:35:39.111753] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-26T19:35:39.379543] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T19:35:39.911721] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-26T19:35:40.575806] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-26T19:35:40.587601] [INFO ] [REMOTE ] JMIA: Full fetch complete (73263 records). [2025-09-26T19:35:40.587845] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-26T19:35:40.713070] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-26T19:35:41.036668] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-26T19:35:41.036778] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-26T19:35:41.042623] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-26T19:35:41.043163] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-26T19:35:41.047360] [DEBUG] [LOCAL ] JMIA: Trimmed 73263 records to 51279 (keeping 200 days of data) [2025-09-26T19:35:41.173750] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T19:35:41.388181] [DEBUG] [LOCAL ] JMIA: Primary data saved (51279 records). [2025-09-26T19:35:41.388342] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-26T19:35:41.388439] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JMIA took 40.1s. Estimated remaining: 2h 41m 23s. Rate: 7.5 symbols/min [2025-09-26T19:35:41.513890] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-26T19:35:41.584287] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:41.594925] [DEBUG] [LOCAL ] JOF: Loaded 7145 existing records from primary storage. [2025-09-26T19:35:41.595456] [INFO ] [MAIN ] JOF: Loaded 7145 existing records. [2025-09-26T19:35:41.755720] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-26T19:35:41.856374] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:41.856719] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-26T19:35:41.856804] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-26T19:35:41.857351] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-26T19:35:41.857443] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-26T19:35:42.288979] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:42.311702] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-26T19:35:42.489106] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-26T19:35:43.123117] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-26T19:35:43.129455] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-26T19:35:43.370297] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T19:35:43.911909] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-26T19:35:44.711729] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-26T19:35:45.073240] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T19:35:45.511731] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-26T19:35:45.699471] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-26T19:35:46.311703] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-26T19:35:46.624623] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:35:46.953608] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-26T19:35:47.111722] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-26T19:35:47.911715] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-26T19:35:48.327764] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-26T19:35:48.711747] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-26T19:35:48.996133] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-09-26T19:35:49.191615] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T19:35:49.505816] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-26T19:35:49.515490] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-26T19:35:49.521778] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-26T19:35:49.521970] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-26T19:35:49.943196] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-26T19:35:49.943364] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-26T19:35:49.944353] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-26T19:35:49.944449] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-26T19:35:49.946110] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54533 (keeping 200 days of data) [2025-09-26T19:35:50.302808] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-09-26T19:35:50.302956] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-26T19:35:50.303197] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JNJ took 32.5s. Estimated remaining: 2h 41m 16s. Rate: 7.5 symbols/min [2025-09-26T19:35:50.317152] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-26T19:35:50.492364] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:50.533594] [DEBUG] [LOCAL ] JPC: Loaded 37351 existing records from primary storage. [2025-09-26T19:35:50.533792] [INFO ] [MAIN ] JPC: Loaded 37351 existing records. [2025-09-26T19:35:50.728309] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:50.728602] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-26T19:35:50.728677] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-26T19:35:50.729978] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-26T19:35:50.730050] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-26T19:35:51.115591] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:51.115915] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-26T19:35:51.262500] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-26T19:35:51.911712] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-26T19:35:52.110605] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-26T19:35:52.486961] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T19:35:52.711749] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-26T19:35:53.511737] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-26T19:35:53.772874] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:35:53.796136] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-26T19:35:54.311740] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-26T19:35:54.357722] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T19:35:55.111727] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-26T19:35:55.795879] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:35:55.911713] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-26T19:35:56.532322] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-26T19:35:56.538111] [INFO ] [REMOTE ] JOE: Full fetch complete (36213 records). [2025-09-26T19:35:56.538225] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-26T19:35:56.721794] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-26T19:35:56.936352] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-26T19:35:56.936449] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-26T19:35:56.937189] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-26T19:35:56.937258] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-26T19:35:56.938362] [DEBUG] [LOCAL ] JOE: Trimmed 36213 records to 24860 (keeping 200 days of data) [2025-09-26T19:35:57.113946] [DEBUG] [LOCAL ] JOE: Primary data saved (24860 records). [2025-09-26T19:35:57.114129] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-26T19:35:57.114287] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOE took 26.3s. Estimated remaining: 2h 41m 7s. Rate: 7.5 symbols/min [2025-09-26T19:35:57.289958] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:35:57.357075] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-09-26T19:35:57.357230] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-09-26T19:35:57.522553] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-26T19:35:57.547715] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:35:57.547986] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-26T19:35:57.548057] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-26T19:35:57.549896] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-26T19:35:57.549968] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-26T19:35:57.968283] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:35:58.164373] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T19:35:58.188995] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T19:35:58.311709] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-26T19:35:58.753746] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-26T19:35:58.795992] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-26T19:35:59.111747] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-26T19:35:59.911711] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-26T19:36:00.711730] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-26T19:36:01.511709] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-26T19:36:01.985662] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-26T19:36:02.061533] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-26T19:36:02.151869] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:36:02.172160] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T19:36:02.311714] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-26T19:36:03.111726] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-26T19:36:03.474216] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-26T19:36:03.911720] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-26T19:36:04.711716] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-26T19:36:05.511715] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-26T19:36:05.756042] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-26T19:36:05.770945] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-26T19:36:05.771170] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-26T19:36:06.171145] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T19:36:06.247257] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-26T19:36:06.247588] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-26T19:36:06.248612] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-26T19:36:06.248815] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-26T19:36:06.250723] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54579 (keeping 200 days of data) [2025-09-26T19:36:06.312957] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-26T19:36:06.396313] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T19:36:06.427030] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-26T19:36:06.657879] [DEBUG] [LOCAL ] JOBY: Primary data saved (54579 records). [2025-09-26T19:36:06.658040] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-26T19:36:06.658157] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JOBY took 45.2s. Estimated remaining: 2h 41m 0s. Rate: 7.5 symbols/min [2025-09-26T19:36:06.847386] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:06.881442] [DEBUG] [LOCAL ] JQC: Loaded 33842 existing records from primary storage. [2025-09-26T19:36:06.881590] [INFO ] [MAIN ] JQC: Loaded 33842 existing records. [2025-09-26T19:36:07.075553] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:07.075848] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-26T19:36:07.075929] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-26T19:36:07.076895] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-26T19:36:07.076983] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-26T19:36:07.121719] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-26T19:36:07.460268] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:07.481856] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-26T19:36:07.911714] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-26T19:36:08.711773] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-26T19:36:09.411718] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:36:09.489815] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-26T19:36:09.505995] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T19:36:09.508139] [INFO ] [REMOTE ] JOF: Full fetch complete (9496 records). [2025-09-26T19:36:09.508218] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-26T19:36:09.519902] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-26T19:36:09.895556] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-26T19:36:09.895664] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-26T19:36:09.895932] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-26T19:36:09.895973] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-26T19:36:09.896459] [DEBUG] [LOCAL ] JOF: Trimmed 9496 records to 7177 (keeping 200 days of data) [2025-09-26T19:36:09.942143] [DEBUG] [LOCAL ] JOF: Primary data saved (7177 records). [2025-09-26T19:36:09.942281] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-26T19:36:09.942385] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JOF took 28.6s. Estimated remaining: 2h 40m 48s. Rate: 7.5 symbols/min [2025-09-26T19:36:10.122140] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:10.143226] [DEBUG] [LOCAL ] JRI: Loaded 14986 existing records from primary storage. [2025-09-26T19:36:10.143367] [INFO ] [MAIN ] JRI: Loaded 14986 existing records. [2025-09-26T19:36:10.315277] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-26T19:36:10.341397] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:10.342514] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-26T19:36:10.342590] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-26T19:36:10.343391] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-26T19:36:10.343490] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-26T19:36:10.716367] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:11.079374] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-26T19:36:11.111700] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-26T19:36:11.599174] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T19:36:11.911711] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-26T19:36:12.309880] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:36:12.711728] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-26T19:36:13.471769] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T19:36:13.479734] [INFO ] [REMOTE ] JPC: Full fetch complete (55708 records). [2025-09-26T19:36:13.479894] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-26T19:36:13.518441] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-26T19:36:13.903426] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-26T19:36:13.903556] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-26T19:36:13.904685] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-26T19:36:13.904848] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-26T19:36:13.906856] [DEBUG] [LOCAL ] JPC: Trimmed 55708 records to 37620 (keeping 200 days of data) [2025-09-26T19:36:14.024908] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-26T19:36:14.174061] [DEBUG] [LOCAL ] JPC: Primary data saved (37620 records). [2025-09-26T19:36:14.174217] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-26T19:36:14.174367] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JPC took 23.9s. Estimated remaining: 2h 40m 36s. Rate: 7.5 symbols/min [2025-09-26T19:36:14.327036] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-26T19:36:14.363606] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:14.376541] [DEBUG] [LOCAL ] JRS: Loaded 11185 existing records from primary storage. [2025-09-26T19:36:14.376733] [INFO ] [MAIN ] JRS: Loaded 11185 existing records. [2025-09-26T19:36:14.585925] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:14.586263] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-26T19:36:14.586324] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-26T19:36:14.586830] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-26T19:36:14.586904] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-26T19:36:14.989991] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:15.111729] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-26T19:36:15.658418] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T19:36:15.911708] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-26T19:36:16.035353] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-26T19:36:16.127137] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-26T19:36:16.711756] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-26T19:36:16.995365] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-26T19:36:17.511744] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-26T19:36:18.166238] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-26T19:36:18.311699] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-26T19:36:18.361587] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:36:19.111733] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-26T19:36:19.911719] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-26T19:36:20.097684] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T19:36:20.711719] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-26T19:36:20.937938] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-26T19:36:21.314795] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-26T19:36:21.358155] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T19:36:21.511755] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-26T19:36:22.311711] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-26T19:36:22.507886] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T19:36:23.110594] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-26T19:36:23.114216] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-26T19:36:23.911713] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-26T19:36:24.696790] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T19:36:24.711671] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-26T19:36:24.734966] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-26T19:36:25.511715] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-26T19:36:25.944501] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-26T19:36:26.311727] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-26T19:36:26.482489] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-26T19:36:27.111726] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-26T19:36:27.129471] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T19:36:27.911719] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-26T19:36:28.711718] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-26T19:36:29.417324] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T19:36:29.511700] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-26T19:36:29.590904] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-26T19:36:29.611600] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T19:36:30.166297] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-26T19:36:30.311730] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-26T19:36:31.111698] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-26T19:36:31.158129] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-26T19:36:31.911714] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-26T19:36:32.711703] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-26T19:36:32.858600] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T19:36:33.092848] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T19:36:33.511693] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-26T19:36:33.593731] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T19:36:34.311741] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-26T19:36:35.111780] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-26T19:36:35.289056] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-26T19:36:35.291904] [INFO ] [REMOTE ] JRS: Full fetch complete (16146 records). [2025-09-26T19:36:35.291981] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-26T19:36:35.683101] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-26T19:36:35.683241] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-26T19:36:35.683752] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-26T19:36:35.683817] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-26T19:36:35.684416] [DEBUG] [LOCAL ] JRS: Trimmed 16146 records to 11250 (keeping 200 days of data) [2025-09-26T19:36:35.761848] [DEBUG] [LOCAL ] JRS: Primary data saved (11250 records). [2025-09-26T19:36:35.762017] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-26T19:36:35.762155] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JRS took 21.6s. Estimated remaining: 2h 40m 42s. Rate: 7.5 symbols/min [2025-09-26T19:36:35.939967] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-26T19:36:35.943478] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:35.994907] [DEBUG] [LOCAL ] JXN: Loaded 46259 existing records from primary storage. [2025-09-26T19:36:35.995121] [INFO ] [MAIN ] JXN: Loaded 46259 existing records. [2025-09-26T19:36:36.199640] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T19:36:36.203369] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:36.208829] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-26T19:36:36.209388] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-26T19:36:36.210768] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-26T19:36:36.210854] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-26T19:36:36.374349] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-26T19:36:36.633741] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:36.711746] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-26T19:36:37.298438] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-26T19:36:37.511726] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-26T19:36:38.320683] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-26T19:36:38.328049] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-26T19:36:39.111747] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-26T19:36:39.437888] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-26T19:36:39.788287] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-26T19:36:39.911709] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-26T19:36:40.684665] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T19:36:40.711695] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-26T19:36:41.511786] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-26T19:36:42.243522] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:36:42.311717] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-26T19:36:42.487690] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-26T19:36:42.498945] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-26T19:36:42.499113] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-26T19:36:42.834754] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T19:36:42.877850] [INFO ] [REMOTE ] JRI: Full fetch complete (23142 records). [2025-09-26T19:36:42.894717] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-26T19:36:42.974573] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-26T19:36:43.000063] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-26T19:36:43.016752] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-26T19:36:43.028590] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-26T19:36:43.076408] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54574 (keeping 200 days of data) [2025-09-26T19:36:43.138569] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-26T19:36:43.454039] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-26T19:36:43.455112] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-26T19:36:43.456405] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-26T19:36:43.456488] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-26T19:36:43.459268] [DEBUG] [LOCAL ] JRI: Trimmed 23142 records to 15068 (keeping 200 days of data) [2025-09-26T19:36:43.736985] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-26T19:36:43.799173] [INFO ] [REMOTE ] JQC: Full fetch complete (48750 records). [2025-09-26T19:36:43.818881] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-26T19:36:43.914094] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-09-26T19:36:43.930001] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-26T19:36:43.930493] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JPM took 46.8s. Estimated remaining: 2h 40m 34s. Rate: 7.5 symbols/min [2025-09-26T19:36:44.011680] [DEBUG] [LOCAL ] JRI: Primary data saved (15068 records). [2025-09-26T19:36:44.048015] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-26T19:36:44.099964] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRI took 34.2s. Estimated remaining: 2h 40m 18s. Rate: 7.5 symbols/min [2025-09-26T19:36:44.369216] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:44.625587] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:44.683811] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-26T19:36:44.684038] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-26T19:36:44.685525] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-26T19:36:44.685755] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-26T19:36:44.688090] [DEBUG] [LOCAL ] JQC: Trimmed 48750 records to 34194 (keeping 200 days of data) [2025-09-26T19:36:44.712917] [DEBUG] [LOCAL ] KAI: Loaded 13650 existing records from primary storage. [2025-09-26T19:36:44.713107] [INFO ] [MAIN ] KAI: Loaded 13650 existing records. [2025-09-26T19:36:44.939055] [DEBUG] [LOCAL ] K: Loaded 50249 existing records from primary storage. [2025-09-26T19:36:44.945394] [INFO ] [MAIN ] K: Loaded 50249 existing records. [2025-09-26T19:36:45.218475] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:45.236329] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-26T19:36:45.241674] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-26T19:36:45.297917] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-26T19:36:45.315481] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-26T19:36:45.328975] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:45.380372] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-26T19:36:45.434128] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-26T19:36:45.476552] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-26T19:36:45.482063] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-26T19:36:45.520401] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-26T19:36:45.627498] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-26T19:36:45.951371] [DEBUG] [LOCAL ] JQC: Primary data saved (34194 records). [2025-09-26T19:36:45.957719] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-26T19:36:45.962476] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. JQC took 39.3s. Estimated remaining: 2h 40m 3s. Rate: 7.5 symbols/min [2025-09-26T19:36:46.417108] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:46.442435] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:46.435195] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-26T19:36:46.528867] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:46.529350] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-26T19:36:46.573380] [DEBUG] [LOCAL ] KAR: Loaded 40122 existing records from primary storage. [2025-09-26T19:36:46.573630] [INFO ] [MAIN ] KAR: Loaded 40122 existing records. [2025-09-26T19:36:46.758988] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:46.759382] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-26T19:36:46.759438] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-26T19:36:46.760710] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-26T19:36:46.760772] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-26T19:36:47.138803] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:47.139225] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-26T19:36:47.442701] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T19:36:47.454306] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-26T19:36:47.619104] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-26T19:36:47.911705] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-26T19:36:48.261865] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T19:36:48.351620] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T19:36:48.711710] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-26T19:36:48.741184] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-26T19:36:48.941684] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:36:49.511734] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-26T19:36:50.311721] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-26T19:36:50.383078] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-26T19:36:50.606205] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-26T19:36:51.111748] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-26T19:36:51.868216] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:36:51.911690] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-26T19:36:52.161755] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-26T19:36:52.711746] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-26T19:36:53.402122] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T19:36:53.511689] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-26T19:36:54.057936] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-26T19:36:54.311764] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-26T19:36:55.096091] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T19:36:55.111686] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-26T19:36:55.659288] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:36:55.911759] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-26T19:36:56.711756] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-26T19:36:57.047974] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:36:57.057172] [INFO ] [REMOTE ] JXN: Full fetch complete (65362 records). [2025-09-26T19:36:57.057377] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-26T19:36:57.492778] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:36:57.513142] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-26T19:36:57.520627] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-26T19:36:57.521318] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-26T19:36:57.522879] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-26T19:36:57.523012] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-26T19:36:57.525164] [DEBUG] [LOCAL ] JXN: Trimmed 65362 records to 46558 (keeping 200 days of data) [2025-09-26T19:36:57.829163] [DEBUG] [LOCAL ] JXN: Primary data saved (46558 records). [2025-09-26T19:36:57.829473] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-26T19:36:57.829725] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. JXN took 22.1s. Estimated remaining: 2h 39m 59s. Rate: 7.5 symbols/min [2025-09-26T19:36:58.052195] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:36:58.057930] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-26T19:36:58.093884] [DEBUG] [LOCAL ] KB: Loaded 24295 existing records from primary storage. [2025-09-26T19:36:58.094070] [INFO ] [MAIN ] KB: Loaded 24295 existing records. [2025-09-26T19:36:58.280958] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:36:58.281413] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-26T19:36:58.281490] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-26T19:36:58.282435] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-26T19:36:58.282499] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-26T19:36:58.314305] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-26T19:36:58.372386] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-26T19:36:58.696203] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:36:59.111806] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-26T19:36:59.911732] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-26T19:37:00.010032] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-26T19:37:00.058443] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-26T19:37:00.711746] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-26T19:37:01.309755] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-26T19:37:01.511760] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-26T19:37:01.676788] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-26T19:37:02.311719] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-26T19:37:02.886715] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-26T19:37:03.111765] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-26T19:37:03.844766] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T19:37:03.883007] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-26T19:37:03.911681] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-26T19:37:04.711736] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-26T19:37:04.900867] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-26T19:37:04.904264] [INFO ] [REMOTE ] KAI: Full fetch complete (18883 records). [2025-09-26T19:37:04.904404] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-26T19:37:05.284126] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-26T19:37:05.284218] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-26T19:37:05.284680] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-26T19:37:05.284741] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-26T19:37:05.285323] [DEBUG] [LOCAL ] KAI: Trimmed 18883 records to 13729 (keeping 200 days of data) [2025-09-26T19:37:05.371061] [DEBUG] [LOCAL ] KAI: Primary data saved (13729 records). [2025-09-26T19:37:05.371207] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-26T19:37:05.371327] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. KAI took 21.2s. Estimated remaining: 2h 39m 51s. Rate: 7.5 symbols/min [2025-09-26T19:37:05.519959] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-26T19:37:05.546468] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:05.568611] [DEBUG] [LOCAL ] KBDC: Loaded 21035 existing records from primary storage. [2025-09-26T19:37:05.568838] [INFO ] [MAIN ] KBDC: Loaded 21035 existing records. [2025-09-26T19:37:05.748283] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:05.748611] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-26T19:37:05.748687] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-26T19:37:05.749418] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-26T19:37:05.749478] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-26T19:37:06.119719] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:06.311738] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-26T19:37:06.583018] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-26T19:37:07.111689] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-26T19:37:07.158017] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-26T19:37:07.415278] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-26T19:37:07.911704] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-26T19:37:08.129724] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T19:37:08.711735] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-26T19:37:09.353519] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-26T19:37:09.511738] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-26T19:37:09.902871] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T19:37:10.311697] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-26T19:37:10.458096] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-26T19:37:11.111713] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-26T19:37:11.911748] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-26T19:37:12.034909] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:37:12.081162] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-26T19:37:12.711712] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-26T19:37:13.095013] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-26T19:37:13.511754] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-26T19:37:14.251227] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T19:37:14.311774] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-26T19:37:14.595557] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T19:37:15.111712] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-26T19:37:15.911705] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-26T19:37:16.164353] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:37:16.638761] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-26T19:37:16.711741] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-26T19:37:17.080046] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-26T19:37:17.511722] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-26T19:37:18.299561] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-26T19:37:18.311683] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-26T19:37:18.609134] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T19:37:19.111719] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-26T19:37:19.317700] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T19:37:19.911716] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-26T19:37:20.615034] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:37:20.623983] [INFO ] [REMOTE ] KAR: Full fetch complete (56713 records). [2025-09-26T19:37:20.624125] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-26T19:37:20.716804] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-26T19:37:21.069721] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-26T19:37:21.072766] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-26T19:37:21.077415] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-26T19:37:21.078831] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-26T19:37:21.078909] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-26T19:37:21.080323] [DEBUG] [LOCAL ] KAR: Trimmed 56713 records to 40411 (keeping 200 days of data) [2025-09-26T19:37:21.319583] [DEBUG] [LOCAL ] KAR: Primary data saved (40411 records). [2025-09-26T19:37:21.319740] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-26T19:37:21.319837] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. KAR took 35.4s. Estimated remaining: 2h 39m 51s. Rate: 7.5 symbols/min [2025-09-26T19:37:21.499028] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:21.511705] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-26T19:37:21.549605] [DEBUG] [LOCAL ] KBH: Loaded 49303 existing records from primary storage. [2025-09-26T19:37:21.549792] [INFO ] [MAIN ] KBH: Loaded 49303 existing records. [2025-09-26T19:37:21.738628] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:21.738918] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-26T19:37:21.738969] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-26T19:37:21.740578] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-26T19:37:21.740677] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-26T19:37:22.131417] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:22.311689] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-26T19:37:22.477952] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:37:22.500143] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:37:23.111726] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-26T19:37:23.844581] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:37:23.911670] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-26T19:37:24.151716] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T19:37:24.711725] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-26T19:37:25.511720] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-26T19:37:25.638082] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T19:37:25.933744] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T19:37:26.311709] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-26T19:37:27.111726] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-26T19:37:27.489251] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:37:27.499825] [INFO ] [REMOTE ] K: Full fetch complete (71958 records). [2025-09-26T19:37:27.500011] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-26T19:37:27.937907] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-26T19:37:27.965262] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-26T19:37:27.965422] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-26T19:37:27.966596] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-26T19:37:27.967099] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-26T19:37:27.969033] [DEBUG] [LOCAL ] K: Trimmed 71958 records to 50637 (keeping 200 days of data) [2025-09-26T19:37:27.999130] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:37:28.328786] [DEBUG] [LOCAL ] K: Primary data saved (50637 records). [2025-09-26T19:37:28.328952] [INFO ] [MAIN ] K: Full history saved. [2025-09-26T19:37:28.329058] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. K took 44.4s. Estimated remaining: 2h 39m 42s. Rate: 7.5 symbols/min [2025-09-26T19:37:28.523591] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:28.548857] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-26T19:37:28.603771] [DEBUG] [LOCAL ] KBR: Loaded 48536 existing records from primary storage. [2025-09-26T19:37:28.604078] [INFO ] [MAIN ] KBR: Loaded 48536 existing records. [2025-09-26T19:37:28.713316] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-26T19:37:28.793821] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T19:37:28.842949] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:28.843237] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-26T19:37:28.843295] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-26T19:37:28.844662] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-26T19:37:28.844748] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-26T19:37:29.235291] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:29.511738] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-26T19:37:29.611867] [DEBUG] [REMOTE ] KBDC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-26T19:37:29.612194] [WARN ] [REMOTE ] KBDC: No data returned for month 2025-09 [2025-09-26T19:37:29.612313] [INFO ] [REMOTE ] KBDC: Full fetch complete (24186 records). [2025-09-26T19:37:29.612389] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-26T19:37:29.613173] [FATAL] [VALIDATOR ] KBDC: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-26). Symbol may be delisted or halted. [2025-09-26T19:37:29.613311] [FATAL] [MAIN ] KBDC: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:37:29.613419] [WARN ] [MAIN ] KBDC: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:37:29.613497] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-26T19:37:29.613617] [DEBUG] [LOCAL ] KBDC: No primary data file found to delete. [2025-09-26T19:37:29.613717] [INFO ] [LOCAL ] KBDC: Starting deletion of derivative data. [2025-09-26T19:37:29.614260] [DEBUG] [LOCAL ] KBDC: Deleted derivative data file. [2025-09-26T19:37:29.614392] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBDC took 24.2s. Estimated remaining: 2h 39m 27s. Rate: 7.5 symbols/min [2025-09-26T19:37:29.803114] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:29.865322] [DEBUG] [LOCAL ] KD: Loaded 52678 existing records from primary storage. [2025-09-26T19:37:29.865471] [INFO ] [MAIN ] KD: Loaded 52678 existing records. [2025-09-26T19:37:30.054004] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:30.054426] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-26T19:37:30.054495] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-26T19:37:30.061080] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-26T19:37:30.066526] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-26T19:37:30.128399] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T19:37:30.316849] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-26T19:37:30.459316] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:31.111732] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-26T19:37:31.911714] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-26T19:37:32.115502] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:37:32.644422] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:37:32.711689] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-26T19:37:33.511770] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-26T19:37:33.721602] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T19:37:33.751144] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:37:33.756955] [INFO ] [REMOTE ] KB: Full fetch complete (34364 records). [2025-09-26T19:37:33.757195] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-26T19:37:34.160259] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-26T19:37:34.160345] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-26T19:37:34.160986] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-26T19:37:34.161050] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-26T19:37:34.162063] [DEBUG] [LOCAL ] KB: Trimmed 34364 records to 24453 (keeping 200 days of data) [2025-09-26T19:37:34.315576] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-26T19:37:34.325348] [DEBUG] [LOCAL ] KB: Primary data saved (24453 records). [2025-09-26T19:37:34.325534] [INFO ] [MAIN ] KB: Full history saved. [2025-09-26T19:37:34.325716] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KB took 36.5s. Estimated remaining: 2h 39m 15s. Rate: 7.5 symbols/min [2025-09-26T19:37:34.524826] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:34.533851] [DEBUG] [LOCAL ] KEN: Loaded 4776 existing records from primary storage. [2025-09-26T19:37:34.534029] [INFO ] [MAIN ] KEN: Loaded 4776 existing records. [2025-09-26T19:37:34.745451] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:34.745748] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-26T19:37:34.745827] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-26T19:37:34.746186] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-26T19:37:34.746247] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-26T19:37:35.124625] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-26T19:37:35.130570] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:35.165904] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T19:37:35.911718] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-26T19:37:35.975536] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T19:37:36.711729] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-26T19:37:36.757004] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:37:37.050803] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-26T19:37:37.511713] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-26T19:37:37.540818] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:37:38.311726] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-26T19:37:39.111699] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-26T19:37:39.312087] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T19:37:39.692976] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T19:37:39.889699] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-26T19:37:39.911730] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-26T19:37:40.711733] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-26T19:37:41.169323] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-26T19:37:41.511730] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-26T19:37:41.744241] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:37:41.920304] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-26T19:37:42.311715] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-26T19:37:43.111749] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-26T19:37:43.893732] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-26T19:37:43.923258] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-26T19:37:43.948984] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:37:44.711728] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-26T19:37:45.430728] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-26T19:37:45.511717] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-26T19:37:46.311723] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-26T19:37:46.385211] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:37:46.708950] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-26T19:37:47.111693] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-26T19:37:47.232419] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:37:47.911722] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-26T19:37:48.519116] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-26T19:37:48.691836] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:37:48.711702] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-26T19:37:49.511727] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-26T19:37:50.216351] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T19:37:50.311776] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-26T19:37:51.111704] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-26T19:37:51.305857] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T19:37:51.752151] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-26T19:37:51.911721] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-26T19:37:52.142014] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T19:37:52.630216] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T19:37:52.711676] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-26T19:37:53.511744] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-26T19:37:54.279300] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T19:37:54.302296] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-26T19:37:54.304519] [INFO ] [REMOTE ] KEN: Full fetch complete (5938 records). [2025-09-26T19:37:54.304685] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-26T19:37:54.320276] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-26T19:37:54.748119] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-26T19:37:54.748227] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-26T19:37:54.748438] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-26T19:37:54.748536] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-26T19:37:54.749184] [DEBUG] [LOCAL ] KEN: Trimmed 5938 records to 4784 (keeping 200 days of data) [2025-09-26T19:37:54.781195] [DEBUG] [LOCAL ] KEN: Primary data saved (4784 records). [2025-09-26T19:37:54.781351] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-26T19:37:54.781538] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KEN took 20.5s. Estimated remaining: 2h 39m 20s. Rate: 7.5 symbols/min [2025-09-26T19:37:54.962051] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:55.005218] [DEBUG] [LOCAL ] KEP: Loaded 30936 existing records from primary storage. [2025-09-26T19:37:55.005386] [INFO ] [MAIN ] KEP: Loaded 30936 existing records. [2025-09-26T19:37:55.116788] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-26T19:37:55.220226] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:55.220560] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-26T19:37:55.220614] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-26T19:37:55.221797] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-26T19:37:55.221871] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-26T19:37:55.649167] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:55.911699] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-26T19:37:56.165206] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T19:37:56.711739] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-26T19:37:56.996326] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:37:57.008103] [INFO ] [REMOTE ] KBH: Full fetch complete (70724 records). [2025-09-26T19:37:57.008294] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-26T19:37:57.453850] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-26T19:37:57.454283] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-26T19:37:57.455632] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-26T19:37:57.479849] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-26T19:37:57.485542] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-26T19:37:57.496156] [DEBUG] [LOCAL ] KBH: Trimmed 70724 records to 49678 (keeping 200 days of data) [2025-09-26T19:37:57.511696] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-26T19:37:57.826748] [DEBUG] [LOCAL ] KBH: Primary data saved (49678 records). [2025-09-26T19:37:57.826945] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-26T19:37:57.827070] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KBH took 36.5s. Estimated remaining: 2h 39m 7s. Rate: 7.5 symbols/min [2025-09-26T19:37:58.017115] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:37:58.054741] [DEBUG] [LOCAL ] KEX: Loaded 38367 existing records from primary storage. [2025-09-26T19:37:58.054888] [INFO ] [MAIN ] KEX: Loaded 38367 existing records. [2025-09-26T19:37:58.254346] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:37:58.273074] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-26T19:37:58.273803] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-26T19:37:58.274415] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-26T19:37:58.280280] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-26T19:37:58.281010] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-26T19:37:58.316781] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-26T19:37:58.673519] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:37:59.111692] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-26T19:37:59.483706] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T19:37:59.650766] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-26T19:37:59.911698] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-26T19:38:00.238528] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-26T19:38:00.711737] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-26T19:38:01.511780] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-26T19:38:01.855243] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T19:38:02.311725] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-26T19:38:02.543950] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:38:03.111710] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-26T19:38:03.295790] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-26T19:38:03.305120] [INFO ] [REMOTE ] KBR: Full fetch complete (69982 records). [2025-09-26T19:38:03.305252] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-26T19:38:03.610499] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-26T19:38:03.765734] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-26T19:38:03.765832] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-26T19:38:03.766750] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-26T19:38:03.766817] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-26T19:38:03.771197] [DEBUG] [LOCAL ] KBR: Trimmed 69982 records to 48899 (keeping 200 days of data) [2025-09-26T19:38:03.913442] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-26T19:38:04.099609] [DEBUG] [LOCAL ] KBR: Primary data saved (48899 records). [2025-09-26T19:38:04.099793] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-26T19:38:04.099911] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KBR took 35.8s. Estimated remaining: 2h 38m 57s. Rate: 7.5 symbols/min [2025-09-26T19:38:04.300029] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:04.300243] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-26T19:38:04.300292] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-26T19:38:04.300448] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-26T19:38:04.300504] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-26T19:38:04.300573] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-26T19:38:04.300611] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-26T19:38:04.693014] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:04.711682] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-26T19:38:05.056007] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:38:05.067166] [INFO ] [REMOTE ] KD: Full fetch complete (75603 records). [2025-09-26T19:38:05.067354] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-26T19:38:05.218778] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-26T19:38:05.511930] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-26T19:38:05.511690] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-26T19:38:05.512955] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-26T19:38:05.513953] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-26T19:38:05.514144] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-26T19:38:05.518626] [DEBUG] [LOCAL ] KD: Trimmed 75603 records to 53068 (keeping 200 days of data) [2025-09-26T19:38:05.854411] [DEBUG] [LOCAL ] KD: Primary data saved (53068 records). [2025-09-26T19:38:05.854569] [INFO ] [MAIN ] KD: Full history saved. [2025-09-26T19:38:05.854694] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KD took 36.2s. Estimated remaining: 2h 38m 43s. Rate: 7.5 symbols/min [2025-09-26T19:38:06.031693] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:06.081797] [DEBUG] [LOCAL ] KEYS: Loaded 43637 existing records from primary storage. [2025-09-26T19:38:06.081950] [INFO ] [MAIN ] KEYS: Loaded 43637 existing records. [2025-09-26T19:38:06.277781] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:06.278119] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-26T19:38:06.278167] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-26T19:38:06.279494] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-26T19:38:06.279560] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-26T19:38:06.324519] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-26T19:38:06.678602] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:06.696396] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:38:06.735861] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-26T19:38:07.111723] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-26T19:38:07.863379] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-26T19:38:07.911728] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-26T19:38:08.081855] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T19:38:08.711728] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-26T19:38:09.511708] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-26T19:38:09.586553] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T19:38:10.311708] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-26T19:38:10.565628] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T19:38:10.748882] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-26T19:38:11.111721] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-26T19:38:11.911696] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-26T19:38:11.944362] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-26T19:38:12.566249] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-26T19:38:12.711755] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-26T19:38:13.467225] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:38:13.511717] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-26T19:38:14.287190] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:38:14.311712] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-26T19:38:14.831267] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T19:38:15.111733] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-26T19:38:15.911727] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-26T19:38:16.001691] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:38:16.209727] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T19:38:16.711734] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-26T19:38:17.511730] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-26T19:38:17.795480] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-26T19:38:17.803634] [INFO ] [REMOTE ] KEP: Full fetch complete (41623 records). [2025-09-26T19:38:17.803880] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-26T19:38:18.304515] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-26T19:38:18.304632] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-26T19:38:18.305547] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-26T19:38:18.305620] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-26T19:38:18.306856] [DEBUG] [LOCAL ] KEP: Trimmed 41623 records to 31169 (keeping 200 days of data) [2025-09-26T19:38:18.311755] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-26T19:38:18.542024] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:38:18.566301] [DEBUG] [LOCAL ] KEP: Primary data saved (31169 records). [2025-09-26T19:38:18.566935] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-26T19:38:18.567071] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEP took 23.8s. Estimated remaining: 2h 38m 40s. Rate: 7.5 symbols/min [2025-09-26T19:38:18.757545] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:18.761908] [DEBUG] [LOCAL ] KF: Loaded 2476 existing records from primary storage. [2025-09-26T19:38:18.761993] [INFO ] [MAIN ] KF: Loaded 2476 existing records. [2025-09-26T19:38:18.963346] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:18.963893] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-26T19:38:18.964040] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-26T19:38:18.964437] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-26T19:38:18.964542] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-26T19:38:19.097246] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:38:19.127068] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-26T19:38:19.402678] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:19.911738] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-26T19:38:20.064409] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-26T19:38:20.711706] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-26T19:38:21.062096] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T19:38:21.375480] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-26T19:38:21.401952] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:38:21.511719] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-26T19:38:22.311824] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-26T19:38:23.111713] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-26T19:38:23.513147] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-26T19:38:23.640240] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:38:23.684065] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-26T19:38:23.911719] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-26T19:38:24.711718] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-26T19:38:25.511717] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-26T19:38:25.675867] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T19:38:26.130080] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-26T19:38:26.311787] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-26T19:38:26.789104] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-26T19:38:27.111727] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-26T19:38:27.664299] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-26T19:38:27.731475] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T19:38:27.911735] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-26T19:38:28.449763] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-26T19:38:28.711721] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-26T19:38:29.511746] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-26T19:38:30.077415] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-26T19:38:30.311714] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-26T19:38:30.382320] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:38:31.111728] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-26T19:38:31.911715] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-26T19:38:32.054622] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T19:38:32.064576] [INFO ] [REMOTE ] KEX: Full fetch complete (55668 records). [2025-09-26T19:38:32.064773] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-26T19:38:32.547054] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-26T19:38:32.547215] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-26T19:38:32.548156] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-26T19:38:32.548277] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-26T19:38:32.560005] [DEBUG] [LOCAL ] KEX: Trimmed 55668 records to 38712 (keeping 200 days of data) [2025-09-26T19:38:32.577314] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-26T19:38:32.757940] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-26T19:38:32.825870] [DEBUG] [LOCAL ] KEX: Primary data saved (38712 records). [2025-09-26T19:38:32.826026] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-26T19:38:32.826116] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KEX took 35.0s. Estimated remaining: 2h 38m 38s. Rate: 7.5 symbols/min [2025-09-26T19:38:33.011196] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:33.031262] [DEBUG] [LOCAL ] KFRC: Loaded 19601 existing records from primary storage. [2025-09-26T19:38:33.031407] [INFO ] [MAIN ] KFRC: Loaded 19601 existing records. [2025-09-26T19:38:33.228034] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:33.228305] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-26T19:38:33.228355] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-26T19:38:33.229097] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-26T19:38:33.229162] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-26T19:38:33.521592] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-26T19:38:33.621180] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:33.982067] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T19:38:34.143833] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-26T19:38:34.314040] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-26T19:38:34.316887] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:38:35.111750] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-26T19:38:35.740622] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-26T19:38:35.911703] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-26T19:38:36.301378] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T19:38:36.711714] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-26T19:38:37.500228] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T19:38:37.511674] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-26T19:38:37.621775] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-26T19:38:38.311718] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-26T19:38:38.762970] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-26T19:38:39.111695] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-26T19:38:39.538242] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-26T19:38:39.553534] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T19:38:39.555260] [INFO ] [REMOTE ] KEY: Full fetch complete (77256 records). [2025-09-26T19:38:39.555392] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-26T19:38:39.757831] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T19:38:39.758673] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:38:39.758760] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:38:39.758823] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-26T19:38:39.758980] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-26T19:38:39.759025] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-26T19:38:39.759069] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-26T19:38:39.759164] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KEY took 35.7s. Estimated remaining: 2h 38m 29s. Rate: 7.5 symbols/min [2025-09-26T19:38:39.920411] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-26T19:38:39.944780] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:39.955862] [DEBUG] [LOCAL ] KFS: Loaded 8422 existing records from primary storage. [2025-09-26T19:38:39.956466] [INFO ] [MAIN ] KFS: Loaded 8422 existing records. [2025-09-26T19:38:40.141682] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:40.141983] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-26T19:38:40.142038] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-26T19:38:40.142610] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-26T19:38:40.142718] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-26T19:38:40.507802] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:40.711752] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-26T19:38:41.231605] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-26T19:38:41.232598] [INFO ] [REMOTE ] KF: Full fetch complete (3680 records). [2025-09-26T19:38:41.232696] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-26T19:38:41.529913] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-26T19:38:41.635553] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-26T19:38:41.635695] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-26T19:38:41.635872] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-26T19:38:41.636034] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-26T19:38:41.636630] [DEBUG] [LOCAL ] KF: Trimmed 3680 records to 2486 (keeping 200 days of data) [2025-09-26T19:38:41.652354] [DEBUG] [LOCAL ] KF: Primary data saved (2486 records). [2025-09-26T19:38:41.652445] [INFO ] [MAIN ] KF: Full history saved. [2025-09-26T19:38:41.652556] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KF took 23.1s. Estimated remaining: 2h 38m 15s. Rate: 7.5 symbols/min [2025-09-26T19:38:41.844419] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:41.870317] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-26T19:38:41.879632] [INFO ] [REMOTE ] KEYS: Full fetch complete (62974 records). [2025-09-26T19:38:41.879803] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-26T19:38:42.099349] [DEBUG] [LOCAL ] KFY: Loaded 30872 existing records from primary storage. [2025-09-26T19:38:42.120083] [INFO ] [MAIN ] KFY: Loaded 30872 existing records. [2025-09-26T19:38:42.313316] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-26T19:38:42.517419] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-26T19:38:42.527681] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-26T19:38:42.548454] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-26T19:38:42.555311] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-26T19:38:42.555122] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:42.555957] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-26T19:38:42.556041] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-26T19:38:42.557760] [DEBUG] [LOCAL ] KEYS: Trimmed 62974 records to 43955 (keeping 200 days of data) [2025-09-26T19:38:42.557957] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-26T19:38:42.558802] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-26T19:38:42.816381] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:38:43.034259] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-26T19:38:43.115922] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-26T19:38:43.292185] [DEBUG] [LOCAL ] KEYS: Primary data saved (43955 records). [2025-09-26T19:38:43.290355] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:43.292453] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-26T19:38:43.292941] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEYS took 37.4s. Estimated remaining: 2h 38m 0s. Rate: 7.5 symbols/min [2025-09-26T19:38:43.477146] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:43.536040] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-09-26T19:38:43.536227] [INFO ] [MAIN ] KGC: Loaded 54089 existing records. [2025-09-26T19:38:43.724363] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:38:43.724698] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-26T19:38:43.724755] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-26T19:38:43.726280] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-26T19:38:43.726342] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-26T19:38:43.924014] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-26T19:38:44.143215] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:38:44.155246] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-26T19:38:44.666226] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-26T19:38:44.711685] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-26T19:38:45.511758] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-26T19:38:46.311772] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-26T19:38:46.436348] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T19:38:46.538901] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-26T19:38:46.880229] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T19:38:47.111717] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-26T19:38:47.911752] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-26T19:38:48.179970] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T19:38:48.711741] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-26T19:38:49.511713] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-26T19:38:49.602980] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-26T19:38:49.628815] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T19:38:50.124453] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T19:38:50.311768] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-26T19:38:51.059316] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-26T19:38:51.111777] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-26T19:38:51.911758] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-26T19:38:52.492812] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T19:38:52.632233] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-26T19:38:52.711776] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-26T19:38:53.511730] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-26T19:38:54.311736] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-26T19:38:54.669984] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-26T19:38:54.724253] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-26T19:38:54.875106] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-26T19:38:55.111723] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-26T19:38:55.911692] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-26T19:38:56.064922] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-26T19:38:56.706262] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:38:56.711661] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-26T19:38:57.468623] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-26T19:38:57.511713] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-26T19:38:58.311718] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-26T19:38:59.111762] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-26T19:38:59.223219] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-26T19:38:59.225768] [INFO ] [REMOTE ] KFS: Full fetch complete (10544 records). [2025-09-26T19:38:59.225839] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-26T19:38:59.634835] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-26T19:38:59.635012] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-26T19:38:59.635413] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-26T19:38:59.635499] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-26T19:38:59.677568] [DEBUG] [LOCAL ] KFS: Trimmed 10544 records to 8471 (keeping 200 days of data) [2025-09-26T19:38:59.683907] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-26T19:38:59.749571] [DEBUG] [LOCAL ] KFS: Primary data saved (8471 records). [2025-09-26T19:38:59.749756] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-26T19:38:59.749881] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 20.0s. Estimated remaining: 2h 38m 1s. Rate: 7.5 symbols/min [2025-09-26T19:38:59.915936] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-26T19:38:59.942879] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:38:59.962857] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-26T19:39:00.014916] [DEBUG] [LOCAL ] KGS: Loaded 46108 existing records from primary storage. [2025-09-26T19:39:00.015123] [INFO ] [MAIN ] KGS: Loaded 46108 existing records. [2025-09-26T19:39:00.213024] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:00.213329] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-26T19:39:00.213379] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-26T19:39:00.214731] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-26T19:39:00.214794] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-26T19:39:00.608741] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:00.711722] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-26T19:39:01.321531] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-26T19:39:01.511807] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-26T19:39:02.311721] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-26T19:39:02.419715] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-26T19:39:03.111682] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-26T19:39:03.526547] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-26T19:39:03.630272] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T19:39:03.911721] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-26T19:39:04.711722] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-26T19:39:04.866392] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T19:39:05.310580] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-26T19:39:05.316382] [INFO ] [REMOTE ] KFRC: Full fetch complete (25430 records). [2025-09-26T19:39:05.316607] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-26T19:39:05.516839] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-26T19:39:05.735370] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-26T19:39:05.735452] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-26T19:39:05.736102] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-26T19:39:05.736167] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-26T19:39:05.736920] [DEBUG] [LOCAL ] KFRC: Trimmed 25430 records to 19766 (keeping 200 days of data) [2025-09-26T19:39:05.861572] [DEBUG] [LOCAL ] KFRC: Primary data saved (19766 records). [2025-09-26T19:39:05.861748] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-26T19:39:05.861843] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFRC took 33.0s. Estimated remaining: 2h 37m 51s. Rate: 7.5 symbols/min [2025-09-26T19:39:06.036272] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:06.087047] [DEBUG] [LOCAL ] KIM: Loaded 53446 existing records from primary storage. [2025-09-26T19:39:06.087208] [INFO ] [MAIN ] KIM: Loaded 53446 existing records. [2025-09-26T19:39:06.276256] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:06.276506] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-26T19:39:06.276555] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-26T19:39:06.278093] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-26T19:39:06.278156] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-26T19:39:06.324788] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-26T19:39:06.672473] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:06.815045] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-26T19:39:07.111738] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-26T19:39:07.228618] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T19:39:07.710161] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-26T19:39:07.911752] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-26T19:39:08.711731] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-26T19:39:09.046962] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-26T19:39:09.204100] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T19:39:09.511740] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-26T19:39:10.206869] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T19:39:10.311725] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-26T19:39:10.744905] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T19:39:11.111721] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-26T19:39:11.911726] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-26T19:39:12.016639] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-26T19:39:12.624886] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:39:12.711708] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-26T19:39:13.511702] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-26T19:39:13.929681] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-26T19:39:13.963613] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-26T19:39:14.311737] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-26T19:39:15.108021] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-26T19:39:15.116991] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-26T19:39:15.174620] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-26T19:39:15.911754] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-26T19:39:16.711776] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-26T19:39:17.283871] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-26T19:39:17.511753] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-26T19:39:17.568837] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-26T19:39:18.311771] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-26T19:39:18.410806] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-26T19:39:18.745927] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T19:39:18.757592] [INFO ] [REMOTE ] KFY: Full fetch complete (43666 records). [2025-09-26T19:39:18.757976] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-26T19:39:19.117091] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-26T19:39:19.351424] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-26T19:39:19.351565] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-26T19:39:19.353684] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-26T19:39:19.353810] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-26T19:39:19.355487] [DEBUG] [LOCAL ] KFY: Trimmed 43666 records to 31057 (keeping 200 days of data) [2025-09-26T19:39:19.626664] [DEBUG] [LOCAL ] KFY: Primary data saved (31057 records). [2025-09-26T19:39:19.626839] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-26T19:39:19.627007] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KFY took 38.0s. Estimated remaining: 2h 37m 48s. Rate: 7.5 symbols/min [2025-09-26T19:39:19.860307] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:19.893983] [DEBUG] [LOCAL ] KIO: Loaded 21449 existing records from primary storage. [2025-09-26T19:39:19.894162] [INFO ] [MAIN ] KIO: Loaded 21449 existing records. [2025-09-26T19:39:19.933464] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-26T19:39:20.105904] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:20.106197] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-26T19:39:20.106277] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-26T19:39:20.107061] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-26T19:39:20.107136] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-26T19:39:20.520300] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:20.657693] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-26T19:39:20.701609] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-26T19:39:20.711685] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-26T19:39:20.714246] [INFO ] [REMOTE ] KGC: Full fetch complete (77695 records). [2025-09-26T19:39:20.714367] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-26T19:39:21.125704] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-26T19:39:21.125819] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-26T19:39:21.126987] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-26T19:39:21.127066] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-26T19:39:21.129019] [DEBUG] [LOCAL ] KGC: Trimmed 77695 records to 54479 (keeping 200 days of data) [2025-09-26T19:39:21.479829] [DEBUG] [LOCAL ] KGC: Primary data saved (54479 records). [2025-09-26T19:39:21.479981] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-26T19:39:21.480083] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGC took 38.2s. Estimated remaining: 2h 37m 34s. Rate: 7.5 symbols/min [2025-09-26T19:39:21.516744] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-26T19:39:21.678569] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:21.746957] [DEBUG] [LOCAL ] KKR: Loaded 53891 existing records from primary storage. [2025-09-26T19:39:21.747265] [INFO ] [MAIN ] KKR: Loaded 53891 existing records. [2025-09-26T19:39:21.901169] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-26T19:39:21.981944] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:21.982532] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-26T19:39:21.982591] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-26T19:39:21.984139] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-26T19:39:21.984202] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-26T19:39:22.315871] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-26T19:39:22.365196] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:22.393208] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T19:39:22.735164] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-26T19:39:23.111733] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-26T19:39:23.911773] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-26T19:39:24.285905] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T19:39:24.711755] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-26T19:39:24.985602] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-26T19:39:25.063483] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-26T19:39:25.511788] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-26T19:39:26.332466] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-26T19:39:26.338964] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:39:26.704339] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T19:39:27.111732] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-26T19:39:27.911707] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-26T19:39:28.212339] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:39:28.696487] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T19:39:28.711691] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-26T19:39:29.509212] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:39:29.519848] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-26T19:39:30.311743] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-26T19:39:30.566037] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:39:30.576469] [INFO ] [REMOTE ] KGS: Full fetch complete (66134 records). [2025-09-26T19:39:30.576711] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-26T19:39:30.867435] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-26T19:39:31.005021] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-26T19:39:31.005127] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-26T19:39:31.006220] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-26T19:39:31.006290] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-26T19:39:31.008237] [DEBUG] [LOCAL ] KGS: Trimmed 66134 records to 46487 (keeping 200 days of data) [2025-09-26T19:39:31.114680] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-26T19:39:31.308939] [DEBUG] [LOCAL ] KGS: Primary data saved (46487 records). [2025-09-26T19:39:31.309254] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-26T19:39:31.309399] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KGS took 31.6s. Estimated remaining: 2h 37m 28s. Rate: 7.5 symbols/min [2025-09-26T19:39:31.484183] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:31.494539] [DEBUG] [LOCAL ] KKRS: Loaded 5781 existing records from primary storage. [2025-09-26T19:39:31.494750] [INFO ] [MAIN ] KKRS: Loaded 5781 existing records. [2025-09-26T19:39:31.686192] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:31.686563] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-26T19:39:31.686616] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-26T19:39:31.687163] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-26T19:39:31.687241] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-26T19:39:31.924736] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-26T19:39:32.133751] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:32.185398] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-26T19:39:32.711737] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-26T19:39:32.965979] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-26T19:39:33.057753] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-26T19:39:33.511800] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-26T19:39:34.311717] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-26T19:39:34.369196] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T19:39:34.406633] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T19:39:35.111747] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-26T19:39:35.356722] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-26T19:39:35.693757] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T19:39:35.911732] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-26T19:39:36.711752] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-26T19:39:37.374885] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-26T19:39:37.511761] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-26T19:39:37.892847] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T19:39:38.311736] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-26T19:39:38.348766] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T19:39:39.111716] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-26T19:39:39.719775] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-26T19:39:39.911701] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-26T19:39:40.228801] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-26T19:39:40.711726] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-26T19:39:41.511727] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-26T19:39:41.944320] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-26T19:39:42.216110] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-26T19:39:42.311712] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-26T19:39:42.933706] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-26T19:39:43.111726] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-26T19:39:43.586406] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T19:39:43.821082] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-26T19:39:43.911726] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-26T19:39:44.711757] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-26T19:39:44.930174] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:39:45.511725] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-26T19:39:46.311742] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-26T19:39:46.735177] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:39:46.745559] [INFO ] [REMOTE ] KIM: Full fetch complete (76822 records). [2025-09-26T19:39:46.745842] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-26T19:39:46.890197] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-26T19:39:46.928801] [INFO ] [REMOTE ] KIO: Full fetch complete (30935 records). [2025-09-26T19:39:47.020283] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-26T19:39:47.087840] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-26T19:39:47.125317] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-26T19:39:47.397909] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-26T19:39:47.422824] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-26T19:39:47.446511] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-26T19:39:47.451859] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-26T19:39:47.571608] [DEBUG] [LOCAL ] KIM: Trimmed 76822 records to 53831 (keeping 200 days of data) [2025-09-26T19:39:47.754229] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-26T19:39:47.754903] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-26T19:39:47.755540] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-26T19:39:47.755619] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-26T19:39:47.759051] [DEBUG] [LOCAL ] KIO: Trimmed 30935 records to 21625 (keeping 200 days of data) [2025-09-26T19:39:47.910441] [DEBUG] [LOCAL ] KIO: Primary data saved (21625 records). [2025-09-26T19:39:47.910929] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-26T19:39:47.911437] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KIO took 28.3s. Estimated remaining: 2h 37m 28s. Rate: 7.5 symbols/min [2025-09-26T19:39:47.912185] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-26T19:39:48.227825] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:48.229023] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-26T19:39:48.229373] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-26T19:39:48.230911] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-26T19:39:48.231220] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-26T19:39:48.232412] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-26T19:39:48.233001] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-26T19:39:48.570048] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-26T19:39:48.674393] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:48.716084] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-26T19:39:48.770213] [DEBUG] [LOCAL ] KIM: Primary data saved (53831 records). [2025-09-26T19:39:48.770387] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-26T19:39:48.770519] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KIM took 42.9s. Estimated remaining: 2h 37m 13s. Rate: 7.5 symbols/min [2025-09-26T19:39:48.951061] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:48.951272] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-26T19:39:48.951330] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-26T19:39:48.951476] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-26T19:39:48.951520] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-26T19:39:48.951566] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-26T19:39:48.951623] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-26T19:39:49.254714] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T19:39:49.365367] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:49.395398] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-26T19:39:49.511720] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-26T19:39:50.231159] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-26T19:39:50.232626] [INFO ] [REMOTE ] KKRS: Full fetch complete (8008 records). [2025-09-26T19:39:50.232763] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-26T19:39:50.316936] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-26T19:39:50.582937] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:50.612881] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-26T19:39:50.646878] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-26T19:39:50.646998] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-26T19:39:50.647215] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-26T19:39:50.647255] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-26T19:39:50.648201] [DEBUG] [LOCAL ] KKRS: Trimmed 8008 records to 5801 (keeping 200 days of data) [2025-09-26T19:39:50.691087] [DEBUG] [LOCAL ] KKRS: Primary data saved (5801 records). [2025-09-26T19:39:50.691216] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-26T19:39:50.691303] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KKRS took 19.4s. Estimated remaining: 2h 36m 59s. Rate: 7.5 symbols/min [2025-09-26T19:39:50.868326] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:39:50.921135] [DEBUG] [LOCAL ] KLC: Loaded 36807 existing records from primary storage. [2025-09-26T19:39:50.921279] [INFO ] [MAIN ] KLC: Loaded 36807 existing records. [2025-09-26T19:39:51.113593] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-26T19:39:51.118992] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:39:51.119268] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-26T19:39:51.119332] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-26T19:39:51.120411] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-26T19:39:51.120477] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-26T19:39:51.413239] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:51.416613] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-26T19:39:51.494088] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:39:51.911742] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-26T19:39:52.711729] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-26T19:39:53.511690] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-26T19:39:53.549449] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T19:39:53.719618] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:53.720041] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-26T19:39:54.321201] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-26T19:39:54.328339] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-26T19:39:55.111718] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-26T19:39:55.345806] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:55.346164] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-26T19:39:55.648031] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T19:39:55.911736] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-26T19:39:56.711685] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-26T19:39:57.082705] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-26T19:39:57.511747] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-26T19:39:57.713090] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:57.713443] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-26T19:39:58.311720] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-26T19:39:58.538311] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:39:58.538698] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-26T19:39:58.601488] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-26T19:39:59.111729] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-26T19:39:59.911733] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-26T19:40:00.711722] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-26T19:40:00.996253] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:00.996596] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-26T19:40:01.262807] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T19:40:01.274248] [INFO ] [REMOTE ] KKR: Full fetch complete (77442 records). [2025-09-26T19:40:01.274418] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-26T19:40:01.525719] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-26T19:40:01.766031] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T19:40:01.766314] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-26T19:40:01.776069] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-26T19:40:01.777824] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-26T19:40:01.777940] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-26T19:40:01.779956] [DEBUG] [LOCAL ] KKR: Trimmed 77442 records to 54281 (keeping 200 days of data) [2025-09-26T19:40:01.793834] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:01.794176] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-26T19:40:02.169514] [DEBUG] [LOCAL ] KKR: Primary data saved (54281 records). [2025-09-26T19:40:02.169716] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-26T19:40:02.171823] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KKR took 40.7s. Estimated remaining: 2h 36m 55s. Rate: 7.5 symbols/min [2025-09-26T19:40:02.311751] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-26T19:40:03.111720] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-26T19:40:03.339819] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:03.340159] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-26T19:40:03.902133] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:40:03.911679] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-26T19:40:04.145991] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:04.146404] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-26T19:40:04.711720] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-26T19:40:05.511759] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-26T19:40:05.718603] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:05.719051] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-26T19:40:06.311706] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-26T19:40:06.342508] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:40:06.801778] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-26T19:40:07.111725] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-26T19:40:07.318034] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:07.318469] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-26T19:40:07.911740] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-26T19:40:08.711712] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-26T19:40:09.135541] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-26T19:40:09.511742] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-26T19:40:09.708705] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:09.709054] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-26T19:40:10.005302] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T19:40:10.311735] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-26T19:40:11.111754] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-26T19:40:11.139586] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T19:40:11.315747] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:40:11.316157] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-26T19:40:11.911749] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-26T19:40:12.707846] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-26T19:40:12.711988] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-26T19:40:13.511729] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-26T19:40:14.311712] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-26T19:40:14.705119] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T19:40:14.712538] [INFO ] [REMOTE ] KLAR: Full fetch complete (4802 records). [2025-09-26T19:40:14.712726] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-26T19:40:14.919841] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 13 unique days, need 200 days [2025-09-26T19:40:14.920241] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:40:14.920334] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:40:14.920411] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-26T19:40:14.920703] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-26T19:40:14.920761] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-26T19:40:14.928138] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-26T19:40:14.941599] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KLAR took 26.2s. Estimated remaining: 2h 36m 51s. Rate: 7.5 symbols/min [2025-09-26T19:40:14.943620] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:40:15.111725] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-26T19:40:15.354749] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:40:15.357332] [INFO ] [REMOTE ] KKRT: Full fetch complete (8662 records). [2025-09-26T19:40:15.357529] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-26T19:40:15.547035] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 83 unique days, need 200 days [2025-09-26T19:40:15.547321] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:40:15.547393] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:40:15.547466] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-26T19:40:15.547535] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-26T19:40:15.547579] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-26T19:40:15.547690] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-26T19:40:15.547778] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KKRT took 27.6s. Estimated remaining: 2h 36m 36s. Rate: 7.5 symbols/min [2025-09-26T19:40:16.703976] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T19:40:16.712954] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-26T19:40:19.599800] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-09-26T19:40:19.607483] [INFO ] [REMOTE ] KLC: Full fetch complete (50788 records). [2025-09-26T19:40:19.607598] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-26T19:40:20.026596] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-26T19:40:20.026726] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-26T19:40:20.027832] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-26T19:40:20.027906] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-26T19:40:20.029301] [DEBUG] [LOCAL ] KLC: Trimmed 50788 records to 37107 (keeping 200 days of data) [2025-09-26T19:40:20.263063] [DEBUG] [LOCAL ] KLC: Primary data saved (37107 records). [2025-09-26T19:40:20.263245] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-26T19:40:20.263349] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KLC took 29.6s. Estimated remaining: 2h 36m 25s. Rate: 7.5 symbols/min [2025-09-26T19:40:20.830685] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:21.000739] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:21.031994] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:21.051337] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:21.060000] [DEBUG] [LOCAL ] KMPB: Loaded 3623 existing records from primary storage. [2025-09-26T19:40:21.060306] [INFO ] [MAIN ] KMPB: Loaded 3623 existing records. [2025-09-26T19:40:21.321830] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:21.321993] [DEBUG] [LOCAL ] KMPR: Loaded 38785 existing records from primary storage. [2025-09-26T19:40:21.349480] [DEBUG] [LOCAL ] KMT: Loaded 43390 existing records from primary storage. [2025-09-26T19:40:21.348857] [INFO ] [MAIN ] KMPR: Loaded 38785 existing records. [2025-09-26T19:40:21.350279] [INFO ] [MAIN ] KMT: Loaded 43390 existing records. [2025-09-26T19:40:21.350131] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-09-26T19:40:21.355754] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-26T19:40:21.398550] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-26T19:40:21.416530] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-09-26T19:40:21.448742] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-26T19:40:21.448888] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-26T19:40:22.060374] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:22.115234] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:22.147941] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-26T19:40:22.206282] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:22.213924] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-26T19:40:22.195890] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-26T19:40:22.225934] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-26T19:40:22.236344] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-26T19:40:22.233773] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-26T19:40:22.272172] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-26T19:40:22.272334] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-26T19:40:22.272085] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-26T19:40:22.307797] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-26T19:40:22.313176] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-26T19:40:22.471210] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-26T19:40:22.824154] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:22.908067] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-26T19:40:23.507031] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:23.531817] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-26T19:40:23.584685] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:23.595859] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-26T19:40:23.659707] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:23.660303] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-26T19:40:23.795945] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-26T19:40:23.797453] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-26T19:40:24.268480] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-26T19:40:24.269898] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-26T19:40:24.720010] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-26T19:40:24.721470] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-26T19:40:25.002156] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T19:40:25.008406] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-26T19:40:25.186506] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:40:25.200186] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-26T19:40:25.304722] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-26T19:40:25.306534] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-26T19:40:25.653352] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-26T19:40:25.671278] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-26T19:40:25.854485] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-26T19:40:25.855957] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-26T19:40:26.164539] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T19:40:26.216577] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-26T19:40:26.311733] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-26T19:40:26.783807] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:40:26.888934] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-26T19:40:27.111730] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-26T19:40:27.581070] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-26T19:40:27.911728] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-26T19:40:28.377996] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-26T19:40:28.717672] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-26T19:40:28.734704] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:40:29.511775] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-26T19:40:30.001907] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-26T19:40:30.311721] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-26T19:40:31.111730] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-26T19:40:31.335317] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:40:31.526371] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T19:40:31.709373] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-26T19:40:31.911745] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-26T19:40:32.538103] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-26T19:40:32.539514] [INFO ] [REMOTE ] KMPB: Full fetch complete (4939 records). [2025-09-26T19:40:32.539589] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-26T19:40:32.723286] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-26T19:40:32.963198] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-26T19:40:32.963333] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-26T19:40:32.963509] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-26T19:40:32.963550] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-26T19:40:32.963962] [DEBUG] [LOCAL ] KMPB: Trimmed 4939 records to 3646 (keeping 200 days of data) [2025-09-26T19:40:32.986859] [DEBUG] [LOCAL ] KMPB: Primary data saved (3646 records). [2025-09-26T19:40:32.986967] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-26T19:40:32.987064] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 12.7s. Estimated remaining: 2h 36m 21s. Rate: 7.5 symbols/min [2025-09-26T19:40:33.166343] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:33.221581] [DEBUG] [LOCAL ] KMX: Loaded 53507 existing records from primary storage. [2025-09-26T19:40:33.221760] [INFO ] [MAIN ] KMX: Loaded 53507 existing records. [2025-09-26T19:40:33.407501] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:33.407784] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-26T19:40:33.407836] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-26T19:40:33.409320] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-26T19:40:33.409389] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-26T19:40:33.517134] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-26T19:40:33.793153] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:34.311717] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-26T19:40:34.603011] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T19:40:35.111721] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-26T19:40:35.190914] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:40:35.911694] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-26T19:40:36.078466] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-26T19:40:36.711719] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-26T19:40:36.759424] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:40:37.176208] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-26T19:40:37.511775] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-26T19:40:38.311725] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-26T19:40:38.369927] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-26T19:40:38.998783] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:40:39.111768] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-26T19:40:39.723461] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T19:40:39.911737] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-26T19:40:40.711715] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-26T19:40:40.972104] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T19:40:41.275034] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-26T19:40:41.511725] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-26T19:40:42.067473] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T19:40:42.311717] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-26T19:40:43.111716] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-26T19:40:43.261599] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-26T19:40:43.911716] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-26T19:40:43.992414] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-26T19:40:44.476801] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-26T19:40:44.711755] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-26T19:40:45.511746] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-26T19:40:46.068036] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-26T19:40:46.311725] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-26T19:40:46.676542] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-26T19:40:47.016880] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-26T19:40:47.111742] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-26T19:40:47.810804] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-26T19:40:47.911743] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-26T19:40:48.711735] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-26T19:40:48.780919] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:40:49.511692] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-26T19:40:49.958590] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-26T19:40:50.029312] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-26T19:40:50.311753] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-26T19:40:51.010577] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:40:51.111758] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-26T19:40:51.911691] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-26T19:40:52.400605] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T19:40:52.411690] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-26T19:40:52.411957] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-26T19:40:52.716311] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-26T19:40:52.877223] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-26T19:40:52.877618] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-26T19:40:52.879515] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-26T19:40:52.881460] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-26T19:40:52.881334] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-26T19:40:52.894613] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54473 (keeping 200 days of data) [2025-09-26T19:40:53.266797] [DEBUG] [LOCAL ] KMI: Primary data saved (54473 records). [2025-09-26T19:40:53.267094] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-26T19:40:53.267291] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMI took 33.0s. Estimated remaining: 2h 36m 25s. Rate: 7.5 symbols/min [2025-09-26T19:40:53.456799] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:53.500038] [DEBUG] [LOCAL ] KN: Loaded 39156 existing records from primary storage. [2025-09-26T19:40:53.500217] [INFO ] [MAIN ] KN: Loaded 39156 existing records. [2025-09-26T19:40:53.532528] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-26T19:40:53.726013] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:53.726595] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-26T19:40:53.726807] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-26T19:40:53.728083] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-26T19:40:53.728313] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-26T19:40:53.919769] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-26T19:40:54.313323] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-26T19:40:54.424057] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:54.451178] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T19:40:54.460386] [INFO ] [REMOTE ] KMT: Full fetch complete (62054 records). [2025-09-26T19:40:54.460598] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-26T19:40:54.862172] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-26T19:40:54.862284] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-26T19:40:54.863347] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-26T19:40:54.863435] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-26T19:40:54.865397] [DEBUG] [LOCAL ] KMT: Trimmed 62054 records to 43687 (keeping 200 days of data) [2025-09-26T19:40:55.113697] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-26T19:40:55.162222] [DEBUG] [LOCAL ] KMT: Primary data saved (43687 records). [2025-09-26T19:40:55.162389] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-26T19:40:55.162499] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMT took 34.9s. Estimated remaining: 2h 36m 11s. Rate: 7.5 symbols/min [2025-09-26T19:40:55.365999] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:55.398927] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-26T19:40:55.408745] [INFO ] [REMOTE ] KMPR: Full fetch complete (51000 records). [2025-09-26T19:40:55.408862] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-26T19:40:55.566492] [DEBUG] [LOCAL ] KNF: Loaded 36152 existing records from primary storage. [2025-09-26T19:40:55.576972] [INFO ] [MAIN ] KNF: Loaded 36152 existing records. [2025-09-26T19:40:56.061977] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:56.079977] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-26T19:40:56.080338] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-26T19:40:56.080569] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-26T19:40:56.080625] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-26T19:40:56.082215] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-26T19:40:56.082306] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-26T19:40:56.082786] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-26T19:40:56.083296] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-26T19:40:56.167938] [DEBUG] [LOCAL ] KMPR: Trimmed 51000 records to 39117 (keeping 200 days of data) [2025-09-26T19:40:56.827320] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-26T19:40:56.855440] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:56.875706] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-26T19:40:56.889092] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-26T19:40:56.921278] [DEBUG] [LOCAL ] KMPR: Primary data saved (39117 records). [2025-09-26T19:40:56.923468] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-26T19:40:56.922320] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-26T19:40:56.933074] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMPR took 36.7s. Estimated remaining: 2h 35m 57s. Rate: 7.5 symbols/min [2025-09-26T19:40:57.115185] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:40:57.126006] [DEBUG] [LOCAL ] KNOP: Loaded 10121 existing records from primary storage. [2025-09-26T19:40:57.126111] [INFO ] [MAIN ] KNOP: Loaded 10121 existing records. [2025-09-26T19:40:57.318196] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:40:57.318626] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-26T19:40:57.318714] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-26T19:40:57.319903] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-26T19:40:57.319969] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-26T19:40:57.543831] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-26T19:40:57.697941] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:40:58.257886] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-26T19:40:58.311715] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-26T19:40:58.787206] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-26T19:40:58.988344] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-26T19:40:59.111725] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-26T19:40:59.274230] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-26T19:40:59.911725] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-26T19:41:00.711721] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-26T19:41:01.004367] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-26T19:41:01.279433] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-26T19:41:01.289679] [INFO ] [REMOTE ] KMX: Full fetch complete (75973 records). [2025-09-26T19:41:01.289829] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-26T19:41:01.521026] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-26T19:41:01.735667] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-26T19:41:01.735779] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-26T19:41:01.736938] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-26T19:41:01.737014] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-26T19:41:01.738719] [DEBUG] [LOCAL ] KMX: Trimmed 75973 records to 53897 (keeping 200 days of data) [2025-09-26T19:41:02.080980] [DEBUG] [LOCAL ] KMX: Primary data saved (53897 records). [2025-09-26T19:41:02.081181] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-26T19:41:02.081359] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KMX took 29.1s. Estimated remaining: 2h 35m 46s. Rate: 7.5 symbols/min [2025-09-26T19:41:02.281003] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:02.292257] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-26T19:41:02.316779] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-26T19:41:02.318397] [DEBUG] [LOCAL ] KNSL: Loaded 18261 existing records from primary storage. [2025-09-26T19:41:02.318474] [INFO ] [MAIN ] KNSL: Loaded 18261 existing records. [2025-09-26T19:41:02.509101] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:02.509357] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-26T19:41:02.509405] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-26T19:41:02.511790] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-26T19:41:02.511856] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-26T19:41:02.902503] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:02.932343] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:41:03.111696] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-26T19:41:03.174189] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-26T19:41:03.911738] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-26T19:41:04.650386] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-26T19:41:04.652294] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-26T19:41:04.711753] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-26T19:41:05.511736] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-26T19:41:05.676992] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-26T19:41:06.311773] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-26T19:41:06.844959] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-26T19:41:07.111720] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-26T19:41:07.205382] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T19:41:07.911733] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-26T19:41:08.578525] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T19:41:08.711745] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-26T19:41:08.727248] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-26T19:41:09.511724] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-26T19:41:09.770895] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-26T19:41:10.311721] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-26T19:41:10.796876] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-26T19:41:11.111715] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-26T19:41:11.786042] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-26T19:41:11.911710] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-26T19:41:12.488484] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-26T19:41:12.715997] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-26T19:41:12.719997] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-26T19:41:13.511733] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-26T19:41:14.260463] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T19:41:14.311723] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-26T19:41:14.345948] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-26T19:41:15.111699] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-26T19:41:15.446022] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-26T19:41:15.911740] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-26T19:41:16.633609] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T19:41:16.711738] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-26T19:41:16.975862] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-26T19:41:17.511723] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-26T19:41:17.543284] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-26T19:41:18.311761] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-26T19:41:18.472894] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-26T19:41:19.111723] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-26T19:41:19.668908] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-26T19:41:19.911721] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-26T19:41:20.411540] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T19:41:20.419770] [INFO ] [REMOTE ] KN: Full fetch complete (56407 records). [2025-09-26T19:41:20.419949] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-26T19:41:20.716846] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-26T19:41:20.858003] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-26T19:41:20.858228] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-26T19:41:20.859114] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-26T19:41:20.859196] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-26T19:41:20.860540] [DEBUG] [LOCAL ] KN: Trimmed 56407 records to 39393 (keeping 200 days of data) [2025-09-26T19:41:20.987064] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-26T19:41:21.114418] [DEBUG] [LOCAL ] KN: Primary data saved (39393 records). [2025-09-26T19:41:21.114578] [INFO ] [MAIN ] KN: Full history saved. [2025-09-26T19:41:21.114691] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KN took 27.8s. Estimated remaining: 2h 35m 49s. Rate: 7.5 symbols/min [2025-09-26T19:41:21.297563] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:21.339894] [DEBUG] [LOCAL ] KNTK: Loaded 46447 existing records from primary storage. [2025-09-26T19:41:21.340040] [INFO ] [MAIN ] KNTK: Loaded 46447 existing records. [2025-09-26T19:41:21.514215] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-26T19:41:21.558237] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-26T19:41:21.558598] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:21.562622] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-26T19:41:21.563045] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-26T19:41:21.564178] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-26T19:41:21.564272] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-26T19:41:21.978060] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:22.311721] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-26T19:41:23.027379] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:41:23.111736] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-26T19:41:23.407776] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-26T19:41:23.911737] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-26T19:41:24.629438] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-26T19:41:24.711689] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-26T19:41:24.922598] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T19:41:24.925289] [INFO ] [REMOTE ] KNOP: Full fetch complete (14697 records). [2025-09-26T19:41:24.925458] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-26T19:41:25.319559] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-26T19:41:25.319639] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-26T19:41:25.320027] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-26T19:41:25.320068] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-26T19:41:25.320589] [DEBUG] [LOCAL ] KNOP: Trimmed 14697 records to 10274 (keeping 200 days of data) [2025-09-26T19:41:25.383209] [DEBUG] [LOCAL ] KNOP: Primary data saved (10274 records). [2025-09-26T19:41:25.383365] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-26T19:41:25.383457] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KNOP took 28.5s. Estimated remaining: 2h 35m 37s. Rate: 7.5 symbols/min [2025-09-26T19:41:25.516880] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-26T19:41:25.574067] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:25.634088] [DEBUG] [LOCAL ] KNX: Loaded 52981 existing records from primary storage. [2025-09-26T19:41:25.634272] [INFO ] [MAIN ] KNX: Loaded 52981 existing records. [2025-09-26T19:41:25.824270] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:25.824559] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-26T19:41:25.824614] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-26T19:41:25.825916] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-26T19:41:25.826001] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-26T19:41:26.201125] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:41:26.247924] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:26.311718] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-26T19:41:26.883532] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-26T19:41:27.111719] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-26T19:41:27.877609] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-26T19:41:27.911711] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-26T19:41:28.504300] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T19:41:28.711726] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-26T19:41:29.202015] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T19:41:29.511739] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-26T19:41:30.311736] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-26T19:41:30.348513] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-26T19:41:30.356301] [INFO ] [REMOTE ] KNF: Full fetch complete (50623 records). [2025-09-26T19:41:30.356473] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-26T19:41:30.759055] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-26T19:41:30.759145] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-26T19:41:30.760012] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-26T19:41:30.760080] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-26T19:41:30.761577] [DEBUG] [LOCAL ] KNF: Trimmed 50623 records to 36435 (keeping 200 days of data) [2025-09-26T19:41:31.025606] [DEBUG] [LOCAL ] KNF: Primary data saved (36435 records). [2025-09-26T19:41:31.026251] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-26T19:41:31.026800] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNF took 35.9s. Estimated remaining: 2h 35m 27s. Rate: 7.5 symbols/min [2025-09-26T19:41:31.028011] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:41:31.115025] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-26T19:41:31.240132] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:31.240358] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-26T19:41:31.240415] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-26T19:41:31.240587] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-26T19:41:31.240635] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-26T19:41:31.240724] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-26T19:41:31.240765] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-26T19:41:31.631018] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:31.743730] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-26T19:41:31.911762] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-26T19:41:32.019758] [DEBUG] [REMOTE ] KO: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-26T19:41:32.020207] [WARN ] [REMOTE ] KO: No data returned for month 2024-12 [2025-09-26T19:41:32.161617] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-26T19:41:32.711735] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-26T19:41:33.511879] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-26T19:41:33.962148] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-26T19:41:33.966558] [INFO ] [REMOTE ] KNSL: Full fetch complete (26678 records). [2025-09-26T19:41:33.966768] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-26T19:41:34.313535] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-26T19:41:34.407725] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-26T19:41:34.407820] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-26T19:41:34.408504] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-26T19:41:34.408568] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-26T19:41:34.409328] [DEBUG] [LOCAL ] KNSL: Trimmed 26678 records to 18372 (keeping 200 days of data) [2025-09-26T19:41:34.531167] [DEBUG] [LOCAL ] KNSL: Primary data saved (18372 records). [2025-09-26T19:41:34.531362] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-26T19:41:34.531458] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNSL took 32.4s. Estimated remaining: 2h 35m 15s. Rate: 7.5 symbols/min [2025-09-26T19:41:34.726499] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:34.766834] [DEBUG] [LOCAL ] KODK: Loaded 43657 existing records from primary storage. [2025-09-26T19:41:34.767016] [INFO ] [MAIN ] KODK: Loaded 43657 existing records. [2025-09-26T19:41:34.957569] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:34.958052] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-26T19:41:34.958232] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-26T19:41:34.959346] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-26T19:41:34.959425] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-26T19:41:35.124713] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-26T19:41:35.218628] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-26T19:41:35.389214] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:35.911769] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-26T19:41:36.711724] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-26T19:41:36.863490] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:41:36.962964] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-26T19:41:37.126717] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-26T19:41:37.511796] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-26T19:41:38.311722] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-26T19:41:38.455130] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:41:39.111808] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-26T19:41:39.911695] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-26T19:41:39.994030] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-26T19:41:40.174730] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-26T19:41:40.711726] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-26T19:41:40.874930] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T19:41:41.194450] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-26T19:41:41.511818] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-26T19:41:42.311735] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-26T19:41:42.684238] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-26T19:41:42.989804] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T19:41:43.111732] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-26T19:41:43.911714] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-26T19:41:44.711898] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-26T19:41:44.918524] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-26T19:41:44.974350] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T19:41:45.511793] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-26T19:41:45.556346] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T19:41:46.289668] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T19:41:46.311675] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-26T19:41:47.111786] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-26T19:41:47.223048] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:41:47.911731] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-26T19:41:48.069989] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-26T19:41:48.710675] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:41:48.719573] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-26T19:41:49.511838] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-26T19:41:50.311754] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-26T19:41:50.573026] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-26T19:41:50.627689] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T19:41:51.111795] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-26T19:41:51.197965] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-26T19:41:51.921802] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-26T19:41:51.942769] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:41:52.711733] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-26T19:41:53.511676] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-26T19:41:53.764778] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-26T19:41:53.983873] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.87 seconds). [2025-09-26T19:41:54.311773] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-26T19:41:54.427780] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-26T19:41:54.437748] [INFO ] [REMOTE ] KNTK: Full fetch complete (64289 records). [2025-09-26T19:41:54.437887] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-26T19:41:54.883907] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-26T19:41:54.884021] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-26T19:41:54.885092] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-26T19:41:54.885159] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-26T19:41:54.886554] [DEBUG] [LOCAL ] KNTK: Trimmed 64289 records to 46794 (keeping 200 days of data) [2025-09-26T19:41:55.037074] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:41:55.146926] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-26T19:41:55.250076] [DEBUG] [LOCAL ] KNTK: Primary data saved (46794 records). [2025-09-26T19:41:55.250402] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-26T19:41:55.250936] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 34.1s. Estimated remaining: 2h 35m 19s. Rate: 7.5 symbols/min [2025-09-26T19:41:55.464071] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:55.497124] [DEBUG] [LOCAL ] KOF: Loaded 26094 existing records from primary storage. [2025-09-26T19:41:55.497352] [INFO ] [MAIN ] KOF: Loaded 26094 existing records. [2025-09-26T19:41:55.697360] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:55.697624] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-26T19:41:55.697749] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-26T19:41:55.698522] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-26T19:41:55.698598] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-26T19:41:55.929624] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-26T19:41:56.092387] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:56.441387] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-26T19:41:56.711750] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-26T19:41:57.126873] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:41:57.141603] [INFO ] [REMOTE ] KNX: Full fetch complete (75761 records). [2025-09-26T19:41:57.141850] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-26T19:41:57.518496] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-26T19:41:57.585317] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-26T19:41:57.586583] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-26T19:41:57.588118] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-26T19:41:57.588493] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-26T19:41:57.590987] [DEBUG] [LOCAL ] KNX: Trimmed 75761 records to 53363 (keeping 200 days of data) [2025-09-26T19:41:57.874401] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-26T19:41:57.990171] [DEBUG] [LOCAL ] KNX: Primary data saved (53363 records). [2025-09-26T19:41:57.990323] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-26T19:41:57.990411] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 32.6s. Estimated remaining: 2h 35m 6s. Rate: 7.5 symbols/min [2025-09-26T19:41:58.183199] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:41:58.203181] [DEBUG] [LOCAL ] KOP: Loaded 17944 existing records from primary storage. [2025-09-26T19:41:58.203386] [INFO ] [MAIN ] KOP: Loaded 17944 existing records. [2025-09-26T19:41:58.312284] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-26T19:41:58.406836] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:41:58.407506] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-26T19:41:58.407678] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-26T19:41:58.408722] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-26T19:41:58.408814] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-26T19:41:58.530075] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T19:41:58.898705] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:41:59.111710] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-26T19:41:59.388892] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-26T19:41:59.911682] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-26T19:42:00.004393] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:42:00.386389] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-26T19:42:00.711720] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-26T19:42:01.511727] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-26T19:42:01.744926] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-26T19:42:02.311711] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-26T19:42:02.820839] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-26T19:42:02.867630] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-26T19:42:03.111749] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-26T19:42:03.894509] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-26T19:42:03.911673] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-26T19:42:04.051613] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T19:42:04.060028] [INFO ] [REMOTE ] KODK: Full fetch complete (63451 records). [2025-09-26T19:42:04.060182] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-26T19:42:04.510682] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-26T19:42:04.510806] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-26T19:42:04.511873] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-26T19:42:04.511960] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-26T19:42:04.513404] [DEBUG] [LOCAL ] KODK: Trimmed 63451 records to 44025 (keeping 200 days of data) [2025-09-26T19:42:04.714708] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-26T19:42:04.714583] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-26T19:42:04.811503] [DEBUG] [LOCAL ] KODK: Primary data saved (44025 records). [2025-09-26T19:42:04.811673] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-26T19:42:04.811807] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 30.3s. Estimated remaining: 2h 34m 57s. Rate: 7.5 symbols/min [2025-09-26T19:42:04.995670] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:04.999967] [DEBUG] [LOCAL ] KORE: Loaded 1990 existing records from primary storage. [2025-09-26T19:42:05.000054] [INFO ] [MAIN ] KORE: Loaded 1990 existing records. [2025-09-26T19:42:05.200774] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:05.201069] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-26T19:42:05.201125] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-26T19:42:05.201341] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-26T19:42:05.201403] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-26T19:42:05.516814] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-26T19:42:05.589872] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:06.311751] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-26T19:42:06.756676] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T19:42:07.111685] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-26T19:42:07.384090] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-26T19:42:07.395731] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-26T19:42:07.412563] [INFO ] [REMOTE ] KO: Full fetch complete (70978 records). [2025-09-26T19:42:07.412796] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-26T19:42:07.619200] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-26T19:42:07.620146] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:42:07.620227] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:42:07.620305] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-26T19:42:07.620379] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-26T19:42:07.620419] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-26T19:42:07.620556] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-26T19:42:07.620680] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KO took 36.6s. Estimated remaining: 2h 34m 44s. Rate: 7.5 symbols/min [2025-09-26T19:42:07.807049] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:07.879856] [DEBUG] [LOCAL ] KOS: Loaded 53448 existing records from primary storage. [2025-09-26T19:42:07.880039] [INFO ] [MAIN ] KOS: Loaded 53448 existing records. [2025-09-26T19:42:07.916850] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-26T19:42:08.081247] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:08.081571] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-26T19:42:08.081668] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-26T19:42:08.082705] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-26T19:42:08.082765] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-26T19:42:08.518511] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:08.538484] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-26T19:42:08.711694] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-26T19:42:08.870937] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-26T19:42:09.511701] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-26T19:42:09.815275] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-26T19:42:10.311709] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-26T19:42:10.445920] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-26T19:42:11.111690] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-26T19:42:11.541009] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-26T19:42:11.911716] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-26T19:42:12.222270] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-26T19:42:12.711726] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-26T19:42:13.227745] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-26T19:42:13.299228] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T19:42:13.511729] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-26T19:42:14.311728] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-26T19:42:14.749603] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-26T19:42:15.111687] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-26T19:42:15.212754] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T19:42:15.911726] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-26T19:42:16.378816] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-26T19:42:16.443422] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T19:42:16.711721] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-26T19:42:17.511757] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-26T19:42:17.576170] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-26T19:42:17.970050] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T19:42:18.311732] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-26T19:42:19.111723] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-26T19:42:19.434087] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-26T19:42:19.911724] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-26T19:42:20.711701] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-26T19:42:20.986670] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-26T19:42:21.116637] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-26T19:42:21.511724] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-26T19:42:21.861045] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-26T19:42:22.311693] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-26T19:42:22.667190] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-26T19:42:22.681088] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-26T19:42:22.686110] [INFO ] [REMOTE ] KOP: Full fetch complete (25438 records). [2025-09-26T19:42:22.686210] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-26T19:42:23.111696] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-26T19:42:23.111849] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-26T19:42:23.112345] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-26T19:42:23.114238] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-26T19:42:23.114310] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-26T19:42:23.115348] [DEBUG] [LOCAL ] KOP: Trimmed 25438 records to 18066 (keeping 200 days of data) [2025-09-26T19:42:23.232847] [DEBUG] [LOCAL ] KOP: Primary data saved (18066 records). [2025-09-26T19:42:23.233003] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-26T19:42:23.233104] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KOP took 25.2s. Estimated remaining: 2h 34m 43s. Rate: 7.5 symbols/min [2025-09-26T19:42:23.425090] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:23.486456] [DEBUG] [LOCAL ] KR: Loaded 54072 existing records from primary storage. [2025-09-26T19:42:23.486617] [INFO ] [MAIN ] KR: Loaded 54072 existing records. [2025-09-26T19:42:23.669699] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:23.669970] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-26T19:42:23.670020] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-26T19:42:23.671338] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-26T19:42:23.671405] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-26T19:42:23.916959] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-26T19:42:24.091995] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:24.499560] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-26T19:42:24.711703] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-26T19:42:24.883066] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:42:25.150459] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-26T19:42:25.511747] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-26T19:42:26.311733] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-26T19:42:27.111711] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-26T19:42:27.668024] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T19:42:27.674102] [INFO ] [REMOTE ] KOF: Full fetch complete (36931 records). [2025-09-26T19:42:27.674219] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-26T19:42:27.918177] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-26T19:42:28.140699] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-26T19:42:28.156359] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-26T19:42:28.156453] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-26T19:42:28.157320] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-26T19:42:28.168234] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-26T19:42:28.169150] [DEBUG] [LOCAL ] KOF: Trimmed 36931 records to 26219 (keeping 200 days of data) [2025-09-26T19:42:28.366213] [DEBUG] [LOCAL ] KOF: Primary data saved (26219 records). [2025-09-26T19:42:28.366470] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-26T19:42:28.366598] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 33.1s. Estimated remaining: 2h 34m 32s. Rate: 7.5 symbols/min [2025-09-26T19:42:28.559520] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:28.563999] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-26T19:42:28.566031] [INFO ] [REMOTE ] KORE: Full fetch complete (6050 records). [2025-09-26T19:42:28.566152] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-26T19:42:28.715409] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-26T19:42:28.966347] [DEBUG] [LOCAL ] KRC: Loaded 48747 existing records from primary storage. [2025-09-26T19:42:28.982523] [INFO ] [MAIN ] KRC: Loaded 48747 existing records. [2025-09-26T19:42:29.102726] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-26T19:42:29.087782] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T19:42:29.108099] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-26T19:42:29.138520] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-26T19:42:29.165318] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-26T19:42:29.184503] [DEBUG] [LOCAL ] KORE: Trimmed 6050 records to 2010 (keeping 200 days of data) [2025-09-26T19:42:29.275775] [DEBUG] [LOCAL ] KORE: Primary data saved (2010 records). [2025-09-26T19:42:29.285764] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-26T19:42:29.294073] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KORE took 24.5s. Estimated remaining: 2h 34m 17s. Rate: 7.5 symbols/min [2025-09-26T19:42:29.307245] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:29.353986] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-26T19:42:29.383134] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-26T19:42:29.414697] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-26T19:42:29.417530] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-26T19:42:29.516589] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-26T19:42:29.639130] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:29.943292] [DEBUG] [LOCAL ] KREF: Loaded 37458 existing records from primary storage. [2025-09-26T19:42:29.946171] [INFO ] [MAIN ] KREF: Loaded 37458 existing records. [2025-09-26T19:42:30.008523] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:30.184696] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:30.185021] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-26T19:42:30.185080] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-26T19:42:30.185980] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-26T19:42:30.186044] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-26T19:42:30.316824] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-26T19:42:30.595234] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:30.656127] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T19:42:31.111741] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-26T19:42:31.345849] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:42:31.911720] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-26T19:42:32.118353] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T19:42:32.711715] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-26T19:42:32.945093] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T19:42:33.511736] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-26T19:42:33.819416] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:42:34.239151] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:42:34.311754] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-26T19:42:34.668611] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-26T19:42:35.111770] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-26T19:42:35.840894] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-26T19:42:35.911734] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-26T19:42:36.711720] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-26T19:42:37.011431] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T19:42:37.511736] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-26T19:42:37.684256] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:42:38.027485] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-26T19:42:38.311725] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-26T19:42:39.089806] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:42:39.111685] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-26T19:42:39.870500] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:42:39.911666] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-26T19:42:40.691073] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-26T19:42:40.711687] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-26T19:42:41.511742] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-26T19:42:42.032957] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-26T19:42:42.311736] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-26T19:42:42.811547] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-26T19:42:42.821906] [INFO ] [REMOTE ] KOS: Full fetch complete (76838 records). [2025-09-26T19:42:42.822041] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-26T19:42:43.115261] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-26T19:42:43.255416] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-26T19:42:43.255612] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-26T19:42:43.256860] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-26T19:42:43.256966] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-26T19:42:43.259636] [DEBUG] [LOCAL ] KOS: Trimmed 76838 records to 53828 (keeping 200 days of data) [2025-09-26T19:42:43.384141] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-26T19:42:43.628802] [DEBUG] [LOCAL ] KOS: Primary data saved (53828 records). [2025-09-26T19:42:43.628960] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-26T19:42:43.629065] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KOS took 36.0s. Estimated remaining: 2h 34m 15s. Rate: 7.5 symbols/min [2025-09-26T19:42:43.813261] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:43.859389] [DEBUG] [LOCAL ] KRG: Loaded 49543 existing records from primary storage. [2025-09-26T19:42:43.859592] [INFO ] [MAIN ] KRG: Loaded 49543 existing records. [2025-09-26T19:42:43.918840] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-26T19:42:44.055351] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:42:44.055748] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-26T19:42:44.055804] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-26T19:42:44.057073] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-26T19:42:44.057133] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-26T19:42:44.460528] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:44.522687] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-26T19:42:44.525385] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-26T19:42:44.711749] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-26T19:42:45.511698] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-26T19:42:45.701755] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:42:45.910243] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:42:46.311728] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-26T19:42:47.111732] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-26T19:42:47.477686] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-26T19:42:47.794358] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:42:47.911739] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-26T19:42:48.538422] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-26T19:42:48.711722] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-26T19:42:49.463555] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T19:42:49.511732] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-26T19:42:50.311764] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-26T19:42:50.510915] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T19:42:51.111759] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-26T19:42:51.390086] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T19:42:51.911736] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-26T19:42:51.978018] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:42:52.698565] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:42:52.711674] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-26T19:42:53.511705] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-26T19:42:53.722297] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T19:42:54.213813] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:42:54.311689] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-26T19:42:55.111743] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-26T19:42:55.452193] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-26T19:42:55.463104] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-09-26T19:42:55.463353] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-26T19:42:55.886369] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-26T19:42:55.886569] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-26T19:42:55.887882] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-26T19:42:55.888088] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-26T19:42:55.890240] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 54461 (keeping 200 days of data) [2025-09-26T19:42:55.918225] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-26T19:42:55.921993] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:42:56.287224] [DEBUG] [LOCAL ] KR: Primary data saved (54461 records). [2025-09-26T19:42:56.287438] [INFO ] [MAIN ] KR: Full history saved. [2025-09-26T19:42:56.287623] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KR took 33.1s. Estimated remaining: 2h 34m 12s. Rate: 7.5 symbols/min [2025-09-26T19:42:56.481561] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:42:56.481968] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-26T19:42:56.482066] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-26T19:42:56.482334] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-26T19:42:56.482382] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-26T19:42:56.482425] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-26T19:42:56.482456] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-26T19:42:56.712375] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-26T19:42:56.870816] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T19:42:56.917890] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:42:57.427752] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-26T19:42:57.511679] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-26T19:42:58.311702] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-26T19:42:58.595304] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T19:42:58.813888] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T19:42:59.111722] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-26T19:42:59.315227] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:42:59.315589] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-26T19:42:59.911795] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-26T19:43:00.035374] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T19:43:00.711763] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-26T19:43:01.290742] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-26T19:43:01.511836] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-26T19:43:02.311726] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-26T19:43:02.367108] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-26T19:43:02.522715] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:43:02.523060] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-26T19:43:02.913035] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-26T19:43:03.111727] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-26T19:43:03.911719] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-26T19:43:04.656573] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-26T19:43:04.664095] [INFO ] [REMOTE ] KREF: Full fetch complete (52111 records). [2025-09-26T19:43:04.664211] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-26T19:43:04.723713] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-26T19:43:05.086806] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-26T19:43:05.087046] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-26T19:43:05.087992] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-26T19:43:05.088067] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-26T19:43:05.089309] [DEBUG] [LOCAL ] KREF: Trimmed 52111 records to 37767 (keeping 200 days of data) [2025-09-26T19:43:05.204452] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-26T19:43:05.343874] [DEBUG] [LOCAL ] KREF: Primary data saved (37767 records). [2025-09-26T19:43:05.344033] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-26T19:43:05.344136] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KREF took 36.0s. Estimated remaining: 2h 34m 5s. Rate: 7.5 symbols/min [2025-09-26T19:43:05.516966] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-26T19:43:05.563495] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:05.591257] [DEBUG] [LOCAL ] KRO: Loaded 26251 existing records from primary storage. [2025-09-26T19:43:05.591486] [INFO ] [MAIN ] KRO: Loaded 26251 existing records. [2025-09-26T19:43:05.815179] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:05.815717] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-26T19:43:05.815778] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-26T19:43:05.817045] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-26T19:43:05.817111] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-26T19:43:06.214557] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:06.245494] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-26T19:43:06.311743] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-26T19:43:06.714001] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-26T19:43:07.111726] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-26T19:43:07.797767] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T19:43:07.807518] [INFO ] [REMOTE ] KRC: Full fetch complete (69728 records). [2025-09-26T19:43:07.807738] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-26T19:43:07.916796] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-26T19:43:08.247449] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-26T19:43:08.247553] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-26T19:43:08.248714] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-26T19:43:08.248845] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-26T19:43:08.250465] [DEBUG] [LOCAL ] KRC: Trimmed 69728 records to 49114 (keeping 200 days of data) [2025-09-26T19:43:08.500450] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T19:43:08.600472] [DEBUG] [LOCAL ] KRC: Primary data saved (49114 records). [2025-09-26T19:43:08.600638] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-26T19:43:08.600825] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRC took 40.2s. Estimated remaining: 2h 33m 52s. Rate: 7.5 symbols/min [2025-09-26T19:43:08.716842] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-26T19:43:08.843876] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:08.885416] [DEBUG] [LOCAL ] KRP: Loaded 37736 existing records from primary storage. [2025-09-26T19:43:08.885637] [INFO ] [MAIN ] KRP: Loaded 37736 existing records. [2025-09-26T19:43:09.084885] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:09.085314] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-26T19:43:09.085400] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-26T19:43:09.086528] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-26T19:43:09.086600] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-26T19:43:09.517440] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-26T19:43:09.524280] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:09.740216] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:43:09.751322] [INFO ] [REMOTE ] KRG: Full fetch complete (71056 records). [2025-09-26T19:43:09.751559] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-26T19:43:10.007734] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-26T19:43:10.321018] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-26T19:43:10.399904] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-26T19:43:10.400042] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-26T19:43:10.401970] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-26T19:43:10.402112] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-26T19:43:10.404425] [DEBUG] [LOCAL ] KRG: Trimmed 71056 records to 49859 (keeping 200 days of data) [2025-09-26T19:43:10.789356] [DEBUG] [LOCAL ] KRG: Primary data saved (49859 records). [2025-09-26T19:43:10.789606] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-26T19:43:10.789776] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRG took 27.2s. Estimated remaining: 2h 33m 39s. Rate: 7.5 symbols/min [2025-09-26T19:43:10.987790] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:11.043096] [DEBUG] [LOCAL ] KSS: Loaded 53996 existing records from primary storage. [2025-09-26T19:43:11.066566] [INFO ] [MAIN ] KSS: Loaded 53996 existing records. [2025-09-26T19:43:11.108095] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:43:11.132541] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-26T19:43:11.178304] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-26T19:43:11.297503] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:11.297776] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-26T19:43:11.297829] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-26T19:43:11.298958] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-26T19:43:11.299019] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-26T19:43:11.685032] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:11.911728] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-26T19:43:12.552303] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:43:12.711720] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-26T19:43:13.056479] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:43:13.511732] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-26T19:43:14.311738] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-26T19:43:14.808525] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-26T19:43:15.079200] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T19:43:15.111688] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-26T19:43:15.912420] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-26T19:43:15.914591] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:43:16.497920] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-26T19:43:16.711726] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-26T19:43:17.511688] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-26T19:43:17.923282] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-26T19:43:17.970896] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:43:18.311729] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-26T19:43:18.954169] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-26T19:43:19.111748] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-26T19:43:19.716946] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:43:19.911684] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-26T19:43:20.220385] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-26T19:43:20.711743] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-26T19:43:21.511747] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-26T19:43:22.017933] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-26T19:43:22.311706] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-26T19:43:22.551031] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-26T19:43:23.111707] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-26T19:43:23.346578] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-26T19:43:23.911705] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-26T19:43:24.295310] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-26T19:43:24.452060] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-26T19:43:24.711758] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-26T19:43:25.439547] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-26T19:43:25.511769] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-26T19:43:26.084106] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-26T19:43:26.311753] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-26T19:43:27.111757] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-26T19:43:27.566316] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T19:43:27.812305] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:43:27.911739] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-26T19:43:28.711728] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-26T19:43:28.890485] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T19:43:29.511791] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-26T19:43:29.974418] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-26T19:43:30.030252] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-26T19:43:30.036744] [INFO ] [REMOTE ] KRO: Full fetch complete (34930 records). [2025-09-26T19:43:30.036941] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-26T19:43:30.316818] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-26T19:43:30.441834] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-26T19:43:30.441923] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-26T19:43:30.442678] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-26T19:43:30.442754] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-26T19:43:30.443805] [DEBUG] [LOCAL ] KRO: Trimmed 34930 records to 26448 (keeping 200 days of data) [2025-09-26T19:43:30.602671] [DEBUG] [LOCAL ] KRO: Primary data saved (26448 records). [2025-09-26T19:43:30.602886] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-26T19:43:30.602998] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRO took 25.3s. Estimated remaining: 2h 33m 42s. Rate: 7.5 symbols/min [2025-09-26T19:43:30.785765] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:30.832690] [DEBUG] [LOCAL ] KT: Loaded 46028 existing records from primary storage. [2025-09-26T19:43:30.832876] [INFO ] [MAIN ] KT: Loaded 46028 existing records. [2025-09-26T19:43:31.036878] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:31.060047] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-26T19:43:31.061840] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:43:31.061948] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-26T19:43:31.071366] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-26T19:43:31.071452] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-26T19:43:31.118146] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-26T19:43:31.464919] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:31.911705] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-26T19:43:31.952613] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:43:32.659959] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-26T19:43:32.711756] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-26T19:43:33.299555] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-26T19:43:33.511748] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-26T19:43:34.106693] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-26T19:43:34.311734] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-26T19:43:35.111767] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-26T19:43:35.628715] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-26T19:43:35.911739] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-26T19:43:35.955521] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-26T19:43:36.711775] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-26T19:43:37.315494] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-26T19:43:37.325428] [INFO ] [REMOTE ] KRMN: Full fetch complete (50587 records). [2025-09-26T19:43:37.325630] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-26T19:43:37.517047] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-26T19:43:37.537297] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 156 unique days, need 200 days [2025-09-26T19:43:37.537995] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:43:37.538069] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:43:37.538142] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-26T19:43:37.538235] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-26T19:43:37.538305] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-26T19:43:37.538388] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-26T19:43:37.538504] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRMN took 41.3s. Estimated remaining: 2h 33m 33s. Rate: 7.5 symbols/min [2025-09-26T19:43:37.719812] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:37.760821] [DEBUG] [LOCAL ] KTB: Loaded 41408 existing records from primary storage. [2025-09-26T19:43:37.761036] [INFO ] [MAIN ] KTB: Loaded 41408 existing records. [2025-09-26T19:43:37.971816] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:37.972513] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-26T19:43:37.972719] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-26T19:43:37.973948] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-26T19:43:37.974024] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-26T19:43:38.358460] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:43:38.440941] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-26T19:43:38.437595] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:38.441270] [INFO ] [REMOTE ] KRP: Full fetch complete (54763 records). [2025-09-26T19:43:38.453167] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-26T19:43:38.454352] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-26T19:43:38.884195] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-26T19:43:38.884294] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-26T19:43:38.885147] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-26T19:43:38.885232] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-26T19:43:38.887026] [DEBUG] [LOCAL ] KRP: Trimmed 54763 records to 37947 (keeping 200 days of data) [2025-09-26T19:43:39.111891] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-26T19:43:39.138990] [DEBUG] [LOCAL ] KRP: Primary data saved (37947 records). [2025-09-26T19:43:39.139314] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-26T19:43:39.139460] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KRP took 30.5s. Estimated remaining: 2h 33m 19s. Rate: 7.5 symbols/min [2025-09-26T19:43:39.345798] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:39.348296] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-26T19:43:39.371639] [DEBUG] [LOCAL ] KTF: Loaded 13031 existing records from primary storage. [2025-09-26T19:43:39.371793] [INFO ] [MAIN ] KTF: Loaded 13031 existing records. [2025-09-26T19:43:39.560311] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:43:39.560765] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-26T19:43:39.560894] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-26T19:43:39.561406] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-26T19:43:39.561508] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-26T19:43:39.735276] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T19:43:39.923267] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-26T19:43:39.967050] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:40.711716] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-26T19:43:41.234052] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-26T19:43:41.244613] [INFO ] [REMOTE ] KSS: Full fetch complete (77637 records). [2025-09-26T19:43:41.244806] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-26T19:43:41.518125] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-26T19:43:41.698993] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-26T19:43:41.704692] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-26T19:43:41.707499] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-26T19:43:41.707605] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-26T19:43:41.725244] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:43:41.740670] [DEBUG] [LOCAL ] KSS: Trimmed 77637 records to 54385 (keeping 200 days of data) [2025-09-26T19:43:42.096006] [DEBUG] [LOCAL ] KSS: Primary data saved (54385 records). [2025-09-26T19:43:42.096282] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-26T19:43:42.096412] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KSS took 31.3s. Estimated remaining: 2h 33m 6s. Rate: 7.5 symbols/min [2025-09-26T19:43:42.239083] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-26T19:43:42.328387] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:43:42.324148] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-26T19:43:42.330244] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-26T19:43:42.330309] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-26T19:43:42.330441] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-26T19:43:42.330493] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-26T19:43:42.330543] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-26T19:43:42.330578] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-26T19:43:42.680808] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T19:43:42.751335] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:43:43.111735] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-26T19:43:43.731467] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-26T19:43:43.911701] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-26T19:43:44.105117] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-26T19:43:44.711745] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-26T19:43:44.835628] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-26T19:43:45.511745] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-26T19:43:46.266132] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-26T19:43:46.265916] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T19:43:46.311679] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-26T19:43:47.111728] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-26T19:43:47.894481] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:43:47.911675] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-26T19:43:47.958204] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:43:48.711720] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-26T19:43:49.511726] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-26T19:43:49.562205] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T19:43:49.605551] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-26T19:43:50.277380] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-26T19:43:50.311727] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-26T19:43:51.096377] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:43:51.111703] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-26T19:43:51.911697] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-26T19:43:52.144051] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-26T19:43:52.711749] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-26T19:43:53.511734] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-26T19:43:53.612251] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-26T19:43:53.686456] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T19:43:54.086787] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-26T19:43:54.311736] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-26T19:43:54.768372] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-26T19:43:55.111721] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-26T19:43:55.533131] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-26T19:43:55.911737] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-26T19:43:56.711699] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-26T19:43:56.875831] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-26T19:43:57.511741] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-26T19:43:58.311710] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-26T19:43:58.359201] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T19:43:58.828433] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-26T19:43:58.985214] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-26T19:43:59.111717] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-26T19:43:59.911720] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-26T19:44:00.666431] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:44:00.666604] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-26T19:44:00.711675] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-26T19:44:01.511739] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-26T19:44:02.311770] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-26T19:44:02.443399] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-26T19:44:03.063159] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:44:03.084245] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-26T19:44:03.087724] [INFO ] [REMOTE ] KUKE: Full fetch complete (8120 records). [2025-09-26T19:44:03.087900] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-26T19:44:03.116970] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-26T19:44:03.414800] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-26T19:44:03.415170] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:44:03.415266] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:44:03.415362] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-26T19:44:03.415464] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-26T19:44:03.415526] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-26T19:44:03.415592] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-26T19:44:03.415722] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KUKE took 21.3s. Estimated remaining: 2h 33m 10s. Rate: 7.5 symbols/min [2025-09-26T19:44:03.624712] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:03.682851] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-09-26T19:44:03.683018] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-09-26T19:44:03.878123] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:03.878368] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-26T19:44:03.878418] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-26T19:44:03.879590] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-26T19:44:03.879690] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-26T19:44:03.916941] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-26T19:44:04.276123] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:04.711743] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-26T19:44:04.803805] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:44:05.519349] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-26T19:44:05.522022] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-26T19:44:05.676251] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-26T19:44:06.311766] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-26T19:44:07.111744] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-26T19:44:07.279022] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-26T19:44:07.288730] [INFO ] [REMOTE ] KT: Full fetch complete (66732 records). [2025-09-26T19:44:07.288896] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-26T19:44:07.689328] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-26T19:44:07.689510] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-26T19:44:07.690617] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-26T19:44:07.690709] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-26T19:44:07.692588] [DEBUG] [LOCAL ] KT: Trimmed 66732 records to 46336 (keeping 200 days of data) [2025-09-26T19:44:07.918961] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-26T19:44:08.015127] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:44:08.027272] [DEBUG] [LOCAL ] KT: Primary data saved (46336 records). [2025-09-26T19:44:08.035639] [INFO ] [MAIN ] KT: Full history saved. [2025-09-26T19:44:08.035812] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KT took 37.4s. Estimated remaining: 2h 32m 59s. Rate: 7.5 symbols/min [2025-09-26T19:44:08.070030] [INFO ] [REMOTE ] KTB: Full fetch complete (57710 records). [2025-09-26T19:44:08.103585] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-26T19:44:08.359318] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:08.694024] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-26T19:44:08.694220] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-26T19:44:08.695337] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-26T19:44:08.695570] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-26T19:44:08.697565] [DEBUG] [LOCAL ] KTB: Trimmed 57710 records to 41738 (keeping 200 days of data) [2025-09-26T19:44:08.714809] [DEBUG] [LOCAL ] KVYO: Loaded 50306 existing records from primary storage. [2025-09-26T19:44:08.715061] [INFO ] [MAIN ] KVYO: Loaded 50306 existing records. [2025-09-26T19:44:08.959761] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-26T19:44:09.001009] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-26T19:44:09.078680] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:09.086287] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-26T19:44:09.140002] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-26T19:44:09.177037] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-26T19:44:09.179739] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-26T19:44:09.515071] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-26T19:44:09.591381] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-26T19:44:09.695235] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:09.688243] [DEBUG] [LOCAL ] KTB: Primary data saved (41738 records). [2025-09-26T19:44:09.695455] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-26T19:44:09.695898] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KTB took 32.2s. Estimated remaining: 2h 32m 45s. Rate: 7.5 symbols/min [2025-09-26T19:44:09.878129] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:09.918272] [DEBUG] [LOCAL ] KW: Loaded 40961 existing records from primary storage. [2025-09-26T19:44:09.918427] [INFO ] [MAIN ] KW: Loaded 40961 existing records. [2025-09-26T19:44:10.047619] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:44:10.071583] [INFO ] [REMOTE ] KTF: Full fetch complete (18031 records). [2025-09-26T19:44:10.096032] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-26T19:44:10.187607] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:10.225311] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-26T19:44:10.255313] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-26T19:44:10.261511] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-26T19:44:10.266961] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-26T19:44:10.316262] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-26T19:44:10.795998] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-26T19:44:10.831453] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-26T19:44:10.855754] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-26T19:44:10.880063] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-26T19:44:10.935471] [DEBUG] [LOCAL ] KTF: Trimmed 18031 records to 13065 (keeping 200 days of data) [2025-09-26T19:44:11.047373] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:11.099673] [DEBUG] [LOCAL ] KTF: Primary data saved (13065 records). [2025-09-26T19:44:11.099857] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-26T19:44:11.100123] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KTF took 32.0s. Estimated remaining: 2h 32m 31s. Rate: 7.5 symbols/min [2025-09-26T19:44:11.129204] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-26T19:44:11.306337] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:11.330833] [DEBUG] [LOCAL ] KWR: Loaded 16844 existing records from primary storage. [2025-09-26T19:44:11.330991] [INFO ] [MAIN ] KWR: Loaded 16844 existing records. [2025-09-26T19:44:11.530114] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:11.530437] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-26T19:44:11.530823] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-26T19:44:11.531541] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-26T19:44:11.531747] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-26T19:44:11.820928] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-26T19:44:11.936566] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-26T19:44:12.032018] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:12.175068] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-26T19:44:12.568614] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-26T19:44:12.711720] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-26T19:44:13.511716] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-26T19:44:13.653636] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-26T19:44:13.712614] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T19:44:14.311713] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-26T19:44:15.111716] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-26T19:44:15.157673] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-26T19:44:15.716694] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T19:44:15.911714] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-26T19:44:16.089702] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-26T19:44:16.711724] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-26T19:44:17.511751] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-26T19:44:17.749082] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:44:18.275746] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-26T19:44:18.311730] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-26T19:44:18.503873] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-26T19:44:19.111776] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-26T19:44:19.911735] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-26T19:44:20.213518] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-26T19:44:20.661838] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-26T19:44:20.690315] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-26T19:44:20.711674] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-26T19:44:21.511721] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-26T19:44:21.921201] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-26T19:44:22.311730] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-26T19:44:23.111699] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-26T19:44:23.147054] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:44:23.202718] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-26T19:44:23.911717] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-26T19:44:24.706079] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:44:24.715699] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-26T19:44:25.511746] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-26T19:44:25.792149] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-26T19:44:26.311729] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-26T19:44:26.500907] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-26T19:44:27.060677] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-26T19:44:27.111680] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-26T19:44:27.911703] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-26T19:44:28.172574] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T19:44:28.215801] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-26T19:44:28.711724] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-26T19:44:29.195883] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T19:44:29.511757] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-26T19:44:30.311746] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-26T19:44:30.433798] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-26T19:44:30.990433] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-26T19:44:31.111742] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-26T19:44:31.297437] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:44:31.911731] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-26T19:44:32.711703] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-26T19:44:32.904093] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-26T19:44:32.950109] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-26T19:44:33.511751] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-26T19:44:34.311697] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-26T19:44:34.412478] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T19:44:35.111707] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-26T19:44:35.201365] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-26T19:44:35.396767] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-26T19:44:35.911736] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-26T19:44:36.711711] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-26T19:44:36.849793] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:44:37.511711] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-26T19:44:37.709244] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-26T19:44:38.197594] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-26T19:44:38.311737] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-26T19:44:39.111721] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-26T19:44:39.273695] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-26T19:44:39.276822] [INFO ] [REMOTE ] KWR: Full fetch complete (23986 records). [2025-09-26T19:44:39.276939] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-26T19:44:39.702465] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-26T19:44:39.714516] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-26T19:44:39.723940] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-26T19:44:39.724873] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-26T19:44:39.724960] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-26T19:44:39.725793] [INFO ] [REMOTE ] KVYO: Full fetch complete (71475 records). [2025-09-26T19:44:39.726050] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-26T19:44:39.732178] [DEBUG] [LOCAL ] KWR: Trimmed 23986 records to 16931 (keeping 200 days of data) [2025-09-26T19:44:39.931368] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-26T19:44:40.264508] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-26T19:44:40.264685] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-26T19:44:40.266058] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-26T19:44:40.266421] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-26T19:44:40.274064] [DEBUG] [LOCAL ] KVYO: Trimmed 71475 records to 50696 (keeping 200 days of data) [2025-09-26T19:44:40.352317] [DEBUG] [LOCAL ] KWR: Primary data saved (16931 records). [2025-09-26T19:44:40.377811] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-26T19:44:40.378570] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KWR took 29.3s. Estimated remaining: 2h 32m 43s. Rate: 7.5 symbols/min [2025-09-26T19:44:40.573537] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:40.602751] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-26T19:44:40.613191] [INFO ] [REMOTE ] KW: Full fetch complete (56994 records). [2025-09-26T19:44:40.614152] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-26T19:44:40.761381] [DEBUG] [LOCAL ] KYN: Loaded 30234 existing records from primary storage. [2025-09-26T19:44:40.772470] [INFO ] [MAIN ] KYN: Loaded 30234 existing records. [2025-09-26T19:44:41.277958] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:41.356527] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-26T19:44:41.356963] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-26T19:44:41.376994] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-26T19:44:41.377517] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-26T19:44:41.390285] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-26T19:44:41.390692] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-26T19:44:41.392058] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-26T19:44:41.397536] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-26T19:44:41.474925] [DEBUG] [LOCAL ] KW: Trimmed 56994 records to 41236 (keeping 200 days of data) [2025-09-26T19:44:41.906773] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:41.909935] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-26T19:44:42.176828] [DEBUG] [LOCAL ] KW: Primary data saved (41236 records). [2025-09-26T19:44:42.178876] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T19:44:42.179121] [INFO ] [MAIN ] KW: Full history saved. [2025-09-26T19:44:42.177781] [DEBUG] [LOCAL ] KVYO: Primary data saved (50696 records). [2025-09-26T19:44:42.189486] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-26T19:44:42.188725] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KW took 32.5s. Estimated remaining: 2h 32m 29s. Rate: 7.5 symbols/min [2025-09-26T19:44:42.190662] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KVYO took 34.2s. Estimated remaining: 2h 32m 13s. Rate: 7.5 symbols/min [2025-09-26T19:44:42.195991] [INFO ] [REMOTE ] KVUE: Full fetch complete (77673 records). [2025-09-26T19:44:42.202776] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-26T19:44:42.675345] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:42.805456] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:43.060074] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-26T19:44:43.060196] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-26T19:44:43.061259] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-26T19:44:43.061525] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-26T19:44:43.075677] [DEBUG] [LOCAL ] L: Loaded 41261 existing records from primary storage. [2025-09-26T19:44:43.075904] [INFO ] [MAIN ] L: Loaded 41261 existing records. [2025-09-26T19:44:43.081240] [DEBUG] [LOCAL ] KVUE: Trimmed 77673 records to 54447 (keeping 200 days of data) [2025-09-26T19:44:43.326804] [DEBUG] [LOCAL ] LAC: Loaded 52701 existing records from primary storage. [2025-09-26T19:44:43.327991] [INFO ] [MAIN ] LAC: Loaded 52701 existing records. [2025-09-26T19:44:43.532554] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:43.565747] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-26T19:44:43.578446] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-26T19:44:43.582865] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-26T19:44:43.583253] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-26T19:44:43.753171] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-26T19:44:43.788730] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-26T19:44:43.805252] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:43.859952] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-26T19:44:43.865414] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-26T19:44:43.886809] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-26T19:44:43.887751] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-26T19:44:44.398460] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:44.417874] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-26T19:44:44.689445] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:44.691785] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-26T19:44:44.818494] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-09-26T19:44:44.818707] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-26T19:44:44.818817] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KVUE took 41.4s. Estimated remaining: 2h 32m 0s. Rate: 7.5 symbols/min [2025-09-26T19:44:45.008214] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:44:45.033021] [DEBUG] [LOCAL ] LAD: Loaded 23870 existing records from primary storage. [2025-09-26T19:44:45.033169] [INFO ] [MAIN ] LAD: Loaded 23870 existing records. [2025-09-26T19:44:45.228536] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:44:45.228918] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-26T19:44:45.229094] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-26T19:44:45.229824] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-26T19:44:45.229887] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-26T19:44:45.375054] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:44:45.416264] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-26T19:44:45.644710] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:44:45.645039] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-26T19:44:46.079475] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-26T19:44:46.089631] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-26T19:44:46.304559] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T19:44:46.311694] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-26T19:44:46.798718] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-26T19:44:46.859023] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T19:44:47.111728] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-26T19:44:47.196504] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-26T19:44:47.647823] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-26T19:44:47.911719] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-26T19:44:48.080679] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-26T19:44:48.711753] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-26T19:44:49.444114] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:44:49.511689] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-26T19:44:49.893262] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T19:44:50.311775] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-26T19:44:50.890109] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-26T19:44:51.111722] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-26T19:44:51.888254] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:44:51.911670] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-26T19:44:52.461361] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-26T19:44:52.711721] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-26T19:44:53.449105] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-26T19:44:53.511731] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-26T19:44:54.288091] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:44:54.311711] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-26T19:44:54.830127] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-26T19:44:55.111722] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-26T19:44:55.644588] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:44:55.911742] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-26T19:44:56.711762] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-26T19:44:57.024776] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-26T19:44:57.391209] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-26T19:44:57.511740] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-26T19:44:57.626058] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-26T19:44:58.311735] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-26T19:44:59.112265] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-26T19:44:59.117303] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-26T19:44:59.185344] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-26T19:44:59.911729] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-26T19:45:00.711729] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-26T19:45:00.989367] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-26T19:45:01.508258] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-26T19:45:01.518198] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-26T19:45:02.311722] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-26T19:45:02.515485] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T19:45:02.858560] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T19:45:03.111743] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-26T19:45:03.847239] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-26T19:45:03.911684] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-26T19:45:04.297102] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T19:45:04.711783] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-26T19:45:05.511731] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-26T19:45:05.968092] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-26T19:45:06.311728] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-26T19:45:06.399617] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T19:45:06.861058] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-26T19:45:06.867735] [INFO ] [REMOTE ] KYN: Full fetch complete (44644 records). [2025-09-26T19:45:06.867875] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-26T19:45:07.116848] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-26T19:45:07.295734] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-26T19:45:07.295854] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-26T19:45:07.296598] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-26T19:45:07.296669] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-26T19:45:07.298045] [DEBUG] [LOCAL ] KYN: Trimmed 44644 records to 30432 (keeping 200 days of data) [2025-09-26T19:45:07.505623] [DEBUG] [LOCAL ] KYN: Primary data saved (30432 records). [2025-09-26T19:45:07.505800] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-26T19:45:07.505894] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. KYN took 27.1s. Estimated remaining: 2h 32m 6s. Rate: 7.5 symbols/min [2025-09-26T19:45:07.640833] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-26T19:45:07.686161] [INFO ] [REMOTE ] LAD: Full fetch complete (35401 records). [2025-09-26T19:45:07.701898] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-26T19:45:07.729438] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:07.933665] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-26T19:45:08.110118] [DEBUG] [LOCAL ] LADR: Loaded 38917 existing records from primary storage. [2025-09-26T19:45:08.133989] [INFO ] [MAIN ] LADR: Loaded 38917 existing records. [2025-09-26T19:45:08.295583] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-26T19:45:08.299930] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-26T19:45:08.301105] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-26T19:45:08.316915] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-26T19:45:08.387399] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:08.388378] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-26T19:45:08.388687] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-26T19:45:08.388562] [DEBUG] [LOCAL ] LAD: Trimmed 35401 records to 24089 (keeping 200 days of data) [2025-09-26T19:45:08.389995] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-26T19:45:08.390153] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-26T19:45:08.784042] [DEBUG] [LOCAL ] LAD: Primary data saved (24089 records). [2025-09-26T19:45:08.806965] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-26T19:45:08.822931] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. LAD took 24.0s. Estimated remaining: 2h 31m 52s. Rate: 7.5 symbols/min [2025-09-26T19:45:09.155810] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:09.171917] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-26T19:45:09.259183] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:09.262588] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-26T19:45:09.277382] [DEBUG] [LOCAL ] LANV: Loaded 2808 existing records from primary storage. [2025-09-26T19:45:09.277525] [INFO ] [MAIN ] LANV: Loaded 2808 existing records. [2025-09-26T19:45:09.478801] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:09.479056] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-26T19:45:09.479103] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-26T19:45:09.479395] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-26T19:45:09.479456] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-26T19:45:09.525623] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-26T19:45:09.923837] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:09.979849] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-26T19:45:10.311739] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-26T19:45:10.677965] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-26T19:45:10.907632] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-26T19:45:11.111690] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-26T19:45:11.451900] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-26T19:45:11.460065] [INFO ] [REMOTE ] L: Full fetch complete (59587 records). [2025-09-26T19:45:11.460207] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-26T19:45:11.891103] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-26T19:45:11.891223] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-26T19:45:11.892135] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-26T19:45:11.892203] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-26T19:45:11.893986] [DEBUG] [LOCAL ] L: Trimmed 59587 records to 41562 (keeping 200 days of data) [2025-09-26T19:45:11.955907] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-26T19:45:12.169142] [DEBUG] [LOCAL ] L: Primary data saved (41562 records). [2025-09-26T19:45:12.169284] [INFO ] [MAIN ] L: Full history saved. [2025-09-26T19:45:12.169379] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. L took 30.0s. Estimated remaining: 2h 31m 39s. Rate: 7.5 symbols/min [2025-09-26T19:45:12.359835] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:12.360040] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-26T19:45:12.360106] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-26T19:45:12.360328] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-26T19:45:12.360385] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-26T19:45:12.360432] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-26T19:45:12.360466] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-26T19:45:12.655300] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-26T19:45:12.722618] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-26T19:45:12.768610] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:12.957151] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:45:13.290309] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-26T19:45:13.511730] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-26T19:45:14.060273] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-26T19:45:14.311716] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-26T19:45:14.523062] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:45:14.523422] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-26T19:45:15.111719] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-26T19:45:15.911722] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-26T19:45:16.711757] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-26T19:45:17.346350] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-26T19:45:17.419907] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T19:45:17.511690] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-26T19:45:17.583161] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-26T19:45:17.994621] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-26T19:45:18.311758] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-26T19:45:19.111780] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-26T19:45:19.459629] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-26T19:45:19.653735] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-26T19:45:19.911745] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-26T19:45:20.711723] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-26T19:45:21.511728] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-26T19:45:21.637332] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-26T19:45:21.971829] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-26T19:45:22.311727] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-26T19:45:22.568386] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T19:45:23.111735] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-26T19:45:23.911765] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-26T19:45:23.998518] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:45:24.224420] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-26T19:45:24.711730] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-26T19:45:25.511718] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-26T19:45:25.547765] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-26T19:45:25.559390] [INFO ] [REMOTE ] LAC: Full fetch complete (75972 records). [2025-09-26T19:45:25.559574] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-26T19:45:25.994245] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-26T19:45:25.994351] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-26T19:45:25.995565] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-26T19:45:25.995639] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-26T19:45:25.997381] [DEBUG] [LOCAL ] LAC: Trimmed 75972 records to 53091 (keeping 200 days of data) [2025-09-26T19:45:26.098527] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-26T19:45:26.313338] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-26T19:45:26.346815] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T19:45:26.376497] [DEBUG] [LOCAL ] LAC: Primary data saved (53091 records). [2025-09-26T19:45:26.376674] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-26T19:45:26.376785] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAC took 44.2s. Estimated remaining: 2h 31m 37s. Rate: 7.5 symbols/min [2025-09-26T19:45:27.003528] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-26T19:45:27.005358] [INFO ] [REMOTE ] LANV: Full fetch complete (4442 records). [2025-09-26T19:45:27.005447] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-26T19:45:27.113990] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-26T19:45:27.393181] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-26T19:45:27.393264] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-26T19:45:27.393421] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-26T19:45:27.393461] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-26T19:45:27.393969] [DEBUG] [LOCAL ] LANV: Trimmed 4442 records to 2851 (keeping 200 days of data) [2025-09-26T19:45:27.410475] [DEBUG] [LOCAL ] LANV: Primary data saved (2851 records). [2025-09-26T19:45:27.410578] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-26T19:45:27.410731] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LANV took 18.6s. Estimated remaining: 2h 31m 23s. Rate: 7.5 symbols/min [2025-09-26T19:45:27.911743] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-26T19:45:28.712900] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:45:28.723745] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-26T19:45:29.510098] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:45:29.519892] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-26T19:45:29.903850] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-26T19:45:30.311739] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-26T19:45:31.004299] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-26T19:45:31.111770] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-26T19:45:31.876597] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:45:31.911704] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-26T19:45:32.392027] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-26T19:45:32.711734] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-26T19:45:33.495780] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:45:33.511674] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-26T19:45:34.380026] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-26T19:45:34.391444] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-26T19:45:34.960484] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-26T19:45:35.111752] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-26T19:45:36.101587] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T19:45:36.112047] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-26T19:45:36.851870] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-26T19:45:36.859904] [INFO ] [REMOTE ] LADR: Full fetch complete (55107 records). [2025-09-26T19:45:36.860072] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-26T19:45:37.290469] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-26T19:45:37.290562] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-26T19:45:37.291436] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-26T19:45:37.291503] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-26T19:45:37.292856] [DEBUG] [LOCAL ] LADR: Trimmed 55107 records to 39204 (keeping 200 days of data) [2025-09-26T19:45:37.549965] [DEBUG] [LOCAL ] LADR: Primary data saved (39204 records). [2025-09-26T19:45:37.550214] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-26T19:45:37.550386] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LADR took 30.0s. Estimated remaining: 2h 31m 17s. Rate: 7.5 symbols/min [2025-09-26T19:45:37.688600] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-26T19:45:37.700899] [INFO ] [REMOTE ] LAR: Full fetch complete (55540 records). [2025-09-26T19:45:37.701090] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-26T19:45:37.910782] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-26T19:45:37.911408] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:45:37.911482] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:45:37.911684] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-26T19:45:37.911804] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-26T19:45:37.911863] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-26T19:45:37.911931] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-26T19:45:37.912051] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LAR took 25.7s. Estimated remaining: 2h 31m 2s. Rate: 7.5 symbols/min [2025-09-26T19:45:38.523542] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:38.623080] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:38.737858] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:38.752448] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:45:38.780568] [DEBUG] [LOCAL ] LAW: Loaded 14087 existing records from primary storage. [2025-09-26T19:45:38.780875] [INFO ] [MAIN ] LAW: Loaded 14087 existing records. [2025-09-26T19:45:38.938682] [DEBUG] [LOCAL ] LAZ: Loaded 45524 existing records from primary storage. [2025-09-26T19:45:38.942277] [INFO ] [MAIN ] LAZ: Loaded 45524 existing records. [2025-09-26T19:45:39.145358] [DEBUG] [LOCAL ] LB: Loaded 37889 existing records from primary storage. [2025-09-26T19:45:39.158109] [INFO ] [MAIN ] LB: Loaded 37889 existing records. [2025-09-26T19:45:39.174285] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:39.219814] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-26T19:45:39.273595] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-26T19:45:39.334055] [DEBUG] [LOCAL ] LBRT: Loaded 53307 existing records from primary storage. [2025-09-26T19:45:39.370547] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-26T19:45:39.453441] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:39.453304] [INFO ] [MAIN ] LBRT: Loaded 53307 existing records. [2025-09-26T19:45:39.454429] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-26T19:45:39.476577] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-26T19:45:39.661173] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-26T19:45:39.771750] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-26T19:45:39.755943] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:39.788336] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-26T19:45:39.788243] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-26T19:45:39.869904] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-26T19:45:39.924734] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-26T19:45:40.026140] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-26T19:45:40.052430] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:45:40.186567] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-26T19:45:40.236674] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-26T19:45:40.301189] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-26T19:45:40.301338] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-26T19:45:40.947183] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:40.995503] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-26T19:45:41.262639] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:41.326380] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-26T19:45:41.320797] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:41.336142] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-26T19:45:41.472907] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:45:41.473293] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-26T19:45:42.200215] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-26T19:45:42.204953] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-26T19:45:42.677894] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-26T19:45:42.686066] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-26T19:45:42.941761] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-26T19:45:42.953029] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-26T19:45:42.995887] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-26T19:45:43.010154] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-26T19:45:43.040698] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-26T19:45:43.111722] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-26T19:45:44.127058] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:45:44.130985] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-26T19:45:44.273211] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-26T19:45:44.369000] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T19:45:44.711732] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-26T19:45:44.767369] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-26T19:45:44.800576] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-26T19:45:45.511729] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-26T19:45:46.315597] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-26T19:45:46.322621] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-26T19:45:46.970975] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-26T19:45:47.111720] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-26T19:45:47.915619] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-26T19:45:47.918466] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T19:45:48.005170] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:45:48.711715] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-26T19:45:49.291017] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T19:45:49.511761] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-26T19:45:50.285567] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-26T19:45:50.311682] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-26T19:45:51.111690] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-26T19:45:51.547703] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-26T19:45:51.835261] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T19:45:51.874928] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-26T19:45:51.911702] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-26T19:45:52.711730] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-26T19:45:53.511748] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-26T19:45:53.714633] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-26T19:45:54.304133] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-26T19:45:54.313889] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-26T19:45:55.009225] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-26T19:45:55.111752] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-26T19:45:55.303236] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:45:55.911722] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-26T19:45:56.703126] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:45:56.712183] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-26T19:45:57.226902] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T19:45:57.511716] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-26T19:45:57.627979] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T19:45:58.311744] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-26T19:45:59.111724] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-26T19:45:59.212772] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:45:59.921630] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-26T19:45:59.928779] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-26T19:46:00.048118] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-26T19:46:00.711743] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-26T19:46:01.511748] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-26T19:46:01.643742] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-26T19:46:02.311698] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-26T19:46:02.407381] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T19:46:02.607458] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-26T19:46:02.611167] [INFO ] [REMOTE ] LAW: Full fetch complete (20699 records). [2025-09-26T19:46:02.611257] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-26T19:46:03.006907] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-26T19:46:03.007005] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-26T19:46:03.007583] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-26T19:46:03.007689] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-26T19:46:03.008405] [DEBUG] [LOCAL ] LAW: Trimmed 20699 records to 14171 (keeping 200 days of data) [2025-09-26T19:46:03.089590] [DEBUG] [LOCAL ] LAW: Primary data saved (14171 records). [2025-09-26T19:46:03.089760] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-26T19:46:03.089872] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 25.2s. Estimated remaining: 2h 31m 9s. Rate: 7.5 symbols/min [2025-09-26T19:46:03.122238] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-26T19:46:03.278090] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:03.327858] [DEBUG] [LOCAL ] LC: Loaded 48267 existing records from primary storage. [2025-09-26T19:46:03.328061] [INFO ] [MAIN ] LC: Loaded 48267 existing records. [2025-09-26T19:46:03.523473] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:03.523855] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-26T19:46:03.523913] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-26T19:46:03.525314] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-26T19:46:03.525378] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-26T19:46:03.953717] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-26T19:46:03.959937] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:03.963535] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T19:46:04.711736] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-26T19:46:04.764615] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-26T19:46:05.511744] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-26T19:46:05.754554] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-26T19:46:06.311743] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-26T19:46:06.396124] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T19:46:06.866739] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-26T19:46:06.875503] [INFO ] [REMOTE ] LAZ: Full fetch complete (65854 records). [2025-09-26T19:46:06.875698] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-26T19:46:07.120727] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-26T19:46:07.324300] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-26T19:46:07.324392] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-26T19:46:07.325381] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-26T19:46:07.325460] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-26T19:46:07.326974] [DEBUG] [LOCAL ] LAZ: Trimmed 65854 records to 45784 (keeping 200 days of data) [2025-09-26T19:46:07.641357] [DEBUG] [LOCAL ] LAZ: Primary data saved (45784 records). [2025-09-26T19:46:07.641516] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-26T19:46:07.641615] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LAZ took 29.7s. Estimated remaining: 2h 30m 58s. Rate: 7.5 symbols/min [2025-09-26T19:46:07.864705] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:07.898998] [DEBUG] [LOCAL ] LCII: Loaded 28760 existing records from primary storage. [2025-09-26T19:46:07.899177] [INFO ] [MAIN ] LCII: Loaded 28760 existing records. [2025-09-26T19:46:07.928220] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-26T19:46:08.138253] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:08.138723] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-26T19:46:08.138834] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-26T19:46:08.139788] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-26T19:46:08.139856] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-26T19:46:08.367862] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T19:46:08.713092] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-26T19:46:08.828692] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:08.831312] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-26T19:46:08.840681] [INFO ] [REMOTE ] LB: Full fetch complete (55922 records). [2025-09-26T19:46:08.840883] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-26T19:46:09.372189] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-26T19:46:09.372288] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-26T19:46:09.373215] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-26T19:46:09.373348] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-26T19:46:09.374704] [DEBUG] [LOCAL ] LB: Trimmed 55922 records to 38116 (keeping 200 days of data) [2025-09-26T19:46:09.556607] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-26T19:46:09.629301] [DEBUG] [LOCAL ] LB: Primary data saved (38116 records). [2025-09-26T19:46:09.629488] [INFO ] [MAIN ] LB: Full history saved. [2025-09-26T19:46:09.629615] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LB took 31.7s. Estimated remaining: 2h 30m 44s. Rate: 7.5 symbols/min [2025-09-26T19:46:09.852611] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:09.886195] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-26T19:46:09.942921] [DEBUG] [LOCAL ] LDI: Loaded 44397 existing records from primary storage. [2025-09-26T19:46:09.943074] [INFO ] [MAIN ] LDI: Loaded 44397 existing records. [2025-09-26T19:46:10.136628] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:10.136949] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-26T19:46:10.137008] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-26T19:46:10.137954] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-26T19:46:10.138017] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-26T19:46:10.351243] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-26T19:46:10.544595] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-26T19:46:10.569412] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:10.659665] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-26T19:46:11.111728] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-26T19:46:11.911722] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-26T19:46:12.193569] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-26T19:46:12.711711] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-26T19:46:12.787741] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T19:46:12.799083] [INFO ] [REMOTE ] LBRT: Full fetch complete (76531 records). [2025-09-26T19:46:12.799269] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-26T19:46:13.259731] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-26T19:46:13.260680] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-26T19:46:13.261717] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:46:13.267677] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-26T19:46:13.268632] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-26T19:46:13.270153] [DEBUG] [LOCAL ] LBRT: Trimmed 76531 records to 53695 (keeping 200 days of data) [2025-09-26T19:46:13.514322] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-26T19:46:13.617054] [DEBUG] [LOCAL ] LBRT: Primary data saved (53695 records). [2025-09-26T19:46:13.617216] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-26T19:46:13.617344] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LBRT took 35.7s. Estimated remaining: 2h 30m 33s. Rate: 7.5 symbols/min [2025-09-26T19:46:13.821215] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:13.869802] [DEBUG] [LOCAL ] LDOS: Loaded 46091 existing records from primary storage. [2025-09-26T19:46:13.869958] [INFO ] [MAIN ] LDOS: Loaded 46091 existing records. [2025-09-26T19:46:14.082510] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:14.082784] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-26T19:46:14.082839] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-26T19:46:14.083964] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-26T19:46:14.084031] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-26T19:46:14.320681] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-26T19:46:14.518100] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:14.549878] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-26T19:46:14.722051] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-26T19:46:15.111768] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-26T19:46:15.596131] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-26T19:46:15.911734] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-26T19:46:16.711712] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-26T19:46:16.903991] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-26T19:46:17.511755] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-26T19:46:17.586796] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T19:46:18.157631] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-26T19:46:18.311721] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-26T19:46:18.655942] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-26T19:46:19.111721] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-26T19:46:19.911731] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-26T19:46:20.063985] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T19:46:20.318363] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-26T19:46:20.711719] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-26T19:46:21.280117] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-26T19:46:21.511738] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-26T19:46:22.228242] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-26T19:46:22.311727] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-26T19:46:23.111703] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-26T19:46:23.226681] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-26T19:46:23.841307] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-26T19:46:23.911712] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-26T19:46:24.369219] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-26T19:46:24.711732] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-26T19:46:25.511768] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-26T19:46:25.738825] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:46:25.823368] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-26T19:46:26.311718] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-26T19:46:27.111724] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-26T19:46:27.456550] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-26T19:46:27.525747] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-26T19:46:27.911732] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-26T19:46:28.711766] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-26T19:46:28.936012] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-26T19:46:29.511696] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-26T19:46:29.603427] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-26T19:46:29.981561] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T19:46:30.311758] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-26T19:46:31.111712] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-26T19:46:31.208782] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:46:31.218866] [INFO ] [REMOTE ] LC: Full fetch complete (70431 records). [2025-09-26T19:46:31.219068] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-26T19:46:31.677441] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-26T19:46:31.677542] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-26T19:46:31.678667] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-26T19:46:31.678757] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-26T19:46:31.680447] [DEBUG] [LOCAL ] LC: Trimmed 70431 records to 48605 (keeping 200 days of data) [2025-09-26T19:46:31.917733] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-26T19:46:31.991550] [DEBUG] [LOCAL ] LC: Primary data saved (48605 records). [2025-09-26T19:46:31.991738] [INFO ] [MAIN ] LC: Full history saved. [2025-09-26T19:46:31.993038] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 28.9s. Estimated remaining: 2h 30m 34s. Rate: 7.5 symbols/min [2025-09-26T19:46:32.185525] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:32.222754] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:46:32.244801] [DEBUG] [LOCAL ] LDP: Loaded 13041 existing records from primary storage. [2025-09-26T19:46:32.244953] [INFO ] [MAIN ] LDP: Loaded 13041 existing records. [2025-09-26T19:46:32.436918] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:32.437494] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-26T19:46:32.443844] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-26T19:46:32.457310] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-26T19:46:32.457423] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-26T19:46:32.578355] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-26T19:46:32.719394] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-26T19:46:32.865898] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:33.522291] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-26T19:46:33.528814] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:46:33.952835] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-26T19:46:33.957781] [INFO ] [REMOTE ] LCII: Full fetch complete (39096 records). [2025-09-26T19:46:33.957880] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-26T19:46:34.316693] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-26T19:46:34.353994] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-26T19:46:34.354183] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-26T19:46:34.355637] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-26T19:46:34.355880] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-26T19:46:34.371400] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-26T19:46:34.369915] [DEBUG] [LOCAL ] LCII: Trimmed 39096 records to 28900 (keeping 200 days of data) [2025-09-26T19:46:34.569914] [DEBUG] [LOCAL ] LCII: Primary data saved (28900 records). [2025-09-26T19:46:34.570097] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-26T19:46:34.570226] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LCII took 26.9s. Estimated remaining: 2h 30m 21s. Rate: 7.5 symbols/min [2025-09-26T19:46:34.745016] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:34.788437] [DEBUG] [LOCAL ] LEA: Loaded 42166 existing records from primary storage. [2025-09-26T19:46:34.788593] [INFO ] [MAIN ] LEA: Loaded 42166 existing records. [2025-09-26T19:46:34.970279] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:34.970560] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-26T19:46:34.970608] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-26T19:46:34.971565] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-26T19:46:34.971626] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-26T19:46:35.122152] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-26T19:46:35.372763] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:35.780541] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T19:46:35.911711] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-26T19:46:35.971901] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-26T19:46:36.711771] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-26T19:46:37.460719] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-26T19:46:37.511708] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-26T19:46:37.957809] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-26T19:46:38.311765] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-26T19:46:38.893362] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:46:39.111750] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-26T19:46:39.911713] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-26T19:46:39.990911] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-26T19:46:40.711726] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-26T19:46:40.815189] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:46:41.499267] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T19:46:41.511667] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-26T19:46:41.600940] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-26T19:46:42.311756] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-26T19:46:42.427924] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-26T19:46:43.111764] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-26T19:46:43.911725] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-26T19:46:44.613239] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-26T19:46:44.707308] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-26T19:46:44.717218] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-26T19:46:44.720279] [INFO ] [REMOTE ] LDI: Full fetch complete (60332 records). [2025-09-26T19:46:44.720466] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-26T19:46:45.184198] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-26T19:46:45.184340] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-26T19:46:45.186323] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-26T19:46:45.186437] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-26T19:46:45.191183] [DEBUG] [LOCAL ] LDI: Trimmed 60332 records to 44776 (keeping 200 days of data) [2025-09-26T19:46:45.398795] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:46:45.511974] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-26T19:46:45.523444] [DEBUG] [LOCAL ] LDI: Primary data saved (44776 records). [2025-09-26T19:46:45.523566] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-26T19:46:45.523758] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LDI took 35.9s. Estimated remaining: 2h 30m 16s. Rate: 7.5 symbols/min [2025-09-26T19:46:45.726319] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:45.740275] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-26T19:46:45.804011] [DEBUG] [LOCAL ] LEG: Loaded 50759 existing records from primary storage. [2025-09-26T19:46:45.804179] [INFO ] [MAIN ] LEG: Loaded 50759 existing records. [2025-09-26T19:46:46.007323] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:46.007711] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-26T19:46:46.007778] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-26T19:46:46.009053] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-26T19:46:46.009136] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-26T19:46:46.312992] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-26T19:46:46.398768] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:47.093495] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-26T19:46:47.111739] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-26T19:46:47.911724] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-26T19:46:47.987759] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:46:48.036739] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-26T19:46:48.711753] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-26T19:46:49.511698] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-26T19:46:49.554130] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:46:50.311729] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-26T19:46:50.460045] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-26T19:46:50.498507] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:46:51.111716] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-26T19:46:51.911694] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-26T19:46:51.991441] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-26T19:46:52.000832] [INFO ] [REMOTE ] LDOS: Full fetch complete (67729 records). [2025-09-26T19:46:52.001004] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-26T19:46:52.203676] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-26T19:46:52.436267] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-26T19:46:52.436593] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-26T19:46:52.437678] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-26T19:46:52.437745] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-26T19:46:52.441768] [DEBUG] [LOCAL ] LDOS: Trimmed 67729 records to 46407 (keeping 200 days of data) [2025-09-26T19:46:52.725724] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-26T19:46:52.753820] [DEBUG] [LOCAL ] LDOS: Primary data saved (46407 records). [2025-09-26T19:46:52.753991] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-26T19:46:52.754128] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 39.1s. Estimated remaining: 2h 30m 7s. Rate: 7.5 symbols/min [2025-09-26T19:46:52.939342] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:52.998938] [DEBUG] [LOCAL ] LEN: Loaded 53580 existing records from primary storage. [2025-09-26T19:46:52.999093] [INFO ] [MAIN ] LEN: Loaded 53580 existing records. [2025-09-26T19:46:53.200088] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:53.200537] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-26T19:46:53.200776] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-26T19:46:53.210098] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-26T19:46:53.215382] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-26T19:46:53.309180] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-26T19:46:53.523186] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-26T19:46:53.733190] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:54.311705] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-26T19:46:54.475554] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T19:46:54.548104] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:46:55.111747] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-26T19:46:55.911717] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-26T19:46:56.047126] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T19:46:56.051298] [INFO ] [REMOTE ] LDP: Full fetch complete (19438 records). [2025-09-26T19:46:56.051428] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-26T19:46:56.301059] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T19:46:56.524997] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-26T19:46:56.525088] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-26T19:46:56.525629] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-26T19:46:56.525757] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-26T19:46:56.526454] [DEBUG] [LOCAL ] LDP: Trimmed 19438 records to 13128 (keeping 200 days of data) [2025-09-26T19:46:56.625625] [DEBUG] [LOCAL ] LDP: Primary data saved (13128 records). [2025-09-26T19:46:56.625812] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-26T19:46:56.625924] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 24.6s. Estimated remaining: 2h 29m 55s. Rate: 7.5 symbols/min [2025-09-26T19:46:56.716846] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-26T19:46:56.824334] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:46:56.846959] [DEBUG] [LOCAL ] LEO: Loaded 17726 existing records from primary storage. [2025-09-26T19:46:56.847095] [INFO ] [MAIN ] LEO: Loaded 17726 existing records. [2025-09-26T19:46:57.054731] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:46:57.055032] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-26T19:46:57.055106] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-26T19:46:57.055718] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-26T19:46:57.055781] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-26T19:46:57.456945] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:46:57.522799] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-26T19:46:57.528939] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:46:58.311695] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-26T19:46:58.561767] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-26T19:46:58.708089] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-26T19:46:59.111752] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-26T19:46:59.911687] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-26T19:47:00.328704] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-26T19:47:00.537379] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:47:00.711735] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-26T19:47:01.511713] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-26T19:47:01.656518] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-26T19:47:02.311774] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-26T19:47:02.380676] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-26T19:47:02.565123] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T19:47:03.111771] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-26T19:47:03.911717] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-26T19:47:04.135087] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-26T19:47:04.711717] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-26T19:47:04.912104] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-26T19:47:05.168203] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-26T19:47:05.511719] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-26T19:47:06.311706] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-26T19:47:06.783494] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-26T19:47:06.824062] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-26T19:47:07.111724] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-26T19:47:07.311869] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T19:47:07.911715] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-26T19:47:08.711741] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-26T19:47:08.840120] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T19:47:09.511729] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-26T19:47:09.577726] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:47:09.586800] [INFO ] [REMOTE ] LEA: Full fetch complete (60973 records). [2025-09-26T19:47:09.587017] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-26T19:47:09.992826] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-26T19:47:09.992921] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-26T19:47:09.993855] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-26T19:47:09.993922] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-26T19:47:09.996292] [DEBUG] [LOCAL ] LEA: Trimmed 60973 records to 42464 (keeping 200 days of data) [2025-09-26T19:47:10.291942] [DEBUG] [LOCAL ] LEA: Primary data saved (42464 records). [2025-09-26T19:47:10.292107] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-26T19:47:10.292234] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 35.7s. Estimated remaining: 2h 29m 52s. Rate: 7.5 symbols/min [2025-09-26T19:47:10.314995] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-26T19:47:10.484154] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:10.551183] [DEBUG] [LOCAL ] LEVI: Loaded 51936 existing records from primary storage. [2025-09-26T19:47:10.551520] [INFO ] [MAIN ] LEVI: Loaded 51936 existing records. [2025-09-26T19:47:10.769812] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:10.772666] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-26T19:47:10.773047] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-26T19:47:10.775387] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-26T19:47:10.781343] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-26T19:47:10.781438] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-26T19:47:10.992452] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-26T19:47:11.119689] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-26T19:47:11.250564] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:11.911717] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-26T19:47:12.061909] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-26T19:47:12.141036] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-26T19:47:12.711754] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-26T19:47:13.511711] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-26T19:47:13.712720] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-26T19:47:13.823358] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-26T19:47:14.311763] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-26T19:47:15.016041] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T19:47:15.111719] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-26T19:47:15.268748] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-26T19:47:15.911726] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-26T19:47:16.711773] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-26T19:47:16.813801] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:47:17.511756] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-26T19:47:17.787409] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-26T19:47:17.819910] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-26T19:47:18.311769] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-26T19:47:19.111890] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-26T19:47:19.357805] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-26T19:47:19.361546] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-26T19:47:19.375764] [INFO ] [REMOTE ] LEO: Full fetch complete (27132 records). [2025-09-26T19:47:19.376610] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-26T19:47:19.413281] [INFO ] [REMOTE ] LEG: Full fetch complete (73208 records). [2025-09-26T19:47:19.424037] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-26T19:47:19.935773] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-26T19:47:20.248962] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-26T19:47:20.273210] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-26T19:47:20.273080] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-26T19:47:20.273916] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-26T19:47:20.274001] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-26T19:47:20.274077] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-26T19:47:20.275041] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-26T19:47:20.275127] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-26T19:47:20.276216] [DEBUG] [LOCAL ] LEO: Trimmed 27132 records to 17785 (keeping 200 days of data) [2025-09-26T19:47:20.277713] [DEBUG] [LOCAL ] LEG: Trimmed 73208 records to 51130 (keeping 200 days of data) [2025-09-26T19:47:20.493115] [DEBUG] [LOCAL ] LEO: Primary data saved (17785 records). [2025-09-26T19:47:20.510137] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-26T19:47:20.518844] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEO took 23.9s. Estimated remaining: 2h 29m 46s. Rate: 7.5 symbols/min [2025-09-26T19:47:20.986454] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:21.045023] [DEBUG] [LOCAL ] LFT: Loaded 18180 existing records from primary storage. [2025-09-26T19:47:21.046568] [INFO ] [MAIN ] LFT: Loaded 18180 existing records. [2025-09-26T19:47:21.054048] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-26T19:47:21.127947] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-26T19:47:21.154319] [DEBUG] [LOCAL ] LEG: Primary data saved (51130 records). [2025-09-26T19:47:21.161968] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-26T19:47:21.162214] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEG took 35.6s. Estimated remaining: 2h 29m 32s. Rate: 7.5 symbols/min [2025-09-26T19:47:21.411418] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:21.417072] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-26T19:47:21.427383] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-26T19:47:21.476114] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-26T19:47:21.475971] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:21.476548] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-26T19:47:21.696005] [DEBUG] [LOCAL ] LGI: Loaded 10065 existing records from primary storage. [2025-09-26T19:47:21.723585] [INFO ] [MAIN ] LGI: Loaded 10065 existing records. [2025-09-26T19:47:22.150526] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:22.169136] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-26T19:47:22.196549] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:22.197799] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-26T19:47:22.198359] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-26T19:47:22.204305] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-26T19:47:22.216197] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-26T19:47:22.216556] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-26T19:47:22.318715] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-26T19:47:22.630481] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:22.910622] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-26T19:47:23.111709] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-26T19:47:23.326851] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T19:47:23.911766] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-26T19:47:24.358860] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-26T19:47:24.716861] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-26T19:47:24.737971] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T19:47:24.843066] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-26T19:47:25.511759] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-26T19:47:26.311806] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-26T19:47:26.409884] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-26T19:47:26.857478] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-26T19:47:26.869089] [INFO ] [REMOTE ] LEN: Full fetch complete (77032 records). [2025-09-26T19:47:26.869300] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-26T19:47:27.116074] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-26T19:47:27.197090] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-26T19:47:27.300308] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-26T19:47:27.300422] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-26T19:47:27.301516] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-26T19:47:27.301634] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-26T19:47:27.303912] [DEBUG] [LOCAL ] LEN: Trimmed 77032 records to 53967 (keeping 200 days of data) [2025-09-26T19:47:27.673311] [DEBUG] [LOCAL ] LEN: Primary data saved (53967 records). [2025-09-26T19:47:27.673551] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-26T19:47:27.673763] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 34.9s. Estimated remaining: 2h 29m 22s. Rate: 7.5 symbols/min [2025-09-26T19:47:27.860756] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:27.900837] [DEBUG] [LOCAL ] LH: Loaded 38437 existing records from primary storage. [2025-09-26T19:47:27.901001] [INFO ] [MAIN ] LH: Loaded 38437 existing records. [2025-09-26T19:47:27.916829] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-26T19:47:28.024273] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-26T19:47:28.115420] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:28.115761] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-26T19:47:28.115835] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-26T19:47:28.116890] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-26T19:47:28.116954] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-26T19:47:28.514609] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:28.711738] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-26T19:47:28.813416] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-26T19:47:29.511720] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-26T19:47:30.311713] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-26T19:47:30.569869] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-26T19:47:30.930245] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:47:30.956326] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-26T19:47:31.111720] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-26T19:47:31.911728] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-26T19:47:32.180320] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-26T19:47:32.711737] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-26T19:47:32.900352] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-26T19:47:33.511726] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-26T19:47:34.223740] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T19:47:34.311709] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-26T19:47:34.524563] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-26T19:47:35.111741] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-26T19:47:35.878047] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T19:47:35.911691] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-26T19:47:35.977425] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-26T19:47:36.711742] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-26T19:47:37.511717] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-26T19:47:37.526380] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-26T19:47:37.608699] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T19:47:38.311715] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-26T19:47:38.651164] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-26T19:47:39.111729] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-26T19:47:39.771637] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-26T19:47:39.905681] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-26T19:47:39.911638] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-26T19:47:40.438795] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-26T19:47:40.711746] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-26T19:47:41.511712] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-26T19:47:42.311686] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-26T19:47:42.420756] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-26T19:47:42.529843] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-26T19:47:43.053225] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-26T19:47:43.111725] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-26T19:47:43.911719] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-26T19:47:44.711698] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-26T19:47:44.804036] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T19:47:44.915748] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-26T19:47:44.919215] [INFO ] [REMOTE ] LFT: Full fetch complete (23981 records). [2025-09-26T19:47:44.919308] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-26T19:47:45.300296] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-26T19:47:45.300386] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-26T19:47:45.300922] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-26T19:47:45.300986] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-26T19:47:45.301718] [DEBUG] [LOCAL ] LFT: Trimmed 23981 records to 18286 (keeping 200 days of data) [2025-09-26T19:47:45.404341] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-26T19:47:45.434885] [DEBUG] [LOCAL ] LFT: Primary data saved (18286 records). [2025-09-26T19:47:45.435052] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-26T19:47:45.435143] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LFT took 24.9s. Estimated remaining: 2h 29m 23s. Rate: 7.5 symbols/min [2025-09-26T19:47:45.516909] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-26T19:47:45.626751] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:45.687927] [DEBUG] [LOCAL ] LHX: Loaded 49078 existing records from primary storage. [2025-09-26T19:47:45.688075] [INFO ] [MAIN ] LHX: Loaded 49078 existing records. [2025-09-26T19:47:45.880771] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:45.881084] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-26T19:47:45.881134] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-26T19:47:45.882352] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-26T19:47:45.882415] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-26T19:47:46.268448] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:46.311727] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-26T19:47:46.530608] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T19:47:46.532793] [INFO ] [REMOTE ] LGI: Full fetch complete (14336 records). [2025-09-26T19:47:46.532870] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-26T19:47:46.922061] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-26T19:47:46.922145] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-26T19:47:46.922549] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-26T19:47:46.922663] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-26T19:47:46.923689] [DEBUG] [LOCAL ] LGI: Trimmed 14336 records to 10137 (keeping 200 days of data) [2025-09-26T19:47:46.989962] [DEBUG] [LOCAL ] LGI: Primary data saved (10137 records). [2025-09-26T19:47:46.990108] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-26T19:47:46.990197] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LGI took 25.8s. Estimated remaining: 2h 29m 9s. Rate: 7.5 symbols/min [2025-09-26T19:47:47.116938] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-26T19:47:47.177637] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:47.206954] [DEBUG] [LOCAL ] LII: Loaded 28514 existing records from primary storage. [2025-09-26T19:47:47.207118] [INFO ] [MAIN ] LII: Loaded 28514 existing records. [2025-09-26T19:47:47.399169] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:47.399532] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-26T19:47:47.399588] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-26T19:47:47.400367] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-26T19:47:47.400429] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-26T19:47:47.820727] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:47.911723] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-26T19:47:48.260097] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-26T19:47:48.687573] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-26T19:47:48.711690] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-26T19:47:48.751399] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-26T19:47:49.511727] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-26T19:47:50.311695] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-26T19:47:50.428856] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-26T19:47:51.111714] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-26T19:47:51.178190] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:47:51.891815] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-26T19:47:51.911671] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-26T19:47:52.527367] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-26T19:47:52.711726] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-26T19:47:53.511752] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-26T19:47:53.662564] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-26T19:47:54.321859] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-26T19:47:54.349399] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-26T19:47:55.111699] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-26T19:47:55.179369] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-26T19:47:55.189847] [INFO ] [REMOTE ] LEVI: Full fetch complete (74460 records). [2025-09-26T19:47:55.190013] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-26T19:47:55.611851] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-26T19:47:55.612013] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-26T19:47:55.613849] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-26T19:47:55.614001] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-26T19:47:55.615880] [DEBUG] [LOCAL ] LEVI: Trimmed 74460 records to 52306 (keeping 200 days of data) [2025-09-26T19:47:55.858491] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-26T19:47:55.930623] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-26T19:47:55.982045] [DEBUG] [LOCAL ] LEVI: Primary data saved (52306 records). [2025-09-26T19:47:55.982227] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-26T19:47:55.982359] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LEVI took 45.7s. Estimated remaining: 2h 29m 2s. Rate: 7.5 symbols/min [2025-09-26T19:47:56.170705] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:47:56.212876] [DEBUG] [LOCAL ] LION: Loaded 43618 existing records from primary storage. [2025-09-26T19:47:56.213028] [INFO ] [MAIN ] LION: Loaded 43618 existing records. [2025-09-26T19:47:56.407300] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:47:56.407626] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-26T19:47:56.407719] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-26T19:47:56.408539] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-26T19:47:56.408599] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-26T19:47:56.718182] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-26T19:47:56.816805] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:47:56.846547] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-26T19:47:57.374486] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:47:57.511714] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-26T19:47:58.141780] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-26T19:47:58.311734] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-26T19:47:59.111721] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-26T19:47:59.325587] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-26T19:47:59.406101] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T19:47:59.911723] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-26T19:48:00.520495] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-26T19:48:00.526609] [INFO ] [REMOTE ] LH: Full fetch complete (54877 records). [2025-09-26T19:48:00.526828] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-26T19:48:00.719638] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-26T19:48:00.935796] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-26T19:48:00.935882] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-26T19:48:00.936774] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-26T19:48:00.936852] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-26T19:48:00.938152] [DEBUG] [LOCAL ] LH: Trimmed 54877 records to 38660 (keeping 200 days of data) [2025-09-26T19:48:01.197512] [DEBUG] [LOCAL ] LH: Primary data saved (38660 records). [2025-09-26T19:48:01.198369] [INFO ] [MAIN ] LH: Full history saved. [2025-09-26T19:48:01.198780] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 33.5s. Estimated remaining: 2h 28m 52s. Rate: 7.5 symbols/min [2025-09-26T19:48:01.394076] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:01.402567] [DEBUG] [LOCAL ] LITB: Loaded 4406 existing records from primary storage. [2025-09-26T19:48:01.402766] [INFO ] [MAIN ] LITB: Loaded 4406 existing records. [2025-09-26T19:48:01.513413] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-26T19:48:01.630046] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:01.633069] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-26T19:48:01.633146] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-26T19:48:01.644202] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-26T19:48:01.644804] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-26T19:48:01.644939] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-26T19:48:01.772506] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-26T19:48:02.114386] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:02.311724] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-26T19:48:02.838242] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-26T19:48:03.111728] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-26T19:48:03.402991] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-26T19:48:03.911725] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-26T19:48:04.169253] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-26T19:48:04.487491] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-26T19:48:04.711724] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-26T19:48:05.511722] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-26T19:48:05.954157] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T19:48:05.995743] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-26T19:48:06.311728] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-26T19:48:07.111714] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-26T19:48:07.691689] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T19:48:07.828460] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-26T19:48:07.911719] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-26T19:48:08.711720] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-26T19:48:09.200010] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-26T19:48:09.511733] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-26T19:48:10.056339] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-26T19:48:10.120134] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-26T19:48:10.311754] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-26T19:48:11.111778] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-26T19:48:11.502674] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-26T19:48:11.748921] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-26T19:48:11.911797] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-26T19:48:12.711791] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-26T19:48:13.190222] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T19:48:13.511795] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-26T19:48:13.963555] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-26T19:48:14.311705] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-26T19:48:14.718196] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-26T19:48:15.111808] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-26T19:48:15.911758] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-26T19:48:16.053513] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T19:48:16.711744] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-26T19:48:17.095906] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-26T19:48:17.408751] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:48:17.414757] [INFO ] [REMOTE ] LII: Full fetch complete (41271 records). [2025-09-26T19:48:17.414884] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-26T19:48:17.501912] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:48:17.521052] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-26T19:48:17.838280] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-26T19:48:17.838407] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-26T19:48:17.839286] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-26T19:48:17.839357] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-26T19:48:17.840546] [DEBUG] [LOCAL ] LII: Trimmed 41271 records to 28648 (keeping 200 days of data) [2025-09-26T19:48:18.031618] [DEBUG] [LOCAL ] LII: Primary data saved (28648 records). [2025-09-26T19:48:18.031807] [INFO ] [MAIN ] LII: Full history saved. [2025-09-26T19:48:18.031924] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LII took 31.0s. Estimated remaining: 2h 28m 51s. Rate: 7.5 symbols/min [2025-09-26T19:48:18.222612] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:18.285889] [DEBUG] [LOCAL ] LLY: Loaded 53678 existing records from primary storage. [2025-09-26T19:48:18.286122] [INFO ] [MAIN ] LLY: Loaded 53678 existing records. [2025-09-26T19:48:18.320186] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-26T19:48:18.486191] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:18.486444] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-26T19:48:18.486512] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-26T19:48:18.488498] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-26T19:48:18.488562] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-26T19:48:18.882155] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:19.111763] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-26T19:48:19.397150] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-26T19:48:19.911771] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-26T19:48:20.075791] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-26T19:48:20.711746] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-26T19:48:21.420148] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-26T19:48:21.511760] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-26T19:48:21.642560] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-26T19:48:22.311743] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-26T19:48:22.620377] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T19:48:23.111776] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-26T19:48:23.611601] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-26T19:48:23.911743] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-26T19:48:24.034284] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-26T19:48:24.154675] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-26T19:48:24.164907] [INFO ] [REMOTE ] LHX: Full fetch complete (70803 records). [2025-09-26T19:48:24.165097] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-26T19:48:24.526447] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T19:48:24.578929] [INFO ] [REMOTE ] LITB: Full fetch complete (5636 records). [2025-09-26T19:48:24.590550] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-26T19:48:24.717029] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-26T19:48:24.741782] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-26T19:48:24.755633] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-26T19:48:24.757504] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-26T19:48:24.768638] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-26T19:48:24.839770] [DEBUG] [LOCAL ] LHX: Trimmed 70803 records to 49413 (keeping 200 days of data) [2025-09-26T19:48:25.262684] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-26T19:48:25.289194] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-26T19:48:25.303684] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-26T19:48:25.316479] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-26T19:48:25.330313] [DEBUG] [LOCAL ] LITB: Trimmed 5636 records to 4436 (keeping 200 days of data) [2025-09-26T19:48:25.426861] [DEBUG] [LOCAL ] LHX: Primary data saved (49413 records). [2025-09-26T19:48:25.427727] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-26T19:48:25.429189] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LHX took 40.0s. Estimated remaining: 2h 28m 43s. Rate: 7.5 symbols/min [2025-09-26T19:48:25.523393] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-26T19:48:25.523774] [DEBUG] [LOCAL ] LITB: Primary data saved (4436 records). [2025-09-26T19:48:25.538918] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-26T19:48:25.551781] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LITB took 24.4s. Estimated remaining: 2h 28m 28s. Rate: 7.5 symbols/min [2025-09-26T19:48:25.740776] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:25.827641] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:25.897305] [DEBUG] [LOCAL ] LMND: Loaded 52260 existing records from primary storage. [2025-09-26T19:48:25.897559] [INFO ] [MAIN ] LMND: Loaded 52260 existing records. [2025-09-26T19:48:26.049009] [DEBUG] [LOCAL ] LMT: Loaded 50266 existing records from primary storage. [2025-09-26T19:48:26.067955] [INFO ] [MAIN ] LMT: Loaded 50266 existing records. [2025-09-26T19:48:26.211593] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:26.223869] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-26T19:48:26.234578] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-26T19:48:26.263120] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-26T19:48:26.273755] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-26T19:48:26.375725] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:26.404468] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-26T19:48:26.431844] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-26T19:48:26.442733] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-26T19:48:26.448064] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-26T19:48:27.088431] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:27.110208] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-26T19:48:27.211154] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:27.211875] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-26T19:48:27.248355] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-26T19:48:27.513812] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-26T19:48:27.911769] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-26T19:48:28.711737] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-26T19:48:29.294734] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-26T19:48:29.436993] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-26T19:48:29.511687] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-26T19:48:29.730132] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:48:29.740242] [INFO ] [REMOTE ] LION: Full fetch complete (54496 records). [2025-09-26T19:48:29.740398] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-26T19:48:30.137460] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-26T19:48:30.137661] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-26T19:48:30.139065] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-26T19:48:30.139151] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-26T19:48:30.140845] [DEBUG] [LOCAL ] LION: Trimmed 54496 records to 43950 (keeping 200 days of data) [2025-09-26T19:48:30.316120] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-26T19:48:30.402744] [DEBUG] [LOCAL ] LION: Primary data saved (43950 records). [2025-09-26T19:48:30.402951] [INFO ] [MAIN ] LION: Full history saved. [2025-09-26T19:48:30.403065] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LION took 34.4s. Estimated remaining: 2h 28m 17s. Rate: 7.5 symbols/min [2025-09-26T19:48:30.582059] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:30.635371] [DEBUG] [LOCAL ] LNC: Loaded 51993 existing records from primary storage. [2025-09-26T19:48:30.635584] [INFO ] [MAIN ] LNC: Loaded 51993 existing records. [2025-09-26T19:48:30.834573] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:30.835079] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-26T19:48:30.835154] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-26T19:48:30.836427] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-26T19:48:30.836501] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-26T19:48:31.238943] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:31.239417] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-26T19:48:31.283201] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-26T19:48:31.525564] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-26T19:48:31.911685] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-26T19:48:32.281732] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-26T19:48:32.711721] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-26T19:48:33.036483] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-26T19:48:33.511767] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-26T19:48:34.034768] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-26T19:48:34.311713] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-26T19:48:34.630845] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-26T19:48:35.111759] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-26T19:48:35.819997] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-26T19:48:35.911702] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-26T19:48:36.014483] [DEBUG] [REMOTE ] LMT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-26T19:48:36.016505] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-26T19:48:36.016601] [WARN ] [REMOTE ] LMT: No data returned for month 2025-03 [2025-09-26T19:48:36.711717] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-26T19:48:37.001981] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-26T19:48:37.511732] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-26T19:48:38.311703] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-26T19:48:38.345416] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-26T19:48:39.111728] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-26T19:48:39.581973] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-26T19:48:39.911722] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-26T19:48:40.496935] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-26T19:48:40.711723] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-26T19:48:41.511708] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-26T19:48:41.850041] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-26T19:48:41.894396] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-26T19:48:42.311697] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-26T19:48:42.433722] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:48:43.111737] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-26T19:48:43.286305] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-26T19:48:43.911724] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-26T19:48:44.450335] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-26T19:48:44.711739] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-26T19:48:45.380948] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-26T19:48:45.511735] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-26T19:48:45.559193] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-26T19:48:46.311728] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-26T19:48:47.111740] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-26T19:48:47.333977] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-26T19:48:47.911733] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-26T19:48:48.004146] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-26T19:48:48.509595] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-26T19:48:48.711723] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-26T19:48:49.511742] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-26T19:48:50.525618] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-26T19:48:50.537856] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-26T19:48:50.942463] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-26T19:48:51.111682] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-26T19:48:51.215982] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-26T19:48:51.911710] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-26T19:48:52.894358] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (5.78 seconds). [2025-09-26T19:48:52.905638] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-26T19:48:53.296457] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-26T19:48:53.366437] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-26T19:48:53.377059] [INFO ] [REMOTE ] LMT: Full fetch complete (64748 records). [2025-09-26T19:48:53.377204] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-26T19:48:53.516951] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-26T19:48:53.588939] [WARN ] [VALIDATOR ] LMT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-26T19:48:53.590219] [FATAL] [MAIN ] LMT: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:48:53.590300] [WARN ] [MAIN ] LMT: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:48:53.590354] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-26T19:48:53.590415] [DEBUG] [LOCAL ] LMT: No primary data file found to delete. [2025-09-26T19:48:53.590453] [INFO ] [LOCAL ] LMT: Starting deletion of derivative data. [2025-09-26T19:48:53.590928] [DEBUG] [LOCAL ] LMT: Deleted derivative data file. [2025-09-26T19:48:53.591068] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LMT took 28.0s. Estimated remaining: 2h 28m 22s. Rate: 7.5 symbols/min [2025-09-26T19:48:53.772060] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:53.779513] [DEBUG] [LOCAL ] LND: Loaded 4991 existing records from primary storage. [2025-09-26T19:48:53.779619] [INFO ] [MAIN ] LND: Loaded 4991 existing records. [2025-09-26T19:48:53.970674] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:53.971165] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-26T19:48:53.971225] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-26T19:48:53.971482] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-26T19:48:53.971544] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-26T19:48:54.378850] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:54.379592] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-26T19:48:54.411135] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-26T19:48:54.422481] [INFO ] [REMOTE ] LMND: Full fetch complete (75295 records). [2025-09-26T19:48:54.422769] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-26T19:48:54.888678] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-26T19:48:54.891672] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-26T19:48:54.891804] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-26T19:48:54.902889] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-26T19:48:54.902979] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-26T19:48:54.905103] [DEBUG] [LOCAL ] LMND: Trimmed 75295 records to 52647 (keeping 200 days of data) [2025-09-26T19:48:55.112102] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-26T19:48:55.231113] [DEBUG] [LOCAL ] LMND: Primary data saved (52647 records). [2025-09-26T19:48:55.231347] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-26T19:48:55.231455] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMND took 29.8s. Estimated remaining: 2h 28m 9s. Rate: 7.5 symbols/min [2025-09-26T19:48:55.358738] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-26T19:48:55.427921] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:55.480898] [DEBUG] [LOCAL ] LNG: Loaded 51871 existing records from primary storage. [2025-09-26T19:48:55.481048] [INFO ] [MAIN ] LNG: Loaded 51871 existing records. [2025-09-26T19:48:55.670029] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:55.670364] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-26T19:48:55.670414] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-26T19:48:55.671727] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-26T19:48:55.671792] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-26T19:48:55.915757] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-26T19:48:56.077820] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:56.339345] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-09-26T19:48:56.352319] [INFO ] [REMOTE ] LLY: Full fetch complete (77259 records). [2025-09-26T19:48:56.352542] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-26T19:48:56.714750] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-26T19:48:56.714941] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-26T19:48:56.812363] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-26T19:48:56.812536] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-26T19:48:56.814034] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-26T19:48:56.814195] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-26T19:48:56.818323] [DEBUG] [LOCAL ] LLY: Trimmed 77259 records to 54064 (keeping 200 days of data) [2025-09-26T19:48:57.113925] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-26T19:48:57.259404] [DEBUG] [LOCAL ] LLY: Primary data saved (54064 records). [2025-09-26T19:48:57.259570] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-26T19:48:57.260958] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LLY took 39.2s. Estimated remaining: 2h 27m 55s. Rate: 7.5 symbols/min [2025-09-26T19:48:57.441176] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:48:57.455666] [DEBUG] [LOCAL ] LNN: Loaded 11349 existing records from primary storage. [2025-09-26T19:48:57.455807] [INFO ] [MAIN ] LNN: Loaded 11349 existing records. [2025-09-26T19:48:57.522296] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-26T19:48:57.652004] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:48:57.652734] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-26T19:48:57.652794] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-26T19:48:57.653608] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-26T19:48:57.653712] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-26T19:48:58.022734] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:48:58.307249] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-26T19:48:58.311670] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-26T19:48:58.650696] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T19:48:59.000359] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-26T19:48:59.111744] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-26T19:48:59.747215] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-26T19:48:59.911721] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-26T19:49:00.711731] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-26T19:49:00.907692] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-26T19:49:01.511719] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-26T19:49:02.112089] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-26T19:49:02.311714] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-26T19:49:02.558687] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T19:49:02.954970] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-26T19:49:03.111708] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-26T19:49:03.911725] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-26T19:49:04.100277] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-26T19:49:04.711727] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-26T19:49:05.511736] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-26T19:49:05.521260] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-26T19:49:06.135122] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-26T19:49:06.145859] [INFO ] [REMOTE ] LNC: Full fetch complete (74118 records). [2025-09-26T19:49:06.146044] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-26T19:49:06.314742] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-26T19:49:06.450321] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-26T19:49:06.609503] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-26T19:49:06.609622] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-26T19:49:06.610781] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-26T19:49:06.610850] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-26T19:49:06.613685] [DEBUG] [LOCAL ] LNC: Trimmed 74118 records to 52369 (keeping 200 days of data) [2025-09-26T19:49:06.951044] [DEBUG] [LOCAL ] LNC: Primary data saved (52369 records). [2025-09-26T19:49:06.951192] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-26T19:49:06.951283] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 36.5s. Estimated remaining: 2h 27m 49s. Rate: 7.5 symbols/min [2025-09-26T19:49:07.115350] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-26T19:49:07.136569] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:07.182188] [DEBUG] [LOCAL ] LOAR: Loaded 41940 existing records from primary storage. [2025-09-26T19:49:07.182362] [INFO ] [MAIN ] LOAR: Loaded 41940 existing records. [2025-09-26T19:49:07.413415] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:07.413772] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-26T19:49:07.413845] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-26T19:49:07.414775] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-26T19:49:07.414839] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-26T19:49:07.830182] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:07.831164] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-26T19:49:07.911704] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-26T19:49:08.536798] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-26T19:49:08.541600] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-26T19:49:08.711733] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-26T19:49:09.511777] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-26T19:49:10.130852] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-26T19:49:10.311730] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-26T19:49:10.507710] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-26T19:49:11.111756] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-26T19:49:11.711472] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-26T19:49:11.881715] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-26T19:49:11.911698] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-26T19:49:12.711704] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-26T19:49:12.906204] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-26T19:49:13.173883] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-26T19:49:13.175329] [INFO ] [REMOTE ] LND: Full fetch complete (8608 records). [2025-09-26T19:49:13.175404] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-26T19:49:13.516843] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-26T19:49:13.588492] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-26T19:49:13.588571] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-26T19:49:13.588831] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-26T19:49:13.588896] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-26T19:49:13.589442] [DEBUG] [LOCAL ] LND: Trimmed 8608 records to 5013 (keeping 200 days of data) [2025-09-26T19:49:13.621610] [DEBUG] [LOCAL ] LND: Primary data saved (5013 records). [2025-09-26T19:49:13.621745] [INFO ] [MAIN ] LND: Full history saved. [2025-09-26T19:49:13.621897] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 20.0s. Estimated remaining: 2h 27m 40s. Rate: 7.5 symbols/min [2025-09-26T19:49:13.799401] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:13.847879] [DEBUG] [LOCAL ] LOB: Loaded 27742 existing records from primary storage. [2025-09-26T19:49:13.848042] [INFO ] [MAIN ] LOB: Loaded 27742 existing records. [2025-09-26T19:49:14.030347] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:14.030711] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-26T19:49:14.030785] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-26T19:49:14.031461] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-26T19:49:14.031527] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-26T19:49:14.318626] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-26T19:49:14.431867] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:14.749232] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-26T19:49:15.111752] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-26T19:49:15.911719] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-26T19:49:16.391457] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-26T19:49:16.606270] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-26T19:49:16.711707] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-26T19:49:16.742939] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T19:49:17.511737] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-26T19:49:18.311725] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-26T19:49:18.502932] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-26T19:49:18.533078] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-26T19:49:18.916927] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-26T19:49:18.919627] [INFO ] [REMOTE ] LNN: Full fetch complete (15564 records). [2025-09-26T19:49:18.919783] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-26T19:49:19.122224] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-26T19:49:19.323997] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-26T19:49:19.324168] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-26T19:49:19.324833] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-26T19:49:19.324902] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-26T19:49:19.325543] [DEBUG] [LOCAL ] LNN: Trimmed 15564 records to 11404 (keeping 200 days of data) [2025-09-26T19:49:19.420742] [DEBUG] [LOCAL ] LNN: Primary data saved (11404 records). [2025-09-26T19:49:19.420917] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-26T19:49:19.421026] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LNN took 22.2s. Estimated remaining: 2h 27m 30s. Rate: 7.5 symbols/min [2025-09-26T19:49:19.608200] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:19.613596] [DEBUG] [LOCAL ] LOCL: Loaded 3622 existing records from primary storage. [2025-09-26T19:49:19.613725] [INFO ] [MAIN ] LOCL: Loaded 3622 existing records. [2025-09-26T19:49:19.805473] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:19.805782] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-26T19:49:19.805838] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-26T19:49:19.806124] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-26T19:49:19.806184] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-26T19:49:19.916465] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-26T19:49:20.187196] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:20.612501] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:49:20.711731] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-26T19:49:21.116034] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-26T19:49:21.511761] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-26T19:49:22.311733] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-26T19:49:22.692719] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-26T19:49:22.985435] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-26T19:49:23.119861] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-26T19:49:23.137353] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-26T19:49:23.911686] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-26T19:49:24.304613] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-26T19:49:24.711728] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-26T19:49:25.511726] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-26T19:49:25.781678] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T19:49:25.834957] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-26T19:49:26.131448] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-26T19:49:26.311717] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-26T19:49:26.689194] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-26T19:49:27.111744] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-26T19:49:27.911802] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-26T19:49:28.711705] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-26T19:49:28.942700] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-26T19:49:29.062487] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-26T19:49:29.511738] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-26T19:49:29.808234] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-26T19:49:30.306759] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-26T19:49:30.311660] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-26T19:49:30.763357] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-26T19:49:31.111749] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-26T19:49:31.911723] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-26T19:49:32.711712] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-26T19:49:33.019708] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-26T19:49:33.054499] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-26T19:49:33.221847] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-26T19:49:33.511725] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-26T19:49:34.311730] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-26T19:49:35.111712] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-26T19:49:35.167690] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-26T19:49:35.230359] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-26T19:49:35.911723] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-26T19:49:36.711713] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-26T19:49:37.000021] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-26T19:49:37.278081] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-26T19:49:37.511738] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-26T19:49:38.311692] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-26T19:49:38.733779] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (3.62 seconds). [2025-09-26T19:49:38.807537] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-26T19:49:38.856172] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-26T19:49:39.111734] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-26T19:49:39.911719] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-26T19:49:40.390228] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-26T19:49:40.711741] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-26T19:49:40.848320] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-26T19:49:40.849945] [INFO ] [REMOTE ] LOCL: Full fetch complete (4811 records). [2025-09-26T19:49:40.850019] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-26T19:49:41.222928] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-26T19:49:41.223053] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-26T19:49:41.223238] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-26T19:49:41.223284] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-26T19:49:41.223737] [DEBUG] [LOCAL ] LOCL: Trimmed 4811 records to 3644 (keeping 200 days of data) [2025-09-26T19:49:41.245301] [DEBUG] [LOCAL ] LOCL: Primary data saved (3644 records). [2025-09-26T19:49:41.245410] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-26T19:49:41.245511] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LOCL took 21.8s. Estimated remaining: 2h 27m 34s. Rate: 7.5 symbols/min [2025-09-26T19:49:41.433481] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:41.478515] [DEBUG] [LOCAL ] LOMA: Loaded 32261 existing records from primary storage. [2025-09-26T19:49:41.478688] [INFO ] [MAIN ] LOMA: Loaded 32261 existing records. [2025-09-26T19:49:41.516935] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-26T19:49:41.666570] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:41.666848] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-26T19:49:41.666933] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-26T19:49:41.667584] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-26T19:49:41.667675] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-26T19:49:42.042729] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:42.311732] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-26T19:49:42.609968] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-26T19:49:42.620140] [INFO ] [REMOTE ] LNG: Full fetch complete (74720 records). [2025-09-26T19:49:42.620280] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-26T19:49:43.038664] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-26T19:49:43.038841] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-26T19:49:43.039859] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-26T19:49:43.039982] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-26T19:49:43.056433] [DEBUG] [LOCAL ] LNG: Trimmed 74720 records to 52224 (keeping 200 days of data) [2025-09-26T19:49:43.068808] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-26T19:49:43.141903] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-26T19:49:43.427657] [DEBUG] [LOCAL ] LNG: Primary data saved (52224 records). [2025-09-26T19:49:43.427872] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-26T19:49:43.428062] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LNG took 48.2s. Estimated remaining: 2h 27m 21s. Rate: 7.5 symbols/min [2025-09-26T19:49:43.613605] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:43.670538] [DEBUG] [LOCAL ] LOW: Loaded 53346 existing records from primary storage. [2025-09-26T19:49:43.670743] [INFO ] [MAIN ] LOW: Loaded 53346 existing records. [2025-09-26T19:49:43.864004] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:43.864667] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-26T19:49:43.864791] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-26T19:49:43.875415] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-26T19:49:43.880727] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-26T19:49:43.926026] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-26T19:49:43.986974] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T19:49:44.303850] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:44.708828] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T19:49:44.717588] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-26T19:49:45.388478] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-26T19:49:45.396006] [INFO ] [REMOTE ] LOB: Full fetch complete (37791 records). [2025-09-26T19:49:45.396176] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-26T19:49:45.516981] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-26T19:49:45.811906] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-26T19:49:45.812009] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-26T19:49:45.812876] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-26T19:49:45.812944] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-26T19:49:45.814061] [DEBUG] [LOCAL ] LOB: Trimmed 37791 records to 27886 (keeping 200 days of data) [2025-09-26T19:49:46.009441] [DEBUG] [LOCAL ] LOB: Primary data saved (27886 records). [2025-09-26T19:49:46.009747] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-26T19:49:46.010010] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOB took 32.4s. Estimated remaining: 2h 27m 8s. Rate: 7.5 symbols/min [2025-09-26T19:49:46.209291] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:46.233891] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-26T19:49:46.286665] [DEBUG] [LOCAL ] LPG: Loaded 40307 existing records from primary storage. [2025-09-26T19:49:46.286957] [INFO ] [MAIN ] LPG: Loaded 40307 existing records. [2025-09-26T19:49:46.319908] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-26T19:49:46.491575] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:46.491946] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-26T19:49:46.491999] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-26T19:49:46.492973] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-26T19:49:46.493036] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-26T19:49:46.883574] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:47.111724] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-26T19:49:47.213511] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:49:47.221541] [INFO ] [REMOTE ] LOAR: Full fetch complete (56473 records). [2025-09-26T19:49:47.221742] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-26T19:49:47.636846] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-26T19:49:47.636991] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-26T19:49:47.638180] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-26T19:49:47.638263] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-26T19:49:47.640039] [DEBUG] [LOCAL ] LOAR: Trimmed 56473 records to 42150 (keeping 200 days of data) [2025-09-26T19:49:47.793866] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T19:49:47.911904] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-26T19:49:47.941570] [DEBUG] [LOCAL ] LOAR: Primary data saved (42150 records). [2025-09-26T19:49:47.941743] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-26T19:49:47.941845] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOAR took 41.0s. Estimated remaining: 2h 26m 55s. Rate: 7.5 symbols/min [2025-09-26T19:49:48.129967] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:49:48.157812] [DEBUG] [LOCAL ] LPL: Loaded 26050 existing records from primary storage. [2025-09-26T19:49:48.157985] [INFO ] [MAIN ] LPL: Loaded 26050 existing records. [2025-09-26T19:49:48.349779] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:49:48.350052] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-26T19:49:48.350104] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-26T19:49:48.350793] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-26T19:49:48.350856] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-26T19:49:48.740811] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:49:48.734296] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-26T19:49:48.852195] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-26T19:49:49.290479] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-26T19:49:49.511724] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-26T19:49:50.267358] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-26T19:49:50.311696] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-26T19:49:51.111704] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-26T19:49:51.393795] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-26T19:49:51.911726] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-26T19:49:52.274704] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-26T19:49:52.711765] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-26T19:49:52.748220] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-26T19:49:53.505086] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T19:49:53.511664] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-26T19:49:54.311776] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-26T19:49:54.522041] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-26T19:49:54.621116] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-26T19:49:55.111738] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-26T19:49:55.904229] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-26T19:49:55.912455] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-26T19:49:56.538639] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-26T19:49:56.711715] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-26T19:49:56.933704] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-26T19:49:57.511802] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-26T19:49:58.318590] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-26T19:49:58.336716] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-26T19:49:58.372112] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-26T19:49:59.111733] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-26T19:49:59.604186] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-26T19:49:59.869323] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-26T19:49:59.911743] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-26T19:50:00.711753] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-26T19:50:01.081263] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-26T19:50:01.511714] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-26T19:50:02.311708] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-26T19:50:02.394864] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-26T19:50:03.111714] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-26T19:50:03.447316] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T19:50:03.648198] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-26T19:50:03.911733] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-26T19:50:04.711688] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-26T19:50:04.746245] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:50:05.178078] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-26T19:50:05.511723] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-26T19:50:06.311720] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-26T19:50:06.339701] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-26T19:50:07.111753] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-26T19:50:07.148685] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:50:07.882343] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-26T19:50:07.911675] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-26T19:50:07.994287] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-26T19:50:08.711769] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-26T19:50:09.469534] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-26T19:50:09.477942] [INFO ] [REMOTE ] LPL: Full fetch complete (34855 records). [2025-09-26T19:50:09.478141] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-26T19:50:09.516946] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-26T19:50:09.891737] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-26T19:50:09.891824] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-26T19:50:09.892466] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-26T19:50:09.892507] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-26T19:50:09.893439] [DEBUG] [LOCAL ] LPL: Trimmed 34855 records to 26305 (keeping 200 days of data) [2025-09-26T19:50:10.044482] [DEBUG] [LOCAL ] LPL: Primary data saved (26305 records). [2025-09-26T19:50:10.044629] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-26T19:50:10.044788] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LPL took 22.1s. Estimated remaining: 2h 26m 59s. Rate: 7.5 symbols/min [2025-09-26T19:50:10.243065] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:10.294811] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-26T19:50:10.315695] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-26T19:50:10.320114] [DEBUG] [LOCAL ] LPX: Loaded 40015 existing records from primary storage. [2025-09-26T19:50:10.321043] [INFO ] [MAIN ] LPX: Loaded 40015 existing records. [2025-09-26T19:50:10.514619] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:10.514932] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-26T19:50:10.514997] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-26T19:50:10.515964] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-26T19:50:10.516028] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-26T19:50:10.901283] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:11.111704] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-26T19:50:11.564441] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-26T19:50:11.911696] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-26T19:50:12.013915] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-26T19:50:12.022818] [INFO ] [REMOTE ] LOMA: Full fetch complete (48174 records). [2025-09-26T19:50:12.023015] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-26T19:50:12.471510] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-26T19:50:12.471684] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-26T19:50:12.472494] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-26T19:50:12.472557] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-26T19:50:12.473811] [DEBUG] [LOCAL ] LOMA: Trimmed 48174 records to 32576 (keeping 200 days of data) [2025-09-26T19:50:12.688030] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:50:12.715008] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-26T19:50:12.714873] [DEBUG] [LOCAL ] LOMA: Primary data saved (32576 records). [2025-09-26T19:50:12.716337] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-26T19:50:12.716458] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LOMA took 31.5s. Estimated remaining: 2h 26m 46s. Rate: 7.5 symbols/min [2025-09-26T19:50:12.919267] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:12.963115] [DEBUG] [LOCAL ] LRN: Loaded 40224 existing records from primary storage. [2025-09-26T19:50:12.963278] [INFO ] [MAIN ] LRN: Loaded 40224 existing records. [2025-09-26T19:50:13.161470] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:13.162016] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-26T19:50:13.162077] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-26T19:50:13.163022] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-26T19:50:13.163085] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-26T19:50:13.516112] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-26T19:50:13.594197] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:13.634600] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-26T19:50:14.311717] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-26T19:50:14.614516] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-26T19:50:15.111738] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-26T19:50:15.757132] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-26T19:50:15.911735] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-26T19:50:16.377172] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-26T19:50:16.678495] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-26T19:50:16.711728] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-26T19:50:17.036247] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-26T19:50:17.511781] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-26T19:50:18.231977] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T19:50:18.239554] [INFO ] [REMOTE ] LPG: Full fetch complete (59732 records). [2025-09-26T19:50:18.239713] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-26T19:50:18.320677] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-26T19:50:18.652592] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-26T19:50:18.652719] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-26T19:50:18.653674] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-26T19:50:18.653743] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-26T19:50:18.655117] [DEBUG] [LOCAL ] LPG: Trimmed 59732 records to 40536 (keeping 200 days of data) [2025-09-26T19:50:18.911786] [DEBUG] [LOCAL ] LPG: Primary data saved (40536 records). [2025-09-26T19:50:18.911922] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-26T19:50:18.912047] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LPG took 32.9s. Estimated remaining: 2h 26m 37s. Rate: 7.5 symbols/min [2025-09-26T19:50:19.098949] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:19.111764] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-26T19:50:19.145250] [DEBUG] [LOCAL ] LSPD: Loaded 43518 existing records from primary storage. [2025-09-26T19:50:19.145409] [INFO ] [MAIN ] LSPD: Loaded 43518 existing records. [2025-09-26T19:50:19.332250] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:19.332509] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-26T19:50:19.332561] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-26T19:50:19.333687] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-26T19:50:19.333753] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-26T19:50:19.712803] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:19.911709] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-26T19:50:20.298730] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-26T19:50:20.656082] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-26T19:50:20.696973] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-26T19:50:20.711668] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-26T19:50:21.407781] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-26T19:50:21.511729] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-26T19:50:21.901059] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-26T19:50:22.311751] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-26T19:50:22.883667] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T19:50:23.111717] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-26T19:50:23.911719] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-26T19:50:24.234265] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T19:50:24.711745] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-26T19:50:24.920105] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-26T19:50:25.440953] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-26T19:50:25.511732] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-26T19:50:25.932188] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-26T19:50:26.311734] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-26T19:50:27.111720] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-26T19:50:27.147236] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-26T19:50:27.607749] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-26T19:50:27.911723] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-26T19:50:28.705325] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-26T19:50:28.717422] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-26T19:50:29.516798] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-26T19:50:29.537882] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-26T19:50:30.311734] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-26T19:50:30.447630] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-26T19:50:30.660212] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-26T19:50:31.111708] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-26T19:50:31.911727] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-26T19:50:32.122474] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-26T19:50:32.133059] [INFO ] [REMOTE ] LOW: Full fetch complete (76498 records). [2025-09-26T19:50:32.133238] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-26T19:50:32.574924] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-26T19:50:32.575120] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-26T19:50:32.576223] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-26T19:50:32.576332] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-26T19:50:32.578125] [DEBUG] [LOCAL ] LOW: Trimmed 76498 records to 53721 (keeping 200 days of data) [2025-09-26T19:50:32.719196] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-26T19:50:32.720818] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-26T19:50:32.968236] [DEBUG] [LOCAL ] LOW: Primary data saved (53721 records). [2025-09-26T19:50:32.968441] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-26T19:50:32.968588] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LOW took 49.5s. Estimated remaining: 2h 26m 34s. Rate: 7.5 symbols/min [2025-09-26T19:50:33.162792] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:33.194748] [DEBUG] [LOCAL ] LTC: Loaded 30236 existing records from primary storage. [2025-09-26T19:50:33.194923] [INFO ] [MAIN ] LTC: Loaded 30236 existing records. [2025-09-26T19:50:33.393557] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:33.394015] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-26T19:50:33.394113] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-26T19:50:33.405358] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-26T19:50:33.421262] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-26T19:50:33.511190] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-26T19:50:33.536534] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-26T19:50:33.880795] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:34.314734] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-26T19:50:34.319958] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-26T19:50:35.111730] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-26T19:50:35.200670] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-26T19:50:35.911698] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-26T19:50:36.014037] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-26T19:50:36.705529] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-26T19:50:36.714895] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-26T19:50:37.412194] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-26T19:50:37.421429] [INFO ] [REMOTE ] LRN: Full fetch complete (58423 records). [2025-09-26T19:50:37.421663] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-26T19:50:37.517900] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-26T19:50:37.859189] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-26T19:50:37.864991] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-26T19:50:37.865993] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-26T19:50:37.875712] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-26T19:50:37.877430] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-26T19:50:37.884463] [DEBUG] [LOCAL ] LRN: Trimmed 58423 records to 40503 (keeping 200 days of data) [2025-09-26T19:50:38.141496] [DEBUG] [LOCAL ] LRN: Primary data saved (40503 records). [2025-09-26T19:50:38.141630] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-26T19:50:38.141776] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LRN took 25.4s. Estimated remaining: 2h 26m 23s. Rate: 7.5 symbols/min [2025-09-26T19:50:38.324565] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-26T19:50:38.328534] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:50:38.383452] [DEBUG] [LOCAL ] LTH: Loaded 52212 existing records from primary storage. [2025-09-26T19:50:38.383635] [INFO ] [MAIN ] LTH: Loaded 52212 existing records. [2025-09-26T19:50:38.589411] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:50:38.589742] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-26T19:50:38.589800] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-26T19:50:38.591103] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-26T19:50:38.591188] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-26T19:50:39.111717] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-26T19:50:39.163231] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:50:39.192967] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T19:50:39.682346] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-26T19:50:39.911722] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-26T19:50:40.711743] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-26T19:50:40.764165] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:50:40.772586] [INFO ] [REMOTE ] LPX: Full fetch complete (58628 records). [2025-09-26T19:50:40.772767] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-26T19:50:41.191734] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-26T19:50:41.191968] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-26T19:50:41.192962] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-26T19:50:41.193031] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-26T19:50:41.194487] [DEBUG] [LOCAL ] LPX: Trimmed 58628 records to 40311 (keeping 200 days of data) [2025-09-26T19:50:41.461498] [DEBUG] [LOCAL ] LPX: Primary data saved (40311 records). [2025-09-26T19:50:41.461632] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-26T19:50:41.461757] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LPX took 31.4s. Estimated remaining: 2h 26m 11s. Rate: 7.5 symbols/min [2025-09-26T19:50:41.511733] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-26T19:50:41.791854] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-26T19:50:42.202951] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-26T19:50:42.311745] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-26T19:50:42.829037] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T19:50:43.111712] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-26T19:50:43.911720] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-26T19:50:43.993405] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-26T19:50:44.680618] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-26T19:50:44.711742] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-26T19:50:45.284754] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-26T19:50:45.511722] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-26T19:50:46.230330] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-26T19:50:46.238864] [INFO ] [REMOTE ] LSPD: Full fetch complete (61463 records). [2025-09-26T19:50:46.239032] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-26T19:50:46.322250] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-26T19:50:46.709281] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-26T19:50:46.709449] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-26T19:50:46.710568] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-26T19:50:46.710705] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-26T19:50:46.712330] [DEBUG] [LOCAL ] LSPD: Trimmed 61463 records to 43782 (keeping 200 days of data) [2025-09-26T19:50:46.963922] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-26T19:50:47.007580] [DEBUG] [LOCAL ] LSPD: Primary data saved (43782 records). [2025-09-26T19:50:47.007745] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-26T19:50:47.007856] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LSPD took 28.1s. Estimated remaining: 2h 26m 1s. Rate: 7.5 symbols/min [2025-09-26T19:50:47.111722] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-26T19:50:47.942489] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:50:47.953128] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-26T19:50:48.486951] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-26T19:50:48.711757] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-26T19:50:49.397509] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-26T19:50:49.511736] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-26T19:50:50.104976] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-26T19:50:50.311756] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-26T19:50:51.266789] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-26T19:50:51.277772] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-26T19:50:51.846742] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-26T19:50:51.911740] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-26T19:50:53.039680] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-26T19:50:53.051083] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-26T19:50:53.348536] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-26T19:50:53.511758] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-26T19:50:54.665822] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-26T19:50:54.679739] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-26T19:50:54.705326] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-26T19:50:54.714114] [INFO ] [REMOTE ] LTC: Full fetch complete (43191 records). [2025-09-26T19:50:54.714311] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-26T19:50:55.142767] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-26T19:50:55.142859] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-26T19:50:55.143632] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-26T19:50:55.143781] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-26T19:50:55.145096] [DEBUG] [LOCAL ] LTC: Trimmed 43191 records to 30478 (keeping 200 days of data) [2025-09-26T19:50:55.351722] [DEBUG] [LOCAL ] LTC: Primary data saved (30478 records). [2025-09-26T19:50:55.351878] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-26T19:50:55.351973] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LTC took 22.4s. Estimated remaining: 2h 25m 53s. Rate: 7.5 symbols/min [2025-09-26T19:50:56.105277] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:50:56.117821] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-26T19:50:57.828952] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-26T19:50:57.841154] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-26T19:50:59.663565] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-26T19:50:59.675780] [INFO ] [REMOTE ] LTH: Full fetch complete (74025 records). [2025-09-26T19:50:59.675962] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-26T19:51:00.137933] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-26T19:51:00.138061] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-26T19:51:00.139045] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-26T19:51:00.139113] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-26T19:51:00.140718] [DEBUG] [LOCAL ] LTH: Trimmed 74025 records to 52563 (keeping 200 days of data) [2025-09-26T19:51:00.467857] [DEBUG] [LOCAL ] LTH: Primary data saved (52563 records). [2025-09-26T19:51:00.468008] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-26T19:51:00.468113] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 22.3s. Estimated remaining: 2h 25m 43s. Rate: 7.5 symbols/min [2025-09-26T19:51:01.078563] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:01.157271] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-26T19:51:01.260455] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:01.259434] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-26T19:51:01.322055] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-26T19:51:01.321964] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:01.323250] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:01.323470] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-26T19:51:01.324075] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-26T19:51:01.324492] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-26T19:51:01.635247] [DEBUG] [LOCAL ] LTM: Loaded 36687 existing records from primary storage. [2025-09-26T19:51:01.641400] [INFO ] [MAIN ] LTM: Loaded 36687 existing records. [2025-09-26T19:51:01.734262] [DEBUG] [LOCAL ] LU: Loaded 49314 existing records from primary storage. [2025-09-26T19:51:01.826220] [INFO ] [MAIN ] LU: Loaded 49314 existing records. [2025-09-26T19:51:01.815452] [DEBUG] [LOCAL ] LUMN: Loaded 54024 existing records from primary storage. [2025-09-26T19:51:01.865048] [INFO ] [MAIN ] LUMN: Loaded 54024 existing records. [2025-09-26T19:51:02.120724] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:02.168373] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-26T19:51:02.305513] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:02.419667] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-26T19:51:02.445176] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-26T19:51:02.445039] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:02.487742] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-26T19:51:02.491214] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:02.491368] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-26T19:51:02.491614] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-26T19:51:02.491819] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-26T19:51:02.484188] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-26T19:51:02.491980] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-26T19:51:02.498198] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-26T19:51:02.498249] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-26T19:51:02.548729] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-26T19:51:02.548796] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-26T19:51:03.630216] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:03.651854] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-26T19:51:03.660342] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:03.732448] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-26T19:51:03.735672] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:03.749710] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-26T19:51:03.752197] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-26T19:51:03.757764] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-26T19:51:04.861603] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-26T19:51:04.867019] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-26T19:51:05.312498] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-26T19:51:05.322196] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-26T19:51:05.416268] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-26T19:51:05.426683] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-26T19:51:05.613286] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-26T19:51:05.619019] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-26T19:51:05.820118] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-26T19:51:05.831558] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-26T19:51:06.404160] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-26T19:51:06.410118] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-26T19:51:06.701466] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-26T19:51:06.709925] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-26T19:51:06.794028] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-26T19:51:06.803962] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-26T19:51:07.418400] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-26T19:51:07.425034] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-26T19:51:07.744752] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-26T19:51:07.781684] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-26T19:51:07.911738] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-26T19:51:08.552953] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T19:51:08.674041] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-26T19:51:08.711751] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-26T19:51:09.511698] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-26T19:51:09.653830] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-26T19:51:09.701969] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-26T19:51:10.311744] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-26T19:51:11.111698] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-26T19:51:11.234881] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-26T19:51:11.911757] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-26T19:51:12.234152] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-26T19:51:12.534527] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-26T19:51:12.711719] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-26T19:51:13.282853] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-26T19:51:13.511724] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-26T19:51:14.138826] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-26T19:51:14.311770] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-26T19:51:15.111763] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-26T19:51:15.500127] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-26T19:51:15.916272] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-26T19:51:15.923259] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-26T19:51:16.613465] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-26T19:51:16.711741] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-26T19:51:17.511731] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-26T19:51:17.772992] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-26T19:51:18.309919] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-26T19:51:18.319870] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-26T19:51:19.111708] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-26T19:51:19.488681] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-26T19:51:19.499848] [INFO ] [REMOTE ] LTM: Full fetch complete (47300 records). [2025-09-26T19:51:19.500058] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-26T19:51:19.637197] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-26T19:51:19.923689] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-26T19:51:19.964860] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-26T19:51:19.965232] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-26T19:51:19.966116] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-26T19:51:19.966220] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-26T19:51:19.967918] [DEBUG] [LOCAL ] LTM: Trimmed 47300 records to 37076 (keeping 200 days of data) [2025-09-26T19:51:20.210537] [DEBUG] [LOCAL ] LTM: Primary data saved (37076 records). [2025-09-26T19:51:20.210833] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-26T19:51:20.211142] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LTM took 19.7s. Estimated remaining: 2h 25m 45s. Rate: 7.5 symbols/min [2025-09-26T19:51:20.402828] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:20.464977] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-09-26T19:51:20.465129] [INFO ] [MAIN ] LUV: Loaded 54079 existing records. [2025-09-26T19:51:20.665383] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:20.665853] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-26T19:51:20.665913] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-26T19:51:20.667402] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-26T19:51:20.667475] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-26T19:51:20.716836] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-26T19:51:21.086111] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:21.102598] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-26T19:51:21.145594] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-26T19:51:21.511748] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-26T19:51:22.311713] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-26T19:51:22.368902] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-26T19:51:22.799285] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-26T19:51:23.111713] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-26T19:51:23.911715] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-26T19:51:24.292680] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-26T19:51:24.711743] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-26T19:51:25.106101] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-26T19:51:25.186553] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-26T19:51:25.511746] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-26T19:51:26.311728] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-26T19:51:26.604799] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-26T19:51:27.073927] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-26T19:51:27.111679] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-26T19:51:27.911703] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-26T19:51:28.145941] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-26T19:51:28.593731] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-26T19:51:28.714484] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-26T19:51:28.718402] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-26T19:51:28.726199] [INFO ] [REMOTE ] LUCK: Full fetch complete (40658 records). [2025-09-26T19:51:28.726364] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-26T19:51:28.928898] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-26T19:51:28.929409] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:51:28.929483] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:51:28.929557] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-26T19:51:28.929625] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-26T19:51:28.929701] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-26T19:51:28.929779] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-26T19:51:28.929886] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LUCK took 28.5s. Estimated remaining: 2h 25m 37s. Rate: 7.5 symbols/min [2025-09-26T19:51:29.113757] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:29.113959] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-26T19:51:29.114059] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-26T19:51:29.114240] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-26T19:51:29.114289] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-26T19:51:29.114341] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-26T19:51:29.114435] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-26T19:51:29.507320] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:29.511693] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-26T19:51:29.729952] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:29.730320] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-26T19:51:30.311730] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-26T19:51:30.443930] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-26T19:51:30.453696] [INFO ] [REMOTE ] LU: Full fetch complete (70415 records). [2025-09-26T19:51:30.453847] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-26T19:51:30.907961] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-26T19:51:30.908046] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-26T19:51:30.909036] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-26T19:51:30.909105] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-26T19:51:30.913282] [DEBUG] [LOCAL ] LU: Trimmed 70415 records to 49679 (keeping 200 days of data) [2025-09-26T19:51:31.129151] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-26T19:51:31.224529] [DEBUG] [LOCAL ] LU: Primary data saved (49679 records). [2025-09-26T19:51:31.224717] [INFO ] [MAIN ] LU: Full history saved. [2025-09-26T19:51:31.224850] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LU took 30.8s. Estimated remaining: 2h 25m 24s. Rate: 7.5 symbols/min [2025-09-26T19:51:31.408024] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:31.469023] [DEBUG] [LOCAL ] LVS: Loaded 53954 existing records from primary storage. [2025-09-26T19:51:31.469170] [INFO ] [MAIN ] LVS: Loaded 53954 existing records. [2025-09-26T19:51:31.663186] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:31.663454] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-26T19:51:31.663504] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-26T19:51:31.664761] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-26T19:51:31.664833] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-26T19:51:31.912177] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-26T19:51:32.076859] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:32.108637] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-26T19:51:32.185132] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:32.185534] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-26T19:51:32.711759] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-26T19:51:33.413446] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-26T19:51:33.427255] [INFO ] [REMOTE ] LUMN: Full fetch complete (77634 records). [2025-09-26T19:51:33.427428] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-26T19:51:33.522320] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-26T19:51:33.816286] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:33.859348] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-26T19:51:34.064293] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-26T19:51:34.064384] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-26T19:51:34.065397] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-26T19:51:34.065467] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-26T19:51:34.068699] [DEBUG] [LOCAL ] LUMN: Trimmed 77634 records to 54414 (keeping 200 days of data) [2025-09-26T19:51:34.311849] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-26T19:51:34.424079] [DEBUG] [LOCAL ] LUMN: Primary data saved (54414 records). [2025-09-26T19:51:34.424241] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-26T19:51:34.424348] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUMN took 34.0s. Estimated remaining: 2h 25m 12s. Rate: 7.5 symbols/min [2025-09-26T19:51:34.511839] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:34.537597] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-26T19:51:34.615821] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:34.654170] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-26T19:51:34.682535] [DEBUG] [LOCAL ] LVWR: Loaded 17624 existing records from primary storage. [2025-09-26T19:51:34.682733] [INFO ] [MAIN ] LVWR: Loaded 17624 existing records. [2025-09-26T19:51:34.894857] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:34.895122] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-26T19:51:34.895190] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-26T19:51:34.895899] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-26T19:51:34.895962] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-26T19:51:35.120314] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-26T19:51:35.289032] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:35.383158] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-26T19:51:35.383591] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-26T19:51:35.911727] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-26T19:51:36.499276] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T19:51:36.711740] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-26T19:51:37.425617] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-26T19:51:37.511709] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-26T19:51:38.103199] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-26T19:51:38.311726] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-26T19:51:39.111714] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-26T19:51:39.375579] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-26T19:51:39.911723] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-26T19:51:40.719759] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-26T19:51:40.725793] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-26T19:51:41.511705] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-26T19:51:41.627109] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-26T19:51:41.886924] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-26T19:51:42.311741] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-26T19:51:42.872609] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-26T19:51:42.995354] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-26T19:51:43.111684] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-26T19:51:43.911733] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-26T19:51:44.536537] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-26T19:51:44.711706] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-26T19:51:44.809113] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-26T19:51:45.511792] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-26T19:51:46.311835] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-26T19:51:46.886634] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T19:51:47.111748] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-26T19:51:47.230183] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-26T19:51:47.677869] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-26T19:51:47.911741] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-26T19:51:48.711761] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-26T19:51:48.988427] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-26T19:51:49.010694] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-26T19:51:49.511737] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-26T19:51:50.311716] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-26T19:51:50.517669] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-26T19:51:51.111711] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-26T19:51:51.425821] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-26T19:51:51.426717] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-26T19:51:51.911726] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-26T19:51:52.716836] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-26T19:51:52.752242] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-26T19:51:53.511700] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-26T19:51:53.546601] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-26T19:51:54.311707] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-26T19:51:54.588635] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-26T19:51:54.596690] [INFO ] [REMOTE ] LUXE: Full fetch complete (14057 records). [2025-09-26T19:51:54.596918] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-26T19:51:54.801890] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 103 unique days, need 200 days [2025-09-26T19:51:54.802430] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-26T19:51:54.802557] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-26T19:51:54.802920] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-26T19:51:54.803040] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-26T19:51:54.803197] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-26T19:51:54.803269] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-26T19:51:54.803355] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LUXE took 25.9s. Estimated remaining: 2h 25m 15s. Rate: 7.5 symbols/min [2025-09-26T19:51:54.994811] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:51:55.031169] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-26T19:51:55.105630] [DEBUG] [LOCAL ] LW: Loaded 51531 existing records from primary storage. [2025-09-26T19:51:55.105818] [INFO ] [MAIN ] LW: Loaded 51531 existing records. [2025-09-26T19:51:55.117380] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-26T19:51:55.299298] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:51:55.299552] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-26T19:51:55.299603] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-26T19:51:55.300834] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-26T19:51:55.300898] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-26T19:51:55.694289] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:51:55.911716] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-26T19:51:56.271469] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-26T19:51:56.321004] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-26T19:51:56.711728] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-26T19:51:57.511696] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-26T19:51:57.553411] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-26T19:51:58.311696] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-26T19:51:58.341103] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-26T19:51:58.378094] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-26T19:51:59.111700] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-26T19:51:59.911687] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-26T19:52:00.236746] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-26T19:52:00.240888] [INFO ] [REMOTE ] LVWR: Full fetch complete (19857 records). [2025-09-26T19:52:00.240975] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-26T19:52:00.622727] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-26T19:52:00.689337] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-26T19:52:00.689439] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-26T19:52:00.689960] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-26T19:52:00.690027] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-26T19:52:00.690933] [DEBUG] [LOCAL ] LVWR: Trimmed 19857 records to 17668 (keeping 200 days of data) [2025-09-26T19:52:00.737022] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-26T19:52:00.801619] [DEBUG] [LOCAL ] LVWR: Primary data saved (17668 records). [2025-09-26T19:52:00.801818] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-26T19:52:00.801954] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LVWR took 26.4s. Estimated remaining: 2h 25m 5s. Rate: 7.5 symbols/min [2025-09-26T19:52:00.973246] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:00.991690] [DEBUG] [LOCAL ] LXFR: Loaded 17187 existing records from primary storage. [2025-09-26T19:52:00.991832] [INFO ] [MAIN ] LXFR: Loaded 17187 existing records. [2025-09-26T19:52:01.171689] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:01.171958] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-26T19:52:01.172005] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-26T19:52:01.172538] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-26T19:52:01.172598] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-26T19:52:01.516940] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-26T19:52:01.567029] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:01.898752] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-26T19:52:01.911600] [INFO ] [REMOTE ] LVS: Full fetch complete (77513 records). [2025-09-26T19:52:01.911817] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-26T19:52:02.312609] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-26T19:52:02.333810] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-26T19:52:02.333971] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-26T19:52:02.335236] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-26T19:52:02.335507] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-26T19:52:02.337289] [DEBUG] [LOCAL ] LVS: Trimmed 77513 records to 54342 (keeping 200 days of data) [2025-09-26T19:52:02.686706] [DEBUG] [LOCAL ] LVS: Primary data saved (54342 records). [2025-09-26T19:52:02.686903] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-26T19:52:02.687014] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LVS took 31.5s. Estimated remaining: 2h 24m 52s. Rate: 7.5 symbols/min [2025-09-26T19:52:02.882869] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-26T19:52:02.925726] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:02.981527] [DEBUG] [LOCAL ] LXP: Loaded 51002 existing records from primary storage. [2025-09-26T19:52:02.981710] [INFO ] [MAIN ] LXP: Loaded 51002 existing records. [2025-09-26T19:52:03.116890] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-26T19:52:03.176708] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:03.177000] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-26T19:52:03.177055] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-26T19:52:03.178227] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-26T19:52:03.178304] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-26T19:52:03.382278] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-26T19:52:03.589168] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:03.782606] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-26T19:52:03.793465] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-26T19:52:03.793684] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-26T19:52:03.916792] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-26T19:52:04.206857] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-26T19:52:04.206980] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-26T19:52:04.208072] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-26T19:52:04.208141] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-26T19:52:04.211618] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 54469 (keeping 200 days of data) [2025-09-26T19:52:04.576057] [DEBUG] [LOCAL ] LUV: Primary data saved (54469 records). [2025-09-26T19:52:04.576209] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-26T19:52:04.576308] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LUV took 44.4s. Estimated remaining: 2h 24m 39s. Rate: 7.5 symbols/min [2025-09-26T19:52:04.724419] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-26T19:52:04.760809] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:04.797850] [DEBUG] [LOCAL ] LXU: Loaded 32191 existing records from primary storage. [2025-09-26T19:52:04.798066] [INFO ] [MAIN ] LXU: Loaded 32191 existing records. [2025-09-26T19:52:04.993784] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:04.994496] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-26T19:52:04.994931] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-26T19:52:04.995706] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-26T19:52:04.995781] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-26T19:52:05.118731] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-26T19:52:05.170141] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-26T19:52:05.459668] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:05.511716] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-26T19:52:06.311687] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-26T19:52:06.420374] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-26T19:52:06.645413] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-26T19:52:07.111731] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-26T19:52:07.246356] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-26T19:52:07.911733] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-26T19:52:08.602707] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-26T19:52:08.711728] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-26T19:52:09.511745] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-26T19:52:09.787599] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-26T19:52:09.815676] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-26T19:52:10.311741] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-26T19:52:10.866417] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-26T19:52:11.111732] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-26T19:52:11.301581] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-26T19:52:11.911714] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-26T19:52:12.711719] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-26T19:52:12.934841] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-26T19:52:13.432276] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-26T19:52:13.511698] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-26T19:52:13.686330] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-26T19:52:14.311753] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-26T19:52:15.111688] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-26T19:52:15.247483] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-26T19:52:15.365067] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-26T19:52:15.911719] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-26T19:52:16.711739] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-26T19:52:16.772615] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-26T19:52:17.511690] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-26T19:52:17.614514] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-26T19:52:18.047739] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-26T19:52:18.311714] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-26T19:52:18.533731] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-26T19:52:19.111709] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-26T19:52:19.911725] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-26T19:52:20.143424] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-26T19:52:20.618075] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-26T19:52:20.711728] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-26T19:52:21.511734] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-26T19:52:21.654112] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-26T19:52:22.311758] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-26T19:52:22.490285] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-26T19:52:22.581351] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T19:52:23.111710] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-26T19:52:23.911705] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-26T19:52:23.963682] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-26T19:52:24.209712] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-26T19:52:24.711736] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-26T19:52:25.239833] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-26T19:52:25.511738] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-26T19:52:26.311742] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-26T19:52:26.602613] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-26T19:52:26.614547] [INFO ] [REMOTE ] LW: Full fetch complete (74614 records). [2025-09-26T19:52:26.614778] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-26T19:52:27.063019] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-26T19:52:27.063126] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-26T19:52:27.064115] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-26T19:52:27.064183] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-26T19:52:27.065822] [DEBUG] [LOCAL ] LW: Trimmed 74614 records to 51915 (keeping 200 days of data) [2025-09-26T19:52:27.128062] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-26T19:52:27.359876] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-26T19:52:27.369623] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-26T19:52:27.479307] [DEBUG] [LOCAL ] LW: Primary data saved (51915 records). [2025-09-26T19:52:27.479560] [INFO ] [MAIN ] LW: Full history saved. [2025-09-26T19:52:27.479743] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LW took 32.7s. Estimated remaining: 2h 24m 43s. Rate: 7.5 symbols/min [2025-09-26T19:52:27.668046] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:27.721890] [DEBUG] [LOCAL ] LYB: Loaded 53989 existing records from primary storage. [2025-09-26T19:52:27.722064] [INFO ] [MAIN ] LYB: Loaded 53989 existing records. [2025-09-26T19:52:27.914903] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-26T19:52:27.919712] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:27.920904] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-26T19:52:27.920999] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-26T19:52:27.922233] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-26T19:52:27.922322] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-26T19:52:28.301253] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:28.511452] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-26T19:52:28.711764] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-26T19:52:29.511729] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-26T19:52:29.617612] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-26T19:52:29.718168] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-26T19:52:29.721598] [INFO ] [REMOTE ] LXFR: Full fetch complete (25146 records). [2025-09-26T19:52:29.721711] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-26T19:52:30.130247] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-26T19:52:30.130389] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-26T19:52:30.131111] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-26T19:52:30.131185] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-26T19:52:30.132142] [DEBUG] [LOCAL ] LXFR: Trimmed 25146 records to 17259 (keeping 200 days of data) [2025-09-26T19:52:30.240021] [DEBUG] [LOCAL ] LXFR: Primary data saved (17259 records). [2025-09-26T19:52:30.240222] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-26T19:52:30.240323] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXFR took 29.4s. Estimated remaining: 2h 24m 31s. Rate: 7.5 symbols/min [2025-09-26T19:52:30.316928] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-26T19:52:30.430413] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:30.492434] [DEBUG] [LOCAL ] LYG: Loaded 53243 existing records from primary storage. [2025-09-26T19:52:30.492615] [INFO ] [MAIN ] LYG: Loaded 53243 existing records. [2025-09-26T19:52:30.710554] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:30.711233] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-26T19:52:30.711474] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-26T19:52:30.712694] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-26T19:52:30.712765] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-26T19:52:30.862338] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-26T19:52:31.116834] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-26T19:52:31.149911] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:31.911724] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-26T19:52:32.056204] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-26T19:52:32.711706] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-26T19:52:33.208551] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T19:52:33.214223] [INFO ] [REMOTE ] LXU: Full fetch complete (44982 records). [2025-09-26T19:52:33.214344] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-26T19:52:33.514303] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-26T19:52:33.642870] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-26T19:52:33.642976] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-26T19:52:33.643712] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-26T19:52:33.643777] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-26T19:52:33.644995] [DEBUG] [LOCAL ] LXU: Trimmed 44982 records to 32354 (keeping 200 days of data) [2025-09-26T19:52:33.781487] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-26T19:52:33.880531] [DEBUG] [LOCAL ] LXU: Primary data saved (32354 records). [2025-09-26T19:52:33.880797] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-26T19:52:33.880927] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXU took 29.3s. Estimated remaining: 2h 24m 19s. Rate: 7.5 symbols/min [2025-09-26T19:52:34.080985] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:34.136113] [DEBUG] [LOCAL ] LYV: Loaded 51528 existing records from primary storage. [2025-09-26T19:52:34.136363] [INFO ] [MAIN ] LYV: Loaded 51528 existing records. [2025-09-26T19:52:34.313496] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-26T19:52:34.337894] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:34.339722] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-26T19:52:34.339820] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-26T19:52:34.341069] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-26T19:52:34.341140] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-26T19:52:34.668153] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-26T19:52:34.800895] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:35.111704] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-26T19:52:35.538795] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-26T19:52:35.550781] [INFO ] [REMOTE ] LXP: Full fetch complete (72504 records). [2025-09-26T19:52:35.550991] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-26T19:52:35.913322] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-26T19:52:35.991063] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-26T19:52:35.991259] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-26T19:52:35.992364] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-26T19:52:35.992709] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-26T19:52:35.995055] [DEBUG] [LOCAL ] LXP: Trimmed 72504 records to 51361 (keeping 200 days of data) [2025-09-26T19:52:36.136827] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-26T19:52:36.351635] [DEBUG] [LOCAL ] LXP: Primary data saved (51361 records). [2025-09-26T19:52:36.351807] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-26T19:52:36.351940] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LXP took 33.7s. Estimated remaining: 2h 24m 6s. Rate: 7.5 symbols/min [2025-09-26T19:52:36.544544] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:52:36.579879] [DEBUG] [LOCAL ] LZB: Loaded 35833 existing records from primary storage. [2025-09-26T19:52:36.580030] [INFO ] [MAIN ] LZB: Loaded 35833 existing records. [2025-09-26T19:52:36.715693] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-26T19:52:36.776381] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:52:36.776977] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-26T19:52:36.777110] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-26T19:52:36.778250] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-26T19:52:36.778451] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-26T19:52:36.935192] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-26T19:52:37.212262] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:52:37.511723] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-26T19:52:37.759917] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-26T19:52:38.311692] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-26T19:52:38.484021] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:52:38.820379] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-26T19:52:39.111715] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-26T19:52:39.888866] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-26T19:52:39.911773] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-26T19:52:40.711725] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-26T19:52:40.805113] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-26T19:52:41.246150] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-26T19:52:41.511722] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-26T19:52:42.311698] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-26T19:52:42.485020] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-26T19:52:42.839048] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-26T19:52:43.111708] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-26T19:52:43.911715] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-26T19:52:44.266817] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T19:52:44.711733] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-26T19:52:45.070499] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-26T19:52:45.155017] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-26T19:52:45.511734] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-26T19:52:46.311728] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-26T19:52:46.650541] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-26T19:52:47.111703] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-26T19:52:47.803668] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-26T19:52:47.894530] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-26T19:52:47.911674] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-26T19:52:48.711730] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-26T19:52:48.782097] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-26T19:52:49.397122] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-26T19:52:49.511725] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-26T19:52:50.118752] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-26T19:52:50.311727] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-26T19:52:50.847881] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-26T19:52:51.111713] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-26T19:52:51.911699] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-26T19:52:52.000109] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-26T19:52:52.711694] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-26T19:52:52.761085] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-26T19:52:53.511701] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-26T19:52:53.620843] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-26T19:52:54.039561] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-26T19:52:54.311716] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-26T19:52:55.071197] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-26T19:52:55.111680] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-26T19:52:55.911699] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-26T19:52:56.084733] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T19:52:56.121133] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-26T19:52:56.711716] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-26T19:52:57.511701] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-26T19:52:57.995061] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-26T19:52:58.311682] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-26T19:52:58.483939] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-26T19:52:59.111704] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-26T19:52:59.449126] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T19:52:59.911711] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-26T19:53:00.166290] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-26T19:53:00.447663] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-26T19:53:00.711773] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-26T19:53:01.511695] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-26T19:53:02.005419] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-26T19:53:02.016119] [INFO ] [REMOTE ] LYG: Full fetch complete (76038 records). [2025-09-26T19:53:02.016332] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-26T19:53:02.316844] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-26T19:53:02.457959] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-26T19:53:02.458080] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-26T19:53:02.459256] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-26T19:53:02.459362] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-26T19:53:02.495206] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-26T19:53:02.495399] [DEBUG] [LOCAL ] LYG: Trimmed 76038 records to 53606 (keeping 200 days of data) [2025-09-26T19:53:02.832318] [DEBUG] [LOCAL ] LYG: Primary data saved (53606 records). [2025-09-26T19:53:02.832477] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-26T19:53:02.832584] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYG took 32.6s. Estimated remaining: 2h 24m 14s. Rate: 7.5 symbols/min [2025-09-26T19:53:03.013771] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:03.028267] [DEBUG] [LOCAL ] LZM: Loaded 13758 existing records from primary storage. [2025-09-26T19:53:03.028403] [INFO ] [MAIN ] LZM: Loaded 13758 existing records. [2025-09-26T19:53:03.116763] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-26T19:53:03.227676] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:03.227967] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-26T19:53:03.228018] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-26T19:53:03.228422] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-26T19:53:03.228482] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-26T19:53:03.625635] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:03.657118] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-26T19:53:03.668111] [INFO ] [REMOTE ] LYB: Full fetch complete (77456 records). [2025-09-26T19:53:03.668338] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-26T19:53:03.916981] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-26T19:53:04.100378] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-26T19:53:04.100525] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-26T19:53:04.101669] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-26T19:53:04.101847] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-26T19:53:04.103628] [DEBUG] [LOCAL ] LYB: Trimmed 77456 records to 54379 (keeping 200 days of data) [2025-09-26T19:53:04.254690] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-26T19:53:04.510593] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-26T19:53:04.543562] [DEBUG] [LOCAL ] LYB: Primary data saved (54379 records). [2025-09-26T19:53:04.543764] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-26T19:53:04.543880] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYB took 37.1s. Estimated remaining: 2h 24m 1s. Rate: 7.5 symbols/min [2025-09-26T19:53:04.718056] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-26T19:53:04.759193] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:04.764521] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-26T19:53:04.773247] [INFO ] [REMOTE ] LZB: Full fetch complete (50395 records). [2025-09-26T19:53:04.773404] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-26T19:53:05.157901] [DEBUG] [LOCAL ] M: Loaded 53925 existing records from primary storage. [2025-09-26T19:53:05.168534] [INFO ] [MAIN ] M: Loaded 53925 existing records. [2025-09-26T19:53:05.349237] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-26T19:53:05.367466] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-26T19:53:05.368547] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-26T19:53:05.369002] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-26T19:53:05.433588] [DEBUG] [LOCAL ] LZB: Trimmed 50395 records to 36113 (keeping 200 days of data) [2025-09-26T19:53:05.455116] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:05.456102] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-26T19:53:05.456548] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-26T19:53:05.520749] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-26T19:53:05.520612] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-26T19:53:05.521012] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-26T19:53:05.993599] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:06.110367] [DEBUG] [LOCAL ] LZB: Primary data saved (36113 records). [2025-09-26T19:53:06.110579] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-26T19:53:06.110722] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZB took 29.8s. Estimated remaining: 2h 23m 47s. Rate: 7.5 symbols/min [2025-09-26T19:53:06.290265] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:06.324191] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-26T19:53:06.348580] [DEBUG] [LOCAL ] MA: Loaded 52958 existing records from primary storage. [2025-09-26T19:53:06.348820] [INFO ] [MAIN ] MA: Loaded 52958 existing records. [2025-09-26T19:53:06.528099] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-26T19:53:06.602986] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:06.603768] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-26T19:53:06.603893] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-26T19:53:06.615874] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-26T19:53:06.639331] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-26T19:53:06.691906] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-26T19:53:06.768740] [INFO ] [REMOTE ] LYV: Full fetch complete (73640 records). [2025-09-26T19:53:06.779890] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-26T19:53:07.120282] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-26T19:53:07.463830] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:07.520827] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-26T19:53:07.520932] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-26T19:53:07.522245] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-26T19:53:07.522319] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-26T19:53:07.524140] [DEBUG] [LOCAL ] LYV: Trimmed 73640 records to 51906 (keeping 200 days of data) [2025-09-26T19:53:07.870896] [DEBUG] [LOCAL ] LYV: Primary data saved (51906 records). [2025-09-26T19:53:07.871106] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-26T19:53:07.871241] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LYV took 34.0s. Estimated remaining: 2h 23m 34s. Rate: 7.5 symbols/min [2025-09-26T19:53:07.918275] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-26T19:53:08.005793] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-26T19:53:08.096714] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:08.142253] [DEBUG] [LOCAL ] MAA: Loaded 43062 existing records from primary storage. [2025-09-26T19:53:08.142457] [INFO ] [MAIN ] MAA: Loaded 43062 existing records. [2025-09-26T19:53:08.354467] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:08.354996] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-26T19:53:08.355169] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-26T19:53:08.356229] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-26T19:53:08.356304] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-26T19:53:08.731494] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-26T19:53:08.809948] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:08.818114] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-26T19:53:09.511786] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-26T19:53:09.730297] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-26T19:53:09.767227] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-26T19:53:10.311817] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-26T19:53:11.104890] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-26T19:53:11.112587] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-26T19:53:11.159835] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-26T19:53:11.911757] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-26T19:53:12.709783] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-26T19:53:12.713952] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-26T19:53:12.845880] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-26T19:53:13.511728] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-26T19:53:14.311760] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-26T19:53:14.639223] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-26T19:53:14.994043] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-26T19:53:15.111753] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-26T19:53:15.786325] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-26T19:53:15.911773] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-26T19:53:16.429221] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-26T19:53:16.711846] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-26T19:53:17.511713] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-26T19:53:17.761214] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-26T19:53:18.311870] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-26T19:53:18.350112] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-26T19:53:18.761261] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-26T19:53:19.111843] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-26T19:53:19.905586] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-26T19:53:19.911660] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-26T19:53:20.057821] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-26T19:53:20.711746] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-26T19:53:20.818210] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-26T19:53:21.511757] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-26T19:53:22.311720] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-26T19:53:23.003862] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-26T19:53:23.114702] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-26T19:53:23.120665] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-26T19:53:23.348083] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-26T19:53:23.352387] [INFO ] [REMOTE ] LZM: Full fetch complete (18050 records). [2025-09-26T19:53:23.352485] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-26T19:53:23.746020] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-26T19:53:23.746133] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-26T19:53:23.746908] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-26T19:53:23.746975] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-26T19:53:23.747772] [DEBUG] [LOCAL ] LZM: Trimmed 18050 records to 13905 (keeping 200 days of data) [2025-09-26T19:53:23.829242] [DEBUG] [LOCAL ] LZM: Primary data saved (13905 records). [2025-09-26T19:53:23.829436] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-26T19:53:23.829546] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. LZM took 21.0s. Estimated remaining: 2h 23m 33s. Rate: 7.5 symbols/min [2025-09-26T19:53:23.916815] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-26T19:53:24.017300] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:24.075800] [DEBUG] [LOCAL ] MAC: Loaded 50079 existing records from primary storage. [2025-09-26T19:53:24.076062] [INFO ] [MAIN ] MAC: Loaded 50079 existing records. [2025-09-26T19:53:24.269236] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-09 for 200 day retention. Performing full refresh. [2025-09-26T19:53:24.269728] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-26T19:53:24.269791] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-26T19:53:24.271266] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-26T19:53:24.271474] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-26T19:53:24.653018] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-09 to 2025-09-26 (requires 10 months of data pull). [2025-09-26T19:53:24.711827] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-26T19:53:24.989118] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-26T19:53:25.092874] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-26T19:53:25.511748] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-26T19:53:26.311757] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-26T19:53:26.445785] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-26T19:53:27.116809] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-26T19:53:27.137200] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-26T19:53:27.911729] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-26T19:53:28.082044] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-26T19:53:28.711756] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-26T19:53:29.293370] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-26T19:53:29.512342] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-26T19:53:29.515736] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-26T19:53:30.311223] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-26T19:53:30.320205] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-26T19:53:31.111800] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-26T19:53:31.197627] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-26T19:53:31.917954] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-26T19:53:31.936792] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-26T19:53:32.441920] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-26T19:53:32.711755] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-26T19:53:33.511760] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-26T19:53:34.106104] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-26T19:53:34.311692] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-26T19:53:34.508559] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-26T19:53:35.111708] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-26T19:53:35.376718] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-26T19:53:35.911701] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-26T19:53:35.992660] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-26T19:53:36.711758] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-26T19:53:37.428965] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-26T19:53:37.511689] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-26T19:53:37.659386] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-26T19:53:38.311702] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-26T19:53:38.770043] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-26T19:53:38.807789] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-26T19:53:38.816422] [INFO ] [REMOTE ] MAA: Full fetch complete (61032 records). [2025-09-26T19:53:38.816630] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-26T19:53:39.116902] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-26T19:53:39.232327] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-26T19:53:39.232444] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-26T19:53:39.233776] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-26T19:53:39.233942] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-26T19:53:39.235837] [DEBUG] [LOCAL ] MAA: Trimmed 61032 records to 43354 (keeping 200 days of data) [2025-09-26T19:53:39.544186] [DEBUG] [LOCAL ] MAA: Primary data saved (43354 records). [2025-09-26T19:53:39.544435] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-26T19:53:39.544710] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MAA took 31.7s. Estimated remaining: 2h 23m 31s. Rate: 7.5 symbols/min [2025-09-26T19:53:39.742383] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-18 to 2025-09-26. [2025-09-26T19:53:39.788381] [DEBUG] [LOCAL ] MAGN: Loaded 35204 existing records from primary storage. [2025-09-26T19:53:39.788625] [INFO ] [MAIN ] MAGN: Loaded 35204 e